2024-05-12T10:46:53.611 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-12T10:46:53.611 DEBUG:teuthology.run:Teuthology command: teuthology --name leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279 --verbose -- /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/orig.config.yaml 2024-05-12T10:46:53.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-12T10:46:53.775 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279 branch: wip-lusov-quiesce-lock-auth description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} email: null first_in_suite: false job_id: '7703279' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiesce-lock-auth ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: f1ec882358465db8f363a3865fa83f099183688a subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: f1ec882358465db8f363a3865fa83f099183688a kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiesce-lock-auth sha1: f1ec882358465db8f363a3865fa83f099183688a owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7749 sha1: f1ec882358465db8f363a3865fa83f099183688a sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiesce-lock-auth suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f1ec882358465db8f363a3865fa83f099183688a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f1ec882358465db8f363a3865fa83f099183688a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfyevf8q51ASzpewW8YS9tuMF9kW9o6qGskdHHKUSPmq9LZu43jsCm5xLEGkWmHXS12xEva024MxGl0dBvwQhI= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPqlfYEcv8EN3xe1Tc1JMlfjbQsYFchaLCECX5It+K+BXCup4T+zGVD6m3P22PlqXsjT9MbtZZ/om/75IypYiY= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEVtz6y3+ZQgBsb4CjchFQya+a6EEKT4Sf/TQmR2MMBflQpfzkbJOvjaWemvcC8ewQ3/yFgTUf62aANhn6YRs2Q= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-12_10:14:03 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-12T10:46:53.775 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f1ec882358465db8f363a3865fa83f099183688a/qa; will attempt to use it 2024-05-12T10:46:53.776 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f1ec882358465db8f363a3865fa83f099183688a/qa/tasks 2024-05-12T10:46:53.776 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-12T10:46:53.777 INFO:teuthology.task.internal:Checking packages... 2024-05-12T10:46:53.801 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f1ec882358465db8f363a3865fa83f099183688a' 2024-05-12T10:46:53.801 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-12T10:46:53.801 INFO:teuthology.packaging:ref: None 2024-05-12T10:46:53.801 INFO:teuthology.packaging:tag: None 2024-05-12T10:46:53.801 INFO:teuthology.packaging:branch: wip-lusov-quiesce-lock-auth 2024-05-12T10:46:53.801 INFO:teuthology.packaging:sha1: f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:46:53.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiesce-lock-auth 2024-05-12T10:46:54.018 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3517.gf1ec8823 2024-05-12T10:46:54.020 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-12T10:46:54.027 INFO:teuthology.task.internal:no buildpackages task found 2024-05-12T10:46:54.027 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-12T10:46:54.048 INFO:teuthology.task.internal:Saving configuration 2024-05-12T10:46:54.071 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-12T10:46:54.077 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-12T10:46:54.103 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-12 10:41:41.261343', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfyevf8q51ASzpewW8YS9tuMF9kW9o6qGskdHHKUSPmq9LZu43jsCm5xLEGkWmHXS12xEva024MxGl0dBvwQhI='} 2024-05-12T10:46:54.127 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-12 10:41:41.258452', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPqlfYEcv8EN3xe1Tc1JMlfjbQsYFchaLCECX5It+K+BXCup4T+zGVD6m3P22PlqXsjT9MbtZZ/om/75IypYiY='} 2024-05-12T10:46:54.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-12 10:41:41.260223', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEVtz6y3+ZQgBsb4CjchFQya+a6EEKT4Sf/TQmR2MMBflQpfzkbJOvjaWemvcC8ewQ3/yFgTUf62aANhn6YRs2Q='} 2024-05-12T10:46:54.148 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-12T10:46:54.155 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-12T10:46:54.156 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-12T10:46:54.156 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-12T10:46:54.156 INFO:teuthology.run_tasks:Running task console_log... 2024-05-12T10:46:54.267 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b93f30160>, signals=[15]) 2024-05-12T10:46:54.267 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-12T10:46:54.273 INFO:teuthology.task.internal:Opening connections... 2024-05-12T10:46:54.274 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T10:46:54.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:46:54.357 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-05-12T10:46:54.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:46:54.435 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-05-12T10:46:54.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:46:54.512 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-12T10:46:54.519 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-05-12T10:46:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-05-12T10:46:54.537 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-05-12T10:46:54.593 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-12T10:46:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-12T10:46:54.595 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-12T10:46:54.595 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-05-12T10:46:54.618 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-05-12T10:46:54.636 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-05-12T10:46:54.636 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-05-12T10:46:54.693 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-05-12T10:46:54.693 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-05-12T10:46:54.693 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-12T10:46:54.694 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-12T10:46:54.695 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-05-12T10:46:54.718 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-05-12T10:46:54.736 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-05-12T10:46:54.736 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-05-12T10:46:54.794 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-05-12T10:46:54.794 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-05-12T10:46:54.794 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-05-12T10:46:54.794 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-12T10:46:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-12T10:46:54.796 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-05-12T10:46:54.818 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-12T10:46:54.829 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-12T10:46:54.836 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-12T10:46:54.836 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-05-12T10:46:54.839 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-05-12T10:46:54.842 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-05-12T10:46:54.858 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-12T10:46:54.864 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-12T10:46:54.864 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-05-12T10:46:54.896 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-05-12T10:46:54.899 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-05-12T10:46:55.170 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-12T10:46:55.253 INFO:teuthology.run_tasks:Running task kernel... 2024-05-12T10:46:55.267 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-05-12T10:46:55.268 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-12T10:46:55.268 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-12T10:46:55.268 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-12T10:46:55.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:46:55.285 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-05-12T10:46:55.343 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-437.el9.x86_64 2024-05-12T10:46:55.343 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.14.0-437.el9.x86_64 2024-05-12T10:46:55.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2024-05-12T10:46:58.632 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.1 MB 00:01 2024-05-12T10:47:03.158 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 19 MB 00:03 2024-05-12T10:47:07.234 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-05-12T10:47:09.017 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-05-12T10:47:09.869 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 30 MB/s | 21 MB 00:00 2024-05-12T10:47:15.002 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-12T10:47:15.214 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:01 ago on Sun 12 May 2024 10:47:14 AM UTC. 2024-05-12T10:47:16.983 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-12T10:47:16.983 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-12T10:47:17.077 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-05-12T10:47:17.093 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-05-12T10:47:17.093 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-05-12T10:47:17.093 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-05-12T10:47:17.093 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-05-12T10:47:17.093 INFO:teuthology.orchestra.run.smithi086.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-12T10:47:17.093 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-05-12T10:47:17.093 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-12T10:47:17.093 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout:Install 4 Packages 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 78 M 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 123 M 2024-05-12T10:47:17.094 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-05-12T10:47:18.065 INFO:teuthology.orchestra.run.smithi086.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 692 kB/s | 484 kB 00:00 2024-05-12T10:47:30.911 INFO:teuthology.orchestra.run.smithi086.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.1 MB/s | 15 MB 00:13 2024-05-12T10:47:48.368 INFO:teuthology.orchestra.run.smithi086.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 945 kB/s | 28 MB 00:30 2024-05-12T10:47:57.200 INFO:teuthology.orchestra.run.smithi086.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 872 kB/s | 34 MB 00:39 2024-05-12T10:47:57.201 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-05-12T10:47:57.201 INFO:teuthology.orchestra.run.smithi086.stdout:Total 1.9 MB/s | 78 MB 00:40 2024-05-12T10:47:57.874 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-05-12T10:47:58.209 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-05-12T10:47:58.209 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-05-12T10:47:59.137 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-05-12T10:47:59.137 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-05-12T10:48:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-05-12T10:48:02.276 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-12T10:48:02.359 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-12T10:48:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-12T10:48:05.202 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-12T10:48:09.928 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-12T10:48:10.062 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-12T10:48:14.780 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-12T10:48:44.127 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-12T10:48:44.165 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-12T10:48:44.540 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-12T10:48:44.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-12T10:48:44.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-12T10:48:44.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-12T10:48:45.288 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-12T10:48:45.288 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:48:45.288 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-05-12T10:48:45.288 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-12T10:48:45.288 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-12T10:48:45.289 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-12T10:48:45.289 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-12T10:48:45.289 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:48:45.289 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-05-12T10:48:45.640 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-05-12T10:48:45.707 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-12T10:48:45.708 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-12T10:48:45.708 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-12T10:48:45.708 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-12T10:48:45.708 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-12T10:48:45.708 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-12T10:48:45.709 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=None, version=distro) 2024-05-12T10:48:45.709 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-05-12T10:48:45.757 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-12T10:48:45.758 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-12T10:48:45.758 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -qi grub2-tools 2024-05-12T10:48:45.788 INFO:teuthology.orchestra.run.smithi086.stdout:Name : grub2-tools 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Epoch : 1 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Version : 2.06 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Release : 68.el9 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: x86_64 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Group : Unspecified 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Size : 8264254 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:License : GPLv3+ 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Packager : builder@centos.org 2024-05-12T10:48:45.789 INFO:teuthology.orchestra.run.smithi086.stdout:Vendor : CentOS 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout:Summary : Support tools for GRUB. 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout:Description : 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout:hardware devices. 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:48:45.790 INFO:teuthology.orchestra.run.smithi086.stdout:This subpackage provides tools for support of all platforms. 2024-05-12T10:48:45.791 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-12T10:48:45.791 INFO:teuthology.task.kernel:Updating grub on smithi086 to boot 5.14.0-444.el9.x86_64 2024-05-12T10:48:45.791 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-12T10:48:46.416 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-05-12T10:48:47.859 INFO:teuthology.orchestra.run.smithi086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-12T10:48:47.889 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-05-12T10:48:47.891 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-05-12T10:48:47.906 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.R9lCAZ2C5I 2024-05-12T10:48:47.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.R9lCAZ2C5I 2024-05-12T10:48:47.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.R9lCAZ2C5I 2024-05-12T10:48:48.105 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.R9lCAZ2C5I is 6KB 2024-05-12T10:48:48.153 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.R9lCAZ2C5I 2024-05-12T10:48:48.171 DEBUG:teuthology.orchestra.run.smithi086:> sudo /bin/ls /boot/loader/entries || true 2024-05-12T10:48:48.238 INFO:teuthology.orchestra.run.smithi086.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-12T10:48:48.238 INFO:teuthology.orchestra.run.smithi086.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-12T10:48:48.238 INFO:teuthology.orchestra.run.smithi086.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-12T10:48:48.238 INFO:teuthology.orchestra.run.smithi086.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-12T10:48:48.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-12T10:48:48.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-05-12T10:49:18.394 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-12T10:49:18.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-05-12T10:49:18.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:50:18.398 DEBUG:teuthology.orchestra.remote:timed out 2024-05-12T10:50:27.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-05-12T10:50:27.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:50:30.906 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-05-12T10:50:31.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-05-12T10:50:31.429 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-12T10:50:31.429 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-05-12T10:50:31.444 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-444.el9.x86_64 2024-05-12T10:50:31.444 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-12T10:50:31.444 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-12T10:50:31.444 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-12T10:50:32.445 DEBUG:teuthology.parallel:result is None 2024-05-12T10:50:32.446 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-12T10:50:32.455 INFO:teuthology.task.internal:Creating test directory... 2024-05-12T10:50:32.455 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-12T10:50:32.457 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-12T10:50:32.460 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-12T10:50:32.478 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-12T10:50:32.489 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-12T10:50:32.504 INFO:teuthology.task.internal:Creating archive directory... 2024-05-12T10:50:32.504 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-12T10:50:32.513 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-12T10:50:32.517 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-12T10:50:32.640 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-12T10:50:32.649 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-12T10:50:32.649 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-12T10:50:32.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:50:32.666 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-12T10:50:32.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:50:32.682 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-12T10:50:32.685 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-12T10:50:32.708 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-12T10:50:32.756 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:50:32.762 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:50:32.779 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:50:32.781 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:50:32.793 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:50:32.808 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T10:50:32.810 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-12T10:50:32.818 INFO:teuthology.task.internal:Configuring sudo... 2024-05-12T10:50:32.819 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-12T10:50:32.821 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-12T10:50:32.823 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-12T10:50:32.862 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-12T10:50:32.871 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-12T10:50:32.871 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-12T10:50:32.887 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-12T10:50:32.891 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-12T10:50:32.919 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T10:50:32.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T10:50:33.037 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T10:50:33.120 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T10:50:33.162 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:50:33.163 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-12T10:50:33.242 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T10:50:33.287 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T10:50:33.338 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T10:50:33.423 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T10:50:33.464 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:50:33.464 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-12T10:50:33.529 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T10:50:33.573 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T10:50:33.631 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T10:50:33.713 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T10:50:33.755 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:50:33.755 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-12T10:50:33.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-05-12T10:50:33.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-05-12T10:50:33.825 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-05-12T10:50:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-12T10:50:33.862 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-12T10:50:33.897 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-12T10:50:34.308 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-12T10:50:34.316 INFO:teuthology.task.internal:Starting timer... 2024-05-12T10:50:34.316 INFO:teuthology.run_tasks:Running task pcp... 2024-05-12T10:50:34.333 INFO:teuthology.run_tasks:Running task selinux... 2024-05-12T10:50:34.342 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-12T10:50:34.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2024-05-12T10:50:34.429 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2024-05-12T10:50:34.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-05-12T10:50:34.511 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-05-12T10:50:34.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-05-12T10:50:34.563 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-05-12T10:50:34.565 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-12T10:50:34.565 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2024-05-12T10:50:34.584 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2024-05-12T10:50:34.585 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-05-12T10:50:34.610 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-05-12T10:50:34.610 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-05-12T10:50:34.631 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-05-12T10:50:34.632 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi086.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-05-12T10:50:34.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-12T10:50:34.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:50:34.659 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-12T10:50:34.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:50:34.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-12T10:50:34.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T10:50:34.713 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-12T10:50:34.714 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2024-05-12T10:50:34.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-05-12T10:50:34.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-05-12T10:50:34.790 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-12T10:50:34.801 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-12T10:50:34.806 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-12T10:50:34.946 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-12T10:50:34.964 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-12T10:50:34.965 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi086.front.sepia.ceph.com,smithi172.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-12T10:54:50.633 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-05-12T10:54:50.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-05-12T10:54:50.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:54:50.710 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-05-12T10:54:50.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-05-12T10:54:50.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-12T10:54:50.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:54:50.863 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-05-12T10:54:50.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-12T10:54:50.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-12T10:54:50.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T10:54:51.022 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-05-12T10:54:51.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-12T10:54:51.110 INFO:teuthology.run_tasks:Running task clock... 2024-05-12T10:54:51.122 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-12T10:54:51.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-12T10:54:51.122 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T10:54:51.125 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-12T10:54:51.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T10:54:51.127 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-12T10:54:51.127 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T10:54:51.153 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-12T10:54:51.154 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-12T10:54:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-12T10:54:51.169 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-12T10:54:51.180 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-12T10:54:51.191 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-05-12T10:54:51.193 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2024-05-12T10:54:51.194 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-12T10:54:51.201 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-05-12T10:54:51.204 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2024-05-12T10:54:51.215 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-12T10:54:51.217 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-05-12T10:54:51.219 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-12T10:54:51.227 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-12T10:54:51.228 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-05-12T10:54:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-12T10:54:51.241 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-12T10:54:51.254 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-12T10:54:51.277 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-05-12T10:54:51.281 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-12T10:54:51.281 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-05-12T10:54:51.281 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.281 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.281 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.281 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.293 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-05-12T10:54:51.296 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-12T10:54:51.296 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-05-12T10:54:51.296 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.296 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.296 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.297 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.318 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-05-12T10:54:51.322 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-12T10:54:51.322 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-05-12T10:54:51.322 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.322 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.322 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.322 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T10:54:51.323 INFO:teuthology.run_tasks:Running task install... 2024-05-12T10:54:51.331 DEBUG:teuthology.task.install:project ceph 2024-05-12T10:54:51.332 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a'}} 2024-05-12T10:54:51.332 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a'} 2024-05-12T10:54:51.332 INFO:teuthology.task.install:Using flavor: default 2024-05-12T10:54:51.339 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-12T10:54:51.339 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-12T10:54:51.340 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a', 'tag': None, 'wait_for_package': False} 2024-05-12T10:54:51.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:54:51.342 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a', 'tag': None, 'wait_for_package': False} 2024-05-12T10:54:51.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:54:51.343 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a', 'tag': None, 'wait_for_package': False} 2024-05-12T10:54:51.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:54:51.489 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/ 2024-05-12T10:54:51.489 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3517.gf1ec8823 2024-05-12T10:54:51.564 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/ 2024-05-12T10:54:51.564 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3517.gf1ec8823 2024-05-12T10:54:51.568 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/ 2024-05-12T10:54:51.568 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3517.gf1ec8823 2024-05-12T10:54:51.677 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-12T10:54:51.677 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:54:51.678 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-12T10:54:51.704 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-12T10:54:51.704 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f1ec882358465db8f363a3865fa83f099183688a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-12T10:54:51.768 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-12T10:54:51.769 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:54:51.769 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-12T10:54:51.770 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-12T10:54:51.796 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-12T10:54:51.796 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f1ec882358465db8f363a3865fa83f099183688a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-12T10:54:51.843 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-12T10:54:51.863 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-12T10:54:51.906 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-05-12T10:54:51.907 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-05-12T10:54:51.926 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-12T10:54:51.926 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:54:51.926 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-12T10:54:51.938 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-12T10:54:51.953 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-12T10:54:51.953 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f1ec882358465db8f363a3865fa83f099183688a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-12T10:54:52.002 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2024-05-12T10:54:52.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2024-05-12T10:54:52.020 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-12T10:54:52.095 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-12T10:54:52.135 INFO:teuthology.orchestra.run.smithi172.stdout:54 files removed 2024-05-12T10:54:52.159 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-05-12T10:54:52.161 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-05-12T10:54:52.162 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-12T10:54:52.232 INFO:teuthology.orchestra.run.smithi086.stdout:54 files removed 2024-05-12T10:54:52.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-12T10:54:52.393 INFO:teuthology.orchestra.run.smithi176.stdout:54 files removed 2024-05-12T10:54:52.422 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-12T10:54:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 271 kB/s | 84 kB 00:00 2024-05-12T10:54:52.904 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 174 kB/s | 84 kB 00:00 2024-05-12T10:54:53.078 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 213 kB/s | 84 kB 00:00 2024-05-12T10:54:53.470 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-05-12T10:54:53.533 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-05-12T10:54:53.896 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-12T10:54:53.942 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-05-12T10:54:54.438 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 7.9 kB/s | 12 kB 00:01 2024-05-12T10:54:54.484 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-12T10:54:55.047 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2024-05-12T10:54:55.504 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.1 MB 00:01 2024-05-12T10:54:56.230 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.1 MB 00:01 2024-05-12T10:54:56.968 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-05-12T10:54:57.830 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-05-12T10:54:59.398 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 19 MB 00:02 2024-05-12T10:55:01.261 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-12T10:55:03.203 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 16 kB 00:00 2024-05-12T10:55:03.247 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-05-12T10:55:04.848 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-05-12T10:55:05.023 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-05-12T10:55:06.097 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 21 MB 00:02 2024-05-12T10:55:06.691 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-05-12T10:55:06.885 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-12T10:55:08.029 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-12T10:55:11.380 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-05-12T10:55:12.033 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-12T10:55:13.159 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-12T10:55:13.707 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-12T10:55:13.708 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-12T10:55:13.719 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-12T10:55:13.720 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-12T10:55:13.720 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-12T10:55:13.721 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-12T10:55:13.723 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-12T10:55:13.725 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-12T10:55:13.726 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-12T10:55:13.788 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-05-12T10:55:13.798 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================= 2024-05-12T10:55:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-05-12T10:55:13.798 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================= 2024-05-12T10:55:13.798 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-05-12T10:55:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 6.6 k 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 5.4 M 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 891 k 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 145 k 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 1.5 M 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 142 k 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 3.5 M 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 7.4 M 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 49 k 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 11 M 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 49 M 2024-05-12T10:55:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 273 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 763 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 224 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-shell x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 27 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 18 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 32 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 747 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 127 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-12T10:55:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 162 k 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 320 k 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 298 k 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 100 k 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 85 k 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.1 M 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 170 k 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-05-12T10:55:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.4 M 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.1 M 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 21 M 2024-05-12T10:55:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 34 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 2.4 M 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 274 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 4.7 M 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 17 M 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 16 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 25 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-12T10:55:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 163 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 501 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 5.4 M 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-12T10:55:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-12T10:55:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 45 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 135 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-12T10:55:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-12T10:55:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-12T10:55:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-12T10:55:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout:Installing weak dependencies: 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-05-12T10:55:13.810 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================= 2024-05-12T10:55:13.811 INFO:teuthology.orchestra.run.smithi086.stdout:Install 148 Packages 2024-05-12T10:55:13.811 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 8 Packages 2024-05-12T10:55:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:55:13.811 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 226 M 2024-05-12T10:55:13.811 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-05-12T10:55:14.293 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-12T10:55:14.294 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-12T10:55:14.304 INFO:teuthology.orchestra.run.smithi176.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-12T10:55:14.305 INFO:teuthology.orchestra.run.smithi176.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-12T10:55:14.306 INFO:teuthology.orchestra.run.smithi176.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-12T10:55:14.307 INFO:teuthology.orchestra.run.smithi176.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-12T10:55:14.308 INFO:teuthology.orchestra.run.smithi176.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-12T10:55:14.310 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-12T10:55:14.311 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-12T10:55:14.371 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-05-12T10:55:14.392 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-05-12T10:55:14.392 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-05-12T10:55:14.392 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-05-12T10:55:14.392 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-05-12T10:55:14.392 INFO:teuthology.orchestra.run.smithi176.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-12T10:55:14.392 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 6.6 k 2024-05-12T10:55:14.392 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 5.4 M 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 891 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 145 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 1.5 M 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 142 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 3.5 M 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 7.4 M 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 49 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 11 M 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 49 M 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 273 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 763 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 224 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 27 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 18 k 2024-05-12T10:55:14.393 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 32 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 747 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 127 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 162 k 2024-05-12T10:55:14.394 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 320 k 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 298 k 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 100 k 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 85 k 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.1 M 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 170 k 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.4 M 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.1 M 2024-05-12T10:55:14.395 INFO:teuthology.orchestra.run.smithi176.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 21 M 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 34 k 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 2.4 M 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 274 k 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 4.7 M 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 17 M 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 16 k 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 25 k 2024-05-12T10:55:14.396 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 163 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-12T10:55:14.397 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 501 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 5.4 M 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-12T10:55:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 45 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 135 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-12T10:55:14.399 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-12T10:55:14.400 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-12T10:55:14.401 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-12T10:55:14.402 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-12T10:55:14.403 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout:Install 148 Packages 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 8 Packages 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 226 M 2024-05-12T10:55:14.404 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-05-12T10:55:14.423 INFO:teuthology.orchestra.run.smithi086.stdout:(1/156): ceph-19.0.0-3517.gf1ec8823.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-05-12T10:55:14.857 INFO:teuthology.orchestra.run.smithi086.stdout:(2/156): ceph-base-19.0.0-3517.gf1ec8823.el9.x8 7.9 MB/s | 5.4 MB 00:00 2024-05-12T10:55:14.923 INFO:teuthology.orchestra.run.smithi086.stdout:(3/156): ceph-immutable-object-cache-19.0.0-351 2.1 MB/s | 145 kB 00:00 2024-05-12T10:55:15.149 INFO:teuthology.orchestra.run.smithi086.stdout:(4/156): ceph-fuse-19.0.0-3517.gf1ec8823.el9.x8 1.2 MB/s | 891 kB 00:00 2024-05-12T10:55:15.199 INFO:teuthology.orchestra.run.smithi086.stdout:(5/156): ceph-mds-19.0.0-3517.gf1ec8823.el9.x86 8.6 MB/s | 2.4 MB 00:00 2024-05-12T10:55:15.326 INFO:teuthology.orchestra.run.smithi176.stdout:(1/156): ceph-19.0.0-3517.gf1ec8823.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-12T10:55:15.402 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-12T10:55:15.403 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-12T10:55:15.413 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-12T10:55:15.414 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-12T10:55:15.415 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-12T10:55:15.416 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-12T10:55:15.417 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-12T10:55:15.419 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-12T10:55:15.420 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-12T10:55:15.480 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-05-12T10:55:15.502 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-12T10:55:15.502 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-05-12T10:55:15.502 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-12T10:55:15.502 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-05-12T10:55:15.502 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-12T10:55:15.502 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 6.6 k 2024-05-12T10:55:15.502 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 5.4 M 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 891 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 145 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 1.5 M 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 142 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 3.5 M 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 7.4 M 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 49 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 11 M 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 49 M 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 273 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 763 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 224 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 27 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 18 k 2024-05-12T10:55:15.503 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 32 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 747 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 127 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 162 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 320 k 2024-05-12T10:55:15.504 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 298 k 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 100 k 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 85 k 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.1 M 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 170 k 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.4 M 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 3.1 M 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-12T10:55:15.505 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 21 M 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 34 k 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 2.4 M 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 274 k 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 4.7 M 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 17 M 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3517.gf1ec8823.el9 ceph-noarch 16 k 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 25 k 2024-05-12T10:55:15.506 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 163 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-12T10:55:15.507 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 501 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 5.4 M 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-12T10:55:15.508 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 45 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.0.0-3517.gf1ec8823.el9 ceph 135 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-12T10:55:15.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-12T10:55:15.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-12T10:55:15.511 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-12T10:55:15.512 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-12T10:55:15.513 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout:Install 148 Packages 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 8 Packages 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:55:15.514 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 226 M 2024-05-12T10:55:15.515 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-05-12T10:55:15.699 INFO:teuthology.orchestra.run.smithi086.stdout:(6/156): ceph-mon-19.0.0-3517.gf1ec8823.el9.x86 9.4 MB/s | 4.7 MB 00:00 2024-05-12T10:55:15.908 INFO:teuthology.orchestra.run.smithi086.stdout:(7/156): ceph-common-19.0.0-3517.gf1ec8823.el9. 12 MB/s | 21 MB 00:01 2024-05-12T10:55:16.158 INFO:teuthology.orchestra.run.smithi086.stdout:(8/156): ceph-mgr-19.0.0-3517.gf1ec8823.el9.x86 1.5 MB/s | 1.5 MB 00:01 2024-05-12T10:55:16.250 INFO:teuthology.orchestra.run.smithi086.stdout:(9/156): ceph-selinux-19.0.0-3517.gf1ec8823.el9 274 kB/s | 25 kB 00:00 2024-05-12T10:55:16.476 INFO:teuthology.orchestra.run.smithi176.stdout:(2/156): ceph-fuse-19.0.0-3517.gf1ec8823.el9.x8 775 kB/s | 891 kB 00:01 2024-05-12T10:55:16.659 INFO:teuthology.orchestra.run.smithi086.stdout:(10/156): ceph-radosgw-19.0.0-3517.gf1ec8823.el 14 MB/s | 11 MB 00:00 2024-05-12T10:55:16.718 INFO:teuthology.orchestra.run.smithi086.stdout:(11/156): cephfs-mirror-19.0.0-3517.gf1ec8823.e 3.8 MB/s | 224 kB 00:00 2024-05-12T10:55:16.776 INFO:teuthology.orchestra.run.smithi086.stdout:(12/156): cephfs-shell-19.0.0-3517.gf1ec8823.el 465 kB/s | 27 kB 00:00 2024-05-12T10:55:16.835 INFO:teuthology.orchestra.run.smithi086.stdout:(13/156): libcephfs-devel-19.0.0-3517.gf1ec8823 545 kB/s | 32 kB 00:00 2024-05-12T10:55:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:(1/156): ceph-19.0.0-3517.gf1ec8823.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-05-12T10:55:16.935 INFO:teuthology.orchestra.run.smithi086.stdout:(14/156): libcephfs2-19.0.0-3517.gf1ec8823.el9. 7.3 MB/s | 747 kB 00:00 2024-05-12T10:55:17.027 INFO:teuthology.orchestra.run.smithi086.stdout:(15/156): libcephsqlite-19.0.0-3517.gf1ec8823.e 1.7 MB/s | 163 kB 00:00 2024-05-12T10:55:17.094 INFO:teuthology.orchestra.run.smithi086.stdout:(16/156): librados-devel-19.0.0-3517.gf1ec8823. 1.9 MB/s | 127 kB 00:00 2024-05-12T10:55:17.178 INFO:teuthology.orchestra.run.smithi086.stdout:(17/156): libradosstriper1-19.0.0-3517.gf1ec882 5.9 MB/s | 501 kB 00:00 2024-05-12T10:55:17.244 INFO:teuthology.orchestra.run.smithi172.stdout:(2/156): ceph-fuse-19.0.0-3517.gf1ec8823.el9.x8 2.1 MB/s | 891 kB 00:00 2024-05-12T10:55:17.302 INFO:teuthology.orchestra.run.smithi176.stdout:(3/156): ceph-immutable-object-cache-19.0.0-351 175 kB/s | 145 kB 00:00 2024-05-12T10:55:17.353 INFO:teuthology.orchestra.run.smithi172.stdout:(3/156): ceph-immutable-object-cache-19.0.0-351 1.3 MB/s | 145 kB 00:00 2024-05-12T10:55:17.561 INFO:teuthology.orchestra.run.smithi086.stdout:(18/156): ceph-osd-19.0.0-3517.gf1ec8823.el9.x8 9.0 MB/s | 17 MB 00:01 2024-05-12T10:55:17.687 INFO:teuthology.orchestra.run.smithi086.stdout:(19/156): librgw2-19.0.0-3517.gf1ec8823.el9.x86 11 MB/s | 5.4 MB 00:00 2024-05-12T10:55:17.704 INFO:teuthology.orchestra.run.smithi086.stdout:(20/156): python3-ceph-argparse-19.0.0-3517.gf1 318 kB/s | 45 kB 00:00 2024-05-12T10:55:17.746 INFO:teuthology.orchestra.run.smithi086.stdout:(21/156): python3-ceph-common-19.0.0-3517.gf1ec 2.3 MB/s | 135 kB 00:00 2024-05-12T10:55:17.813 INFO:teuthology.orchestra.run.smithi086.stdout:(22/156): python3-rados-19.0.0-3517.gf1ec8823.e 4.7 MB/s | 320 kB 00:00 2024-05-12T10:55:17.861 INFO:teuthology.orchestra.run.smithi172.stdout:(4/156): ceph-mds-19.0.0-3517.gf1ec8823.el9.x86 4.6 MB/s | 2.4 MB 00:00 2024-05-12T10:55:17.863 INFO:teuthology.orchestra.run.smithi086.stdout:(23/156): python3-rbd-19.0.0-3517.gf1ec8823.el9 5.8 MB/s | 298 kB 00:00 2024-05-12T10:55:17.913 INFO:teuthology.orchestra.run.smithi086.stdout:(24/156): python3-rgw-19.0.0-3517.gf1ec8823.el9 1.9 MB/s | 100 kB 00:00 2024-05-12T10:55:17.962 INFO:teuthology.orchestra.run.smithi172.stdout:(5/156): ceph-base-19.0.0-3517.gf1ec8823.el9.x8 3.3 MB/s | 5.4 MB 00:01 2024-05-12T10:55:17.964 INFO:teuthology.orchestra.run.smithi086.stdout:(25/156): rbd-fuse-19.0.0-3517.gf1ec8823.el9.x8 1.7 MB/s | 85 kB 00:00 2024-05-12T10:55:17.989 INFO:teuthology.orchestra.run.smithi086.stdout:(26/156): python3-cephfs-19.0.0-3517.gf1ec8823. 569 kB/s | 162 kB 00:00 2024-05-12T10:55:18.081 INFO:teuthology.orchestra.run.smithi086.stdout:(27/156): rbd-nbd-19.0.0-3517.gf1ec8823.el9.x86 1.8 MB/s | 170 kB 00:00 2024-05-12T10:55:18.172 INFO:teuthology.orchestra.run.smithi086.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3517.g 374 kB/s | 34 kB 00:00 2024-05-12T10:55:18.185 INFO:teuthology.orchestra.run.smithi176.stdout:(4/156): ceph-base-19.0.0-3517.gf1ec8823.el9.x8 1.7 MB/s | 5.4 MB 00:03 2024-05-12T10:55:18.212 INFO:teuthology.orchestra.run.smithi172.stdout:(6/156): ceph-mgr-19.0.0-3517.gf1ec8823.el9.x86 4.3 MB/s | 1.5 MB 00:00 2024-05-12T10:55:18.256 INFO:teuthology.orchestra.run.smithi086.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3517.gf1ec882 1.7 MB/s | 142 kB 00:00 2024-05-12T10:55:18.323 INFO:teuthology.orchestra.run.smithi086.stdout:(30/156): rbd-mirror-19.0.0-3517.gf1ec8823.el9. 8.6 MB/s | 3.1 MB 00:00 2024-05-12T10:55:18.688 INFO:teuthology.orchestra.run.smithi172.stdout:(7/156): ceph-mon-19.0.0-3517.gf1ec8823.el9.x86 6.5 MB/s | 4.7 MB 00:00 2024-05-12T10:55:18.848 INFO:teuthology.orchestra.run.smithi086.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3517.gf1ec8 6.0 MB/s | 3.5 MB 00:00 2024-05-12T10:55:18.949 INFO:teuthology.orchestra.run.smithi086.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3517.gf1 2.7 MB/s | 274 kB 00:00 2024-05-12T10:55:19.040 INFO:teuthology.orchestra.run.smithi086.stdout:(33/156): ceph-mgr-rook-19.0.0-3517.gf1ec8823.e 539 kB/s | 49 kB 00:00 2024-05-12T10:55:19.124 INFO:teuthology.orchestra.run.smithi086.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3517.gf 198 kB/s | 16 kB 00:00 2024-05-12T10:55:19.160 INFO:teuthology.orchestra.run.smithi176.stdout:(5/156): ceph-mgr-19.0.0-3517.gf1ec8823.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-05-12T10:55:19.208 INFO:teuthology.orchestra.run.smithi086.stdout:(35/156): ceph-volume-19.0.0-3517.gf1ec8823.el9 3.2 MB/s | 273 kB 00:00 2024-05-12T10:55:19.317 INFO:teuthology.orchestra.run.smithi086.stdout:(36/156): ceph-mgr-diskprediction-local-19.0.0- 7.4 MB/s | 7.4 MB 00:00 2024-05-12T10:55:19.367 INFO:teuthology.orchestra.run.smithi086.stdout:(37/156): cephadm-19.0.0-3517.gf1ec8823.el9.noa 4.7 MB/s | 763 kB 00:00 2024-05-12T10:55:19.392 INFO:teuthology.orchestra.run.smithi086.stdout:(38/156): cephfs-top-19.0.0-3517.gf1ec8823.el9. 242 kB/s | 18 kB 00:00 2024-05-12T10:55:19.443 INFO:teuthology.orchestra.run.smithi086.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-05-12T10:55:19.509 INFO:teuthology.orchestra.run.smithi086.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-05-12T10:55:19.535 INFO:teuthology.orchestra.run.smithi086.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-12T10:55:19.602 INFO:teuthology.orchestra.run.smithi086.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-05-12T10:55:19.669 INFO:teuthology.orchestra.run.smithi086.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-05-12T10:55:19.702 INFO:teuthology.orchestra.run.smithi086.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-05-12T10:55:19.744 INFO:teuthology.orchestra.run.smithi086.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-05-12T10:55:19.786 INFO:teuthology.orchestra.run.smithi086.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-12T10:55:19.835 INFO:teuthology.orchestra.run.smithi176.stdout:(6/156): ceph-mds-19.0.0-3517.gf1ec8823.el9.x86 955 kB/s | 2.4 MB 00:02 2024-05-12T10:55:19.836 INFO:teuthology.orchestra.run.smithi086.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-05-12T10:55:20.087 INFO:teuthology.orchestra.run.smithi172.stdout:(8/156): ceph-radosgw-19.0.0-3517.gf1ec8823.el9 7.6 MB/s | 11 MB 00:01 2024-05-12T10:55:20.146 INFO:teuthology.orchestra.run.smithi172.stdout:(9/156): ceph-selinux-19.0.0-3517.gf1ec8823.el9 433 kB/s | 25 kB 00:00 2024-05-12T10:55:20.519 INFO:teuthology.orchestra.run.smithi176.stdout:(7/156): ceph-mon-19.0.0-3517.gf1ec8823.el9.x86 3.5 MB/s | 4.7 MB 00:01 2024-05-12T10:55:20.695 INFO:teuthology.orchestra.run.smithi086.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 758 kB/s | 689 kB 00:00 2024-05-12T10:55:20.788 INFO:teuthology.orchestra.run.smithi172.stdout:(10/156): ceph-osd-19.0.0-3517.gf1ec8823.el9.x8 6.5 MB/s | 17 MB 00:02 2024-05-12T10:55:20.812 INFO:teuthology.orchestra.run.smithi086.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 967 kB/s | 943 kB 00:00 2024-05-12T10:55:20.846 INFO:teuthology.orchestra.run.smithi172.stdout:(11/156): cephfs-mirror-19.0.0-3517.gf1ec8823.e 3.8 MB/s | 224 kB 00:00 2024-05-12T10:55:20.897 INFO:teuthology.orchestra.run.smithi172.stdout:(12/156): cephfs-shell-19.0.0-3517.gf1ec8823.el 542 kB/s | 27 kB 00:00 2024-05-12T10:55:20.947 INFO:teuthology.orchestra.run.smithi172.stdout:(13/156): libcephfs-devel-19.0.0-3517.gf1ec8823 634 kB/s | 32 kB 00:00 2024-05-12T10:55:21.081 INFO:teuthology.orchestra.run.smithi172.stdout:(14/156): libcephfs2-19.0.0-3517.gf1ec8823.el9. 5.5 MB/s | 747 kB 00:00 2024-05-12T10:55:21.139 INFO:teuthology.orchestra.run.smithi172.stdout:(15/156): libcephsqlite-19.0.0-3517.gf1ec8823.e 2.7 MB/s | 163 kB 00:00 2024-05-12T10:55:21.198 INFO:teuthology.orchestra.run.smithi172.stdout:(16/156): librados-devel-19.0.0-3517.gf1ec8823. 2.1 MB/s | 127 kB 00:00 2024-05-12T10:55:21.306 INFO:teuthology.orchestra.run.smithi172.stdout:(17/156): libradosstriper1-19.0.0-3517.gf1ec882 4.5 MB/s | 501 kB 00:00 2024-05-12T10:55:21.379 INFO:teuthology.orchestra.run.smithi086.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 38 kB/s | 21 kB 00:00 2024-05-12T10:55:21.404 INFO:teuthology.orchestra.run.smithi086.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 151 kB/s | 107 kB 00:00 2024-05-12T10:55:21.996 INFO:teuthology.orchestra.run.smithi086.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-05-12T10:55:22.098 INFO:teuthology.orchestra.run.smithi172.stdout:(18/156): librgw2-19.0.0-3517.gf1ec8823.el9.x86 6.8 MB/s | 5.4 MB 00:00 2024-05-12T10:55:22.157 INFO:teuthology.orchestra.run.smithi172.stdout:(19/156): python3-ceph-argparse-19.0.0-3517.gf1 775 kB/s | 45 kB 00:00 2024-05-12T10:55:22.213 INFO:teuthology.orchestra.run.smithi086.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 376 kB/s | 313 kB 00:00 2024-05-12T10:55:22.224 INFO:teuthology.orchestra.run.smithi172.stdout:(20/156): python3-ceph-common-19.0.0-3517.gf1ec 2.0 MB/s | 135 kB 00:00 2024-05-12T10:55:22.283 INFO:teuthology.orchestra.run.smithi172.stdout:(21/156): python3-cephfs-19.0.0-3517.gf1ec8823. 2.7 MB/s | 162 kB 00:00 2024-05-12T10:55:22.358 INFO:teuthology.orchestra.run.smithi172.stdout:(22/156): python3-rados-19.0.0-3517.gf1ec8823.e 4.2 MB/s | 320 kB 00:00 2024-05-12T10:55:22.425 INFO:teuthology.orchestra.run.smithi172.stdout:(23/156): python3-rbd-19.0.0-3517.gf1ec8823.el9 4.4 MB/s | 298 kB 00:00 2024-05-12T10:55:22.484 INFO:teuthology.orchestra.run.smithi172.stdout:(24/156): python3-rgw-19.0.0-3517.gf1ec8823.el9 1.7 MB/s | 100 kB 00:00 2024-05-12T10:55:22.534 INFO:teuthology.orchestra.run.smithi172.stdout:(25/156): rbd-fuse-19.0.0-3517.gf1ec8823.el9.x8 1.7 MB/s | 85 kB 00:00 2024-05-12T10:55:22.746 INFO:teuthology.orchestra.run.smithi086.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 34 kB/s | 18 kB 00:00 2024-05-12T10:55:23.009 INFO:teuthology.orchestra.run.smithi172.stdout:(26/156): rbd-mirror-19.0.0-3517.gf1ec8823.el9. 6.5 MB/s | 3.1 MB 00:00 2024-05-12T10:55:23.060 INFO:teuthology.orchestra.run.smithi172.stdout:(27/156): rbd-nbd-19.0.0-3517.gf1ec8823.el9.x86 3.3 MB/s | 170 kB 00:00 2024-05-12T10:55:23.088 INFO:teuthology.orchestra.run.smithi086.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-05-12T10:55:23.102 INFO:teuthology.orchestra.run.smithi172.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3517.g 823 kB/s | 34 kB 00:00 2024-05-12T10:55:23.102 INFO:teuthology.orchestra.run.smithi176.stdout:(8/156): ceph-radosgw-19.0.0-3517.gf1ec8823.el9 4.1 MB/s | 11 MB 00:02 2024-05-12T10:55:23.160 INFO:teuthology.orchestra.run.smithi172.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3517.gf1ec882 2.4 MB/s | 142 kB 00:00 2024-05-12T10:55:23.161 INFO:teuthology.orchestra.run.smithi176.stdout:(9/156): ceph-selinux-19.0.0-3517.gf1ec8823.el9 434 kB/s | 25 kB 00:00 2024-05-12T10:55:23.272 INFO:teuthology.orchestra.run.smithi086.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-05-12T10:55:23.710 INFO:teuthology.orchestra.run.smithi172.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3517.gf1ec8 6.4 MB/s | 3.5 MB 00:00 2024-05-12T10:55:23.847 INFO:teuthology.orchestra.run.smithi086.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 212 kB/s | 160 kB 00:00 2024-05-12T10:55:23.881 INFO:teuthology.orchestra.run.smithi086.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 74 kB/s | 45 kB 00:00 2024-05-12T10:55:24.790 INFO:teuthology.orchestra.run.smithi086.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 641 kB/s | 582 kB 00:00 2024-05-12T10:55:24.823 INFO:teuthology.orchestra.run.smithi086.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 679 kB/s | 662 kB 00:00 2024-05-12T10:55:24.911 INFO:teuthology.orchestra.run.smithi172.stdout:(31/156): ceph-test-19.0.0-3517.gf1ec8823.el9.x 10 MB/s | 49 MB 00:04 2024-05-12T10:55:25.002 INFO:teuthology.orchestra.run.smithi172.stdout:(32/156): ceph-mgr-diskprediction-local-19.0.0- 5.7 MB/s | 7.4 MB 00:01 2024-05-12T10:55:25.036 INFO:teuthology.orchestra.run.smithi172.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3517.gf1 2.1 MB/s | 274 kB 00:00 2024-05-12T10:55:25.062 INFO:teuthology.orchestra.run.smithi172.stdout:(34/156): ceph-mgr-rook-19.0.0-3517.gf1ec8823.e 842 kB/s | 49 kB 00:00 2024-05-12T10:55:25.095 INFO:teuthology.orchestra.run.smithi172.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3517.gf 280 kB/s | 16 kB 00:00 2024-05-12T10:55:25.145 INFO:teuthology.orchestra.run.smithi172.stdout:(36/156): ceph-volume-19.0.0-3517.gf1ec8823.el9 3.2 MB/s | 273 kB 00:00 2024-05-12T10:55:25.196 INFO:teuthology.orchestra.run.smithi172.stdout:(37/156): cephfs-top-19.0.0-3517.gf1ec8823.el9. 364 kB/s | 18 kB 00:00 2024-05-12T10:55:25.221 INFO:teuthology.orchestra.run.smithi172.stdout:(38/156): cephadm-19.0.0-3517.gf1ec8823.el9.noa 5.9 MB/s | 763 kB 00:00 2024-05-12T10:55:25.338 INFO:teuthology.orchestra.run.smithi172.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 567 kB/s | 80 kB 00:00 2024-05-12T10:55:25.381 INFO:teuthology.orchestra.run.smithi086.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 43 kB/s | 25 kB 00:00 2024-05-12T10:55:25.421 INFO:teuthology.orchestra.run.smithi172.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-05-12T10:55:25.440 INFO:teuthology.orchestra.run.smithi086.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-05-12T10:55:25.488 INFO:teuthology.orchestra.run.smithi172.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-05-12T10:55:25.514 INFO:teuthology.orchestra.run.smithi172.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-05-12T10:55:25.564 INFO:teuthology.orchestra.run.smithi172.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-12T10:55:25.648 INFO:teuthology.orchestra.run.smithi172.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-12T10:55:25.727 INFO:teuthology.orchestra.run.smithi172.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-12T10:55:25.773 INFO:teuthology.orchestra.run.smithi172.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-05-12T10:55:25.824 INFO:teuthology.orchestra.run.smithi172.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.2 MB/s | 215 kB 00:00 2024-05-12T10:55:25.974 INFO:teuthology.orchestra.run.smithi172.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-05-12T10:55:26.008 INFO:teuthology.orchestra.run.smithi172.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-05-12T10:55:26.033 INFO:teuthology.orchestra.run.smithi172.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-05-12T10:55:26.058 INFO:teuthology.orchestra.run.smithi172.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-05-12T10:55:26.084 INFO:teuthology.orchestra.run.smithi172.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-05-12T10:55:26.109 INFO:teuthology.orchestra.run.smithi172.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-05-12T10:55:26.151 INFO:teuthology.orchestra.run.smithi172.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-05-12T10:55:26.207 INFO:teuthology.orchestra.run.smithi086.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 354 kB/s | 292 kB 00:00 2024-05-12T10:55:26.209 INFO:teuthology.orchestra.run.smithi172.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-05-12T10:55:26.232 INFO:teuthology.orchestra.run.smithi086.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 238 kB/s | 188 kB 00:00 2024-05-12T10:55:26.235 INFO:teuthology.orchestra.run.smithi172.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-05-12T10:55:26.260 INFO:teuthology.orchestra.run.smithi172.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-12T10:55:26.285 INFO:teuthology.orchestra.run.smithi172.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-05-12T10:55:26.319 INFO:teuthology.orchestra.run.smithi172.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-05-12T10:55:26.353 INFO:teuthology.orchestra.run.smithi172.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-05-12T10:55:26.378 INFO:teuthology.orchestra.run.smithi172.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-05-12T10:55:26.404 INFO:teuthology.orchestra.run.smithi172.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-05-12T10:55:26.429 INFO:teuthology.orchestra.run.smithi172.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-05-12T10:55:26.454 INFO:teuthology.orchestra.run.smithi172.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-12T10:55:26.479 INFO:teuthology.orchestra.run.smithi172.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-05-12T10:55:26.572 INFO:teuthology.orchestra.run.smithi172.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2024-05-12T10:55:26.638 INFO:teuthology.orchestra.run.smithi172.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-05-12T10:55:26.680 INFO:teuthology.orchestra.run.smithi172.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-12T10:55:26.702 INFO:teuthology.orchestra.run.smithi176.stdout:(10/156): ceph-common-19.0.0-3517.gf1ec8823.el9 1.8 MB/s | 21 MB 00:11 2024-05-12T10:55:26.714 INFO:teuthology.orchestra.run.smithi172.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-05-12T10:55:26.739 INFO:teuthology.orchestra.run.smithi172.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-12T10:55:26.789 INFO:teuthology.orchestra.run.smithi172.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-05-12T10:55:26.832 INFO:teuthology.orchestra.run.smithi086.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 59 kB/s | 35 kB 00:00 2024-05-12T10:55:26.844 INFO:teuthology.orchestra.run.smithi176.stdout:(11/156): cephfs-mirror-19.0.0-3517.gf1ec8823.e 1.6 MB/s | 224 kB 00:00 2024-05-12T10:55:26.865 INFO:teuthology.orchestra.run.smithi172.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-05-12T10:55:26.890 INFO:teuthology.orchestra.run.smithi172.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-05-12T10:55:26.902 INFO:teuthology.orchestra.run.smithi176.stdout:(12/156): cephfs-shell-19.0.0-3517.gf1ec8823.el 466 kB/s | 27 kB 00:00 2024-05-12T10:55:26.932 INFO:teuthology.orchestra.run.smithi172.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-05-12T10:55:26.952 INFO:teuthology.orchestra.run.smithi176.stdout:(13/156): libcephfs-devel-19.0.0-3517.gf1ec8823 637 kB/s | 32 kB 00:00 2024-05-12T10:55:27.016 INFO:teuthology.orchestra.run.smithi172.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-05-12T10:55:27.041 INFO:teuthology.orchestra.run.smithi172.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-05-12T10:55:27.066 INFO:teuthology.orchestra.run.smithi172.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-05-12T10:55:27.092 INFO:teuthology.orchestra.run.smithi172.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-05-12T10:55:27.111 INFO:teuthology.orchestra.run.smithi176.stdout:(14/156): ceph-osd-19.0.0-3517.gf1ec8823.el9.x8 2.3 MB/s | 17 MB 00:07 2024-05-12T10:55:27.117 INFO:teuthology.orchestra.run.smithi172.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-12T10:55:27.142 INFO:teuthology.orchestra.run.smithi172.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-05-12T10:55:27.178 INFO:teuthology.orchestra.run.smithi176.stdout:(15/156): libcephsqlite-19.0.0-3517.gf1ec8823.e 2.4 MB/s | 163 kB 00:00 2024-05-12T10:55:27.185 INFO:teuthology.orchestra.run.smithi172.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-05-12T10:55:27.251 INFO:teuthology.orchestra.run.smithi172.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-05-12T10:55:27.253 INFO:teuthology.orchestra.run.smithi176.stdout:(16/156): librados-devel-19.0.0-3517.gf1ec8823. 1.7 MB/s | 127 kB 00:00 2024-05-12T10:55:27.276 INFO:teuthology.orchestra.run.smithi172.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-12T10:55:27.287 INFO:teuthology.orchestra.run.smithi176.stdout:(17/156): libcephfs2-19.0.0-3517.gf1ec8823.el9. 2.2 MB/s | 747 kB 00:00 2024-05-12T10:55:27.293 INFO:teuthology.orchestra.run.smithi172.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-05-12T10:55:27.318 INFO:teuthology.orchestra.run.smithi172.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-05-12T10:55:27.344 INFO:teuthology.orchestra.run.smithi172.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-05-12T10:55:27.361 INFO:teuthology.orchestra.run.smithi172.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-05-12T10:55:27.403 INFO:teuthology.orchestra.run.smithi172.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-05-12T10:55:27.404 INFO:teuthology.orchestra.run.smithi176.stdout:(18/156): libradosstriper1-19.0.0-3517.gf1ec882 3.3 MB/s | 501 kB 00:00 2024-05-12T10:55:27.416 INFO:teuthology.orchestra.run.smithi086.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 4.0 MB/s | 4.7 MB 00:01 2024-05-12T10:55:27.428 INFO:teuthology.orchestra.run.smithi172.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 759 kB/s | 51 kB 00:00 2024-05-12T10:55:27.454 INFO:teuthology.orchestra.run.smithi172.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-12T10:55:27.479 INFO:teuthology.orchestra.run.smithi176.stdout:(19/156): python3-ceph-argparse-19.0.0-3517.gf1 604 kB/s | 45 kB 00:00 2024-05-12T10:55:27.496 INFO:teuthology.orchestra.run.smithi172.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-05-12T10:55:27.537 INFO:teuthology.orchestra.run.smithi172.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-05-12T10:55:27.546 INFO:teuthology.orchestra.run.smithi176.stdout:(20/156): python3-ceph-common-19.0.0-3517.gf1ec 2.0 MB/s | 135 kB 00:00 2024-05-12T10:55:27.613 INFO:teuthology.orchestra.run.smithi176.stdout:(21/156): python3-cephfs-19.0.0-3517.gf1ec8823. 2.4 MB/s | 162 kB 00:00 2024-05-12T10:55:27.738 INFO:teuthology.orchestra.run.smithi172.stdout:(93/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-05-12T10:55:27.763 INFO:teuthology.orchestra.run.smithi172.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 980 kB/s | 221 kB 00:00 2024-05-12T10:55:27.780 INFO:teuthology.orchestra.run.smithi176.stdout:(22/156): python3-rados-19.0.0-3517.gf1ec8823.e 1.9 MB/s | 320 kB 00:00 2024-05-12T10:55:27.789 INFO:teuthology.orchestra.run.smithi172.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-05-12T10:55:27.814 INFO:teuthology.orchestra.run.smithi172.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-05-12T10:55:27.839 INFO:teuthology.orchestra.run.smithi172.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-05-12T10:55:27.864 INFO:teuthology.orchestra.run.smithi172.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-12T10:55:27.897 INFO:teuthology.orchestra.run.smithi176.stdout:(23/156): python3-rbd-19.0.0-3517.gf1ec8823.el9 2.5 MB/s | 298 kB 00:00 2024-05-12T10:55:27.940 INFO:teuthology.orchestra.run.smithi172.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 933 kB/s | 94 kB 00:00 2024-05-12T10:55:27.964 INFO:teuthology.orchestra.run.smithi176.stdout:(24/156): python3-rgw-19.0.0-3517.gf1ec8823.el9 1.5 MB/s | 100 kB 00:00 2024-05-12T10:55:27.965 INFO:teuthology.orchestra.run.smithi172.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 633 kB/s | 64 kB 00:00 2024-05-12T10:55:27.991 INFO:teuthology.orchestra.run.smithi172.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-05-12T10:55:28.031 INFO:teuthology.orchestra.run.smithi176.stdout:(25/156): rbd-fuse-19.0.0-3517.gf1ec8823.el9.x8 1.2 MB/s | 85 kB 00:00 2024-05-12T10:55:28.033 INFO:teuthology.orchestra.run.smithi086.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-05-12T10:55:28.250 INFO:teuthology.orchestra.run.smithi172.stdout:(102/156): ceph-common-19.0.0-3517.gf1ec8823.el 1.8 MB/s | 21 MB 00:11 2024-05-12T10:55:28.442 INFO:teuthology.orchestra.run.smithi086.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-12T10:55:28.550 INFO:teuthology.orchestra.run.smithi172.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-05-12T10:55:28.617 INFO:teuthology.orchestra.run.smithi172.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 4.6 MB/s | 309 kB 00:00 2024-05-12T10:55:28.631 INFO:teuthology.orchestra.run.smithi176.stdout:(26/156): librgw2-19.0.0-3517.gf1ec8823.el9.x86 4.0 MB/s | 5.4 MB 00:01 2024-05-12T10:55:28.667 INFO:teuthology.orchestra.run.smithi172.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-05-12T10:55:28.698 INFO:teuthology.orchestra.run.smithi176.stdout:(27/156): rbd-nbd-19.0.0-3517.gf1ec8823.el9.x86 2.5 MB/s | 170 kB 00:00 2024-05-12T10:55:28.759 INFO:teuthology.orchestra.run.smithi172.stdout:(106/156): lua-devel-5.4.4-4.el9.x86_64.rpm 28 kB/s | 22 kB 00:00 2024-05-12T10:55:28.765 INFO:teuthology.orchestra.run.smithi176.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3517.g 514 kB/s | 34 kB 00:00 2024-05-12T10:55:28.833 INFO:teuthology.orchestra.run.smithi176.stdout:(29/156): rbd-mirror-19.0.0-3517.gf1ec8823.el9. 3.9 MB/s | 3.1 MB 00:00 2024-05-12T10:55:28.858 INFO:teuthology.orchestra.run.smithi176.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3517.gf1ec882 1.5 MB/s | 142 kB 00:00 2024-05-12T10:55:28.884 INFO:teuthology.orchestra.run.smithi172.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-05-12T10:55:28.909 INFO:teuthology.orchestra.run.smithi172.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 173 kB/s | 26 kB 00:00 2024-05-12T10:55:28.935 INFO:teuthology.orchestra.run.smithi172.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-05-12T10:55:28.993 INFO:teuthology.orchestra.run.smithi172.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-12T10:55:29.009 INFO:teuthology.orchestra.run.smithi086.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 934 kB/s | 911 kB 00:00 2024-05-12T10:55:29.027 INFO:teuthology.orchestra.run.smithi172.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 575 kB/s | 67 kB 00:00 2024-05-12T10:55:29.060 INFO:teuthology.orchestra.run.smithi172.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-05-12T10:55:29.102 INFO:teuthology.orchestra.run.smithi172.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-05-12T10:55:29.145 INFO:teuthology.orchestra.run.smithi172.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 768 kB/s | 32 kB 00:00 2024-05-12T10:55:29.184 INFO:teuthology.orchestra.run.smithi086.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 180 kB/s | 133 kB 00:00 2024-05-12T10:55:29.195 INFO:teuthology.orchestra.run.smithi172.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-05-12T10:55:29.220 INFO:teuthology.orchestra.run.smithi172.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-05-12T10:55:29.254 INFO:teuthology.orchestra.run.smithi172.stdout:(117/156): protobuf-compiler-3.14.0-13.el9.x86_ 684 kB/s | 863 kB 00:01 2024-05-12T10:55:29.279 INFO:teuthology.orchestra.run.smithi172.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-05-12T10:55:29.304 INFO:teuthology.orchestra.run.smithi172.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-05-12T10:55:29.316 INFO:teuthology.orchestra.run.smithi176.stdout:(31/156): ceph-test-19.0.0-3517.gf1ec8823.el9.x 8.0 MB/s | 49 MB 00:06 2024-05-12T10:55:29.330 INFO:teuthology.orchestra.run.smithi172.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 701 kB/s | 35 kB 00:00 2024-05-12T10:55:29.380 INFO:teuthology.orchestra.run.smithi172.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-12T10:55:29.383 INFO:teuthology.orchestra.run.smithi176.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3517.gf1 4.0 MB/s | 274 kB 00:00 2024-05-12T10:55:29.425 INFO:teuthology.orchestra.run.smithi176.stdout:(33/156): ceph-mgr-rook-19.0.0-3517.gf1ec8823.e 1.2 MB/s | 49 kB 00:00 2024-05-12T10:55:29.438 INFO:teuthology.orchestra.run.smithi172.stdout:(122/156): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-05-12T10:55:29.464 INFO:teuthology.orchestra.run.smithi172.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-05-12T10:55:29.475 INFO:teuthology.orchestra.run.smithi176.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3517.gf 330 kB/s | 16 kB 00:00 2024-05-12T10:55:29.489 INFO:teuthology.orchestra.run.smithi172.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-05-12T10:55:29.515 INFO:teuthology.orchestra.run.smithi172.stdout:(125/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-05-12T10:55:29.534 INFO:teuthology.orchestra.run.smithi176.stdout:(35/156): ceph-volume-19.0.0-3517.gf1ec8823.el9 4.6 MB/s | 273 kB 00:00 2024-05-12T10:55:29.540 INFO:teuthology.orchestra.run.smithi172.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 233 kB/s | 18 kB 00:00 2024-05-12T10:55:29.565 INFO:teuthology.orchestra.run.smithi172.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-05-12T10:55:29.590 INFO:teuthology.orchestra.run.smithi172.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-05-12T10:55:29.616 INFO:teuthology.orchestra.run.smithi172.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-05-12T10:55:29.649 INFO:teuthology.orchestra.run.smithi172.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-05-12T10:55:29.668 INFO:teuthology.orchestra.run.smithi176.stdout:(36/156): cephadm-19.0.0-3517.gf1ec8823.el9.noa 5.6 MB/s | 763 kB 00:00 2024-05-12T10:55:29.675 INFO:teuthology.orchestra.run.smithi172.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 552 kB/s | 46 kB 00:00 2024-05-12T10:55:29.700 INFO:teuthology.orchestra.run.smithi172.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 939 kB/s | 79 kB 00:00 2024-05-12T10:55:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:(37/156): cephfs-top-19.0.0-3517.gf1ec8823.el9. 440 kB/s | 18 kB 00:00 2024-05-12T10:55:29.725 INFO:teuthology.orchestra.run.smithi172.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 765 kB/s | 58 kB 00:00 2024-05-12T10:55:29.750 INFO:teuthology.orchestra.run.smithi172.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-05-12T10:55:29.776 INFO:teuthology.orchestra.run.smithi172.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-05-12T10:55:29.776 INFO:teuthology.orchestra.run.smithi176.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-05-12T10:55:29.801 INFO:teuthology.orchestra.run.smithi172.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-12T10:55:29.826 INFO:teuthology.orchestra.run.smithi172.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 373 kB/s | 28 kB 00:00 2024-05-12T10:55:29.851 INFO:teuthology.orchestra.run.smithi172.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-05-12T10:55:29.877 INFO:teuthology.orchestra.run.smithi172.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-05-12T10:55:29.885 INFO:teuthology.orchestra.run.smithi176.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-05-12T10:55:29.902 INFO:teuthology.orchestra.run.smithi172.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 782 kB/s | 59 kB 00:00 2024-05-12T10:55:29.927 INFO:teuthology.orchestra.run.smithi172.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-05-12T10:55:29.935 INFO:teuthology.orchestra.run.smithi176.stdout:(40/156): ceph-mgr-dashboard-19.0.0-3517.gf1ec8 3.2 MB/s | 3.5 MB 00:01 2024-05-12T10:55:29.953 INFO:teuthology.orchestra.run.smithi172.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-05-12T10:55:29.986 INFO:teuthology.orchestra.run.smithi172.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-12T10:55:30.002 INFO:teuthology.orchestra.run.smithi176.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-05-12T10:55:30.012 INFO:teuthology.orchestra.run.smithi172.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-05-12T10:55:30.036 INFO:teuthology.orchestra.run.smithi176.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-05-12T10:55:30.037 INFO:teuthology.orchestra.run.smithi172.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-12T10:55:30.062 INFO:teuthology.orchestra.run.smithi172.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-05-12T10:55:30.088 INFO:teuthology.orchestra.run.smithi172.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-12T10:55:30.103 INFO:teuthology.orchestra.run.smithi176.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-12T10:55:30.130 INFO:teuthology.orchestra.run.smithi172.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-05-12T10:55:30.145 INFO:teuthology.orchestra.run.smithi176.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-05-12T10:55:30.187 INFO:teuthology.orchestra.run.smithi176.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-12T10:55:30.229 INFO:teuthology.orchestra.run.smithi176.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-12T10:55:30.271 INFO:teuthology.orchestra.run.smithi176.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-12T10:55:30.404 INFO:teuthology.orchestra.run.smithi176.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-05-12T10:55:30.434 INFO:teuthology.orchestra.run.smithi086.stdout:(71/156): ceph-test-19.0.0-3517.gf1ec8823.el9.x 3.5 MB/s | 49 MB 00:14 2024-05-12T10:55:30.446 INFO:teuthology.orchestra.run.smithi176.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-05-12T10:55:30.463 INFO:teuthology.orchestra.run.smithi172.stdout:(149/156): librados2-19.0.0-3517.gf1ec8823.el9. 8.5 MB/s | 3.4 MB 00:00 2024-05-12T10:55:30.468 INFO:teuthology.orchestra.run.smithi086.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 805 kB/s | 1.0 MB 00:01 2024-05-12T10:55:30.480 INFO:teuthology.orchestra.run.smithi176.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 646 kB/s | 21 kB 00:00 2024-05-12T10:55:30.513 INFO:teuthology.orchestra.run.smithi176.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-05-12T10:55:30.539 INFO:teuthology.orchestra.run.smithi176.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-05-12T10:55:30.551 INFO:teuthology.orchestra.run.smithi086.stdout:(73/156): postgresql-server-13.14-1.el9.x86_64. 3.7 MB/s | 5.8 MB 00:01 2024-05-12T10:55:30.555 INFO:teuthology.orchestra.run.smithi172.stdout:(150/156): librbd1-19.0.0-3517.gf1ec8823.el9.x8 6.7 MB/s | 3.1 MB 00:00 2024-05-12T10:55:30.556 INFO:teuthology.orchestra.run.smithi176.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 780 kB/s | 33 kB 00:00 2024-05-12T10:55:30.589 INFO:teuthology.orchestra.run.smithi176.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 548 kB/s | 18 kB 00:00 2024-05-12T10:55:30.623 INFO:teuthology.orchestra.run.smithi176.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-05-12T10:55:30.655 INFO:teuthology.orchestra.run.smithi172.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 418 kB/s | 42 kB 00:00 2024-05-12T10:55:30.673 INFO:teuthology.orchestra.run.smithi176.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-05-12T10:55:30.699 INFO:teuthology.orchestra.run.smithi176.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-05-12T10:55:30.706 INFO:teuthology.orchestra.run.smithi172.stdout:(152/156): NetworkManager-1.47.5-1.el9.x86_64.r 4.0 MB/s | 2.3 MB 00:00 2024-05-12T10:55:30.724 INFO:teuthology.orchestra.run.smithi176.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-05-12T10:55:30.758 INFO:teuthology.orchestra.run.smithi176.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-05-12T10:55:30.764 INFO:teuthology.orchestra.run.smithi172.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.2 MB/s | 248 kB 00:00 2024-05-12T10:55:30.841 INFO:teuthology.orchestra.run.smithi176.stdout:(60/156): ceph-mgr-diskprediction-local-19.0.0- 3.7 MB/s | 7.4 MB 00:01 2024-05-12T10:55:30.864 INFO:teuthology.orchestra.run.smithi172.stdout:(154/156): NetworkManager-libnm-1.47.5-1.el9.x8 4.6 MB/s | 1.8 MB 00:00 2024-05-12T10:55:30.888 INFO:teuthology.orchestra.run.smithi176.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 196 kB/s | 25 kB 00:00 2024-05-12T10:55:30.917 INFO:teuthology.orchestra.run.smithi176.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 3.0 MB/s | 582 kB 00:00 2024-05-12T10:55:30.942 INFO:teuthology.orchestra.run.smithi176.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.3 MB/s | 292 kB 00:00 2024-05-12T10:55:30.956 INFO:teuthology.orchestra.run.smithi172.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 1.3 MB 00:00 2024-05-12T10:55:30.959 INFO:teuthology.orchestra.run.smithi176.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-05-12T10:55:30.984 INFO:teuthology.orchestra.run.smithi176.stdout:(65/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 333 kB/s | 47 kB 00:00 2024-05-12T10:55:31.010 INFO:teuthology.orchestra.run.smithi176.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 525 kB/s | 35 kB 00:00 2024-05-12T10:55:31.110 INFO:teuthology.orchestra.run.smithi176.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-05-12T10:55:31.152 INFO:teuthology.orchestra.run.smithi176.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-12T10:55:31.185 INFO:teuthology.orchestra.run.smithi176.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-05-12T10:55:31.210 INFO:teuthology.orchestra.run.smithi086.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 113 kB/s | 87 kB 00:00 2024-05-12T10:55:31.211 INFO:teuthology.orchestra.run.smithi176.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-12T10:55:31.273 INFO:teuthology.orchestra.run.smithi172.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.7 MB/s | 2.4 MB 00:00 2024-05-12T10:55:31.277 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-05-12T10:55:31.277 INFO:teuthology.orchestra.run.smithi176.stdout:(71/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-12T10:55:31.278 INFO:teuthology.orchestra.run.smithi172.stdout:Total 14 MB/s | 226 MB 00:15 2024-05-12T10:55:31.320 INFO:teuthology.orchestra.run.smithi176.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-05-12T10:55:31.345 INFO:teuthology.orchestra.run.smithi176.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-12T10:55:31.385 INFO:teuthology.orchestra.run.smithi086.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 293 kB/s | 244 kB 00:00 2024-05-12T10:55:31.495 INFO:teuthology.orchestra.run.smithi176.stdout:(74/156): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-05-12T10:55:31.520 INFO:teuthology.orchestra.run.smithi176.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-05-12T10:55:31.546 INFO:teuthology.orchestra.run.smithi176.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-05-12T10:55:31.562 INFO:teuthology.orchestra.run.smithi176.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-05-12T10:55:31.579 INFO:teuthology.orchestra.run.smithi176.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 572 kB/s | 19 kB 00:00 2024-05-12T10:55:31.613 INFO:teuthology.orchestra.run.smithi176.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-12T10:55:31.630 INFO:teuthology.orchestra.run.smithi176.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-05-12T10:55:31.714 INFO:teuthology.orchestra.run.smithi176.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-05-12T10:55:31.739 INFO:teuthology.orchestra.run.smithi176.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-12T10:55:31.760 INFO:teuthology.orchestra.run.smithi086.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-05-12T10:55:31.772 INFO:teuthology.orchestra.run.smithi176.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-05-12T10:55:31.798 INFO:teuthology.orchestra.run.smithi176.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-12T10:55:31.815 INFO:teuthology.orchestra.run.smithi176.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-05-12T10:55:31.848 INFO:teuthology.orchestra.run.smithi176.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-05-12T10:55:31.874 INFO:teuthology.orchestra.run.smithi176.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-05-12T10:55:31.899 INFO:teuthology.orchestra.run.smithi176.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-05-12T10:55:31.924 INFO:teuthology.orchestra.run.smithi176.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-12T10:55:31.941 INFO:teuthology.orchestra.run.smithi176.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-05-12T10:55:32.016 INFO:teuthology.orchestra.run.smithi176.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-05-12T10:55:32.033 INFO:teuthology.orchestra.run.smithi176.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-05-12T10:55:32.052 INFO:teuthology.orchestra.run.smithi086.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 38 kB/s | 26 kB 00:00 2024-05-12T10:55:32.059 INFO:teuthology.orchestra.run.smithi176.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-05-12T10:55:32.084 INFO:teuthology.orchestra.run.smithi176.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-12T10:55:32.086 INFO:teuthology.orchestra.run.smithi086.stdout:(78/156): python3-jinja2-2.11.3-5.el9.noarch.rp 283 kB/s | 248 kB 00:00 2024-05-12T10:55:32.101 INFO:teuthology.orchestra.run.smithi176.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 861 kB/s | 36 kB 00:00 2024-05-12T10:55:32.118 INFO:teuthology.orchestra.run.smithi176.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-05-12T10:55:32.151 INFO:teuthology.orchestra.run.smithi176.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-05-12T10:55:32.177 INFO:teuthology.orchestra.run.smithi176.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-05-12T10:55:32.202 INFO:teuthology.orchestra.run.smithi176.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-12T10:55:32.227 INFO:teuthology.orchestra.run.smithi176.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-12T10:55:32.253 INFO:teuthology.orchestra.run.smithi176.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-05-12T10:55:32.286 INFO:teuthology.orchestra.run.smithi086.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 37 kB/s | 19 kB 00:00 2024-05-12T10:55:32.467 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-05-12T10:55:32.511 INFO:teuthology.orchestra.run.smithi176.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-05-12T10:55:32.536 INFO:teuthology.orchestra.run.smithi176.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-05-12T10:55:32.619 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-05-12T10:55:32.619 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-05-12T10:55:32.687 INFO:teuthology.orchestra.run.smithi176.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.0 MB/s | 309 kB 00:00 2024-05-12T10:55:32.703 INFO:teuthology.orchestra.run.smithi086.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 56 kB/s | 35 kB 00:00 2024-05-12T10:55:32.729 INFO:teuthology.orchestra.run.smithi176.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 469 kB/s | 19 kB 00:00 2024-05-12T10:55:32.754 INFO:teuthology.orchestra.run.smithi176.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.2 MB/s | 548 kB 00:00 2024-05-12T10:55:32.796 INFO:teuthology.orchestra.run.smithi176.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-05-12T10:55:32.838 INFO:teuthology.orchestra.run.smithi176.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-05-12T10:55:32.880 INFO:teuthology.orchestra.run.smithi176.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-05-12T10:55:32.947 INFO:teuthology.orchestra.run.smithi176.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-12T10:55:32.987 INFO:teuthology.orchestra.run.smithi086.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 184 kB/s | 172 kB 00:00 2024-05-12T10:55:33.089 INFO:teuthology.orchestra.run.smithi176.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-05-12T10:55:33.139 INFO:teuthology.orchestra.run.smithi176.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.3 MB/s | 839 kB 00:00 2024-05-12T10:55:33.198 INFO:teuthology.orchestra.run.smithi176.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 746 kB/s | 43 kB 00:00 2024-05-12T10:55:33.265 INFO:teuthology.orchestra.run.smithi176.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 484 kB/s | 32 kB 00:00 2024-05-12T10:55:33.382 INFO:teuthology.orchestra.run.smithi176.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 1.8 MB/s | 548 kB 00:00 2024-05-12T10:55:33.465 INFO:teuthology.orchestra.run.smithi176.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 75 kB/s | 15 kB 00:00 2024-05-12T10:55:33.491 INFO:teuthology.orchestra.run.smithi176.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-05-12T10:55:33.549 INFO:teuthology.orchestra.run.smithi176.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-05-12T10:55:33.591 INFO:teuthology.orchestra.run.smithi176.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 848 kB/s | 35 kB 00:00 2024-05-12T10:55:33.616 INFO:teuthology.orchestra.run.smithi176.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-05-12T10:55:33.700 INFO:teuthology.orchestra.run.smithi176.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-05-12T10:55:33.720 INFO:teuthology.orchestra.run.smithi086.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.7 MB/s | 5.1 MB 00:01 2024-05-12T10:55:33.733 INFO:teuthology.orchestra.run.smithi176.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.4 MB/s | 206 kB 00:00 2024-05-12T10:55:33.746 INFO:teuthology.orchestra.run.smithi086.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 240 kB/s | 250 kB 00:01 2024-05-12T10:55:33.759 INFO:teuthology.orchestra.run.smithi176.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-05-12T10:55:33.784 INFO:teuthology.orchestra.run.smithi176.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-05-12T10:55:33.809 INFO:teuthology.orchestra.run.smithi176.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-05-12T10:55:33.813 INFO:teuthology.orchestra.run.smithi086.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 269 kB/s | 222 kB 00:00 2024-05-12T10:55:33.835 INFO:teuthology.orchestra.run.smithi176.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-05-12T10:55:33.861 INFO:teuthology.orchestra.run.smithi176.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-05-12T10:55:33.885 INFO:teuthology.orchestra.run.smithi176.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-05-12T10:55:33.927 INFO:teuthology.orchestra.run.smithi176.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-05-12T10:55:33.969 INFO:teuthology.orchestra.run.smithi176.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-05-12T10:55:34.027 INFO:teuthology.orchestra.run.smithi176.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-05-12T10:55:34.053 INFO:teuthology.orchestra.run.smithi176.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 691 kB/s | 58 kB 00:00 2024-05-12T10:55:34.095 INFO:teuthology.orchestra.run.smithi176.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 396 kB/s | 16 kB 00:00 2024-05-12T10:55:34.120 INFO:teuthology.orchestra.run.smithi176.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-05-12T10:55:34.145 INFO:teuthology.orchestra.run.smithi176.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-05-12T10:55:34.171 INFO:teuthology.orchestra.run.smithi176.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-05-12T10:55:34.196 INFO:teuthology.orchestra.run.smithi176.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-05-12T10:55:34.229 INFO:teuthology.orchestra.run.smithi176.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-05-12T10:55:34.255 INFO:teuthology.orchestra.run.smithi176.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-05-12T10:55:34.280 INFO:teuthology.orchestra.run.smithi176.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-05-12T10:55:34.305 INFO:teuthology.orchestra.run.smithi176.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-05-12T10:55:34.330 INFO:teuthology.orchestra.run.smithi176.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-12T10:55:34.396 INFO:teuthology.orchestra.run.smithi086.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 65 kB/s | 42 kB 00:00 2024-05-12T10:55:34.406 INFO:teuthology.orchestra.run.smithi176.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 891 kB/s | 90 kB 00:00 2024-05-12T10:55:34.421 INFO:teuthology.orchestra.run.smithi086.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 110 kB/s | 77 kB 00:00 2024-05-12T10:55:34.422 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-05-12T10:55:34.423 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-05-12T10:55:34.431 INFO:teuthology.orchestra.run.smithi176.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-05-12T10:55:34.457 INFO:teuthology.orchestra.run.smithi176.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-05-12T10:55:34.473 INFO:teuthology.orchestra.run.smithi176.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-05-12T10:55:34.499 INFO:teuthology.orchestra.run.smithi176.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-05-12T10:55:34.638 INFO:teuthology.orchestra.run.smithi086.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 326 kB/s | 269 kB 00:00 2024-05-12T10:55:34.866 INFO:teuthology.orchestra.run.smithi176.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-05-12T10:55:34.999 INFO:teuthology.orchestra.run.smithi176.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 17 MB/s | 2.3 MB 00:00 2024-05-12T10:55:35.116 INFO:teuthology.orchestra.run.smithi176.stdout:(150/156): librbd1-19.0.0-3517.gf1ec8823.el9.x8 5.1 MB/s | 3.1 MB 00:00 2024-05-12T10:55:35.166 INFO:teuthology.orchestra.run.smithi176.stdout:(151/156): NetworkManager-libnm-1.47.5-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-05-12T10:55:35.180 INFO:teuthology.orchestra.run.smithi086.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 203 kB/s | 159 kB 00:00 2024-05-12T10:55:35.183 INFO:teuthology.orchestra.run.smithi176.stdout:(152/156): NetworkManager-team-1.47.5-1.el9.x86 624 kB/s | 42 kB 00:00 2024-05-12T10:55:35.250 INFO:teuthology.orchestra.run.smithi176.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.9 MB/s | 248 kB 00:00 2024-05-12T10:55:35.256 INFO:teuthology.orchestra.run.smithi086.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 334 kB/s | 279 kB 00:00 2024-05-12T10:55:35.309 INFO:teuthology.orchestra.run.smithi176.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 11 MB/s | 1.3 MB 00:00 2024-05-12T10:55:35.347 INFO:teuthology.orchestra.run.smithi086.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 78 kB/s | 51 kB 00:00 2024-05-12T10:55:35.401 INFO:teuthology.orchestra.run.smithi176.stdout:(155/156): librados2-19.0.0-3517.gf1ec8823.el9. 3.7 MB/s | 3.4 MB 00:00 2024-05-12T10:55:35.459 INFO:teuthology.orchestra.run.smithi176.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-05-12T10:55:35.462 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-05-12T10:55:35.462 INFO:teuthology.orchestra.run.smithi176.stdout:Total 11 MB/s | 226 MB 00:21 2024-05-12T10:55:35.906 INFO:teuthology.orchestra.run.smithi086.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 74 kB/s | 54 kB 00:00 2024-05-12T10:55:36.015 INFO:teuthology.orchestra.run.smithi086.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 62 kB/s | 42 kB 00:00 2024-05-12T10:55:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 67 kB/s | 44 kB 00:00 2024-05-12T10:55:36.619 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-05-12T10:55:36.766 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-05-12T10:55:36.767 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-05-12T10:55:36.890 INFO:teuthology.orchestra.run.smithi086.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.9 MB/s | 16 MB 00:01 2024-05-12T10:55:36.940 INFO:teuthology.orchestra.run.smithi086.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 239 kB/s | 221 kB 00:00 2024-05-12T10:55:37.291 INFO:teuthology.orchestra.run.smithi086.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 49 kB/s | 36 kB 00:00 2024-05-12T10:55:37.541 INFO:teuthology.orchestra.run.smithi086.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-05-12T10:55:37.758 INFO:teuthology.orchestra.run.smithi086.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 373 kB/s | 305 kB 00:00 2024-05-12T10:55:37.992 INFO:teuthology.orchestra.run.smithi086.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 82 kB/s | 58 kB 00:00 2024-05-12T10:55:38.267 INFO:teuthology.orchestra.run.smithi086.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 134 kB/s | 94 kB 00:00 2024-05-12T10:55:38.375 INFO:teuthology.orchestra.run.smithi086.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-05-12T10:55:38.434 INFO:teuthology.orchestra.run.smithi086.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 94 kB/s | 64 kB 00:00 2024-05-12T10:55:38.579 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-05-12T10:55:38.579 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-05-12T10:55:38.634 INFO:teuthology.orchestra.run.smithi086.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-05-12T10:55:38.693 INFO:teuthology.orchestra.run.smithi086.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 66 kB/s | 45 kB 00:00 2024-05-12T10:55:38.926 INFO:teuthology.orchestra.run.smithi086.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-05-12T10:55:38.952 INFO:teuthology.orchestra.run.smithi086.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 83 kB/s | 19 kB 00:00 2024-05-12T10:55:39.052 INFO:teuthology.orchestra.run.smithi086.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-05-12T10:55:39.077 INFO:teuthology.orchestra.run.smithi086.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 697 kB/s | 309 kB 00:00 2024-05-12T10:55:39.144 INFO:teuthology.orchestra.run.smithi086.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-12T10:55:39.169 INFO:teuthology.orchestra.run.smithi086.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-05-12T10:55:39.228 INFO:teuthology.orchestra.run.smithi086.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-12T10:55:39.253 INFO:teuthology.orchestra.run.smithi086.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-05-12T10:55:39.304 INFO:teuthology.orchestra.run.smithi086.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-05-12T10:55:39.329 INFO:teuthology.orchestra.run.smithi086.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2024-05-12T10:55:39.371 INFO:teuthology.orchestra.run.smithi086.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 483 kB/s | 32 kB 00:00 2024-05-12T10:55:39.396 INFO:teuthology.orchestra.run.smithi086.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-05-12T10:55:39.446 INFO:teuthology.orchestra.run.smithi086.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-12T10:55:39.480 INFO:teuthology.orchestra.run.smithi086.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.6 MB/s | 839 kB 00:00 2024-05-12T10:55:39.505 INFO:teuthology.orchestra.run.smithi086.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-05-12T10:55:39.531 INFO:teuthology.orchestra.run.smithi086.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-05-12T10:55:39.556 INFO:teuthology.orchestra.run.smithi086.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 467 kB/s | 35 kB 00:00 2024-05-12T10:55:39.589 INFO:teuthology.orchestra.run.smithi086.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-05-12T10:55:39.648 INFO:teuthology.orchestra.run.smithi086.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-05-12T10:55:39.665 INFO:teuthology.orchestra.run.smithi086.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 141 kB/s | 11 kB 00:00 2024-05-12T10:55:39.691 INFO:teuthology.orchestra.run.smithi086.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-05-12T10:55:39.716 INFO:teuthology.orchestra.run.smithi086.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 262 kB/s | 18 kB 00:00 2024-05-12T10:55:39.741 INFO:teuthology.orchestra.run.smithi086.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-05-12T10:55:39.758 INFO:teuthology.orchestra.run.smithi086.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 288 kB/s | 19 kB 00:00 2024-05-12T10:55:39.783 INFO:teuthology.orchestra.run.smithi086.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-05-12T10:55:39.825 INFO:teuthology.orchestra.run.smithi086.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 692 kB/s | 46 kB 00:00 2024-05-12T10:55:39.851 INFO:teuthology.orchestra.run.smithi086.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-05-12T10:55:39.901 INFO:teuthology.orchestra.run.smithi086.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-05-12T10:55:39.918 INFO:teuthology.orchestra.run.smithi086.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 627 kB/s | 58 kB 00:00 2024-05-12T10:55:39.943 INFO:teuthology.orchestra.run.smithi086.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-05-12T10:55:39.968 INFO:teuthology.orchestra.run.smithi086.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-05-12T10:55:39.994 INFO:teuthology.orchestra.run.smithi086.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-12T10:55:40.019 INFO:teuthology.orchestra.run.smithi086.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-05-12T10:55:40.069 INFO:teuthology.orchestra.run.smithi086.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-05-12T10:55:40.094 INFO:teuthology.orchestra.run.smithi086.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-05-12T10:55:40.120 INFO:teuthology.orchestra.run.smithi086.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-12T10:55:40.145 INFO:teuthology.orchestra.run.smithi086.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-05-12T10:55:40.170 INFO:teuthology.orchestra.run.smithi086.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-05-12T10:55:40.195 INFO:teuthology.orchestra.run.smithi086.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-12T10:55:40.221 INFO:teuthology.orchestra.run.smithi086.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-12T10:55:40.246 INFO:teuthology.orchestra.run.smithi086.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-05-12T10:55:40.272 INFO:teuthology.orchestra.run.smithi086.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-05-12T10:55:40.296 INFO:teuthology.orchestra.run.smithi086.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-12T10:55:40.347 INFO:teuthology.orchestra.run.smithi086.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-05-12T10:55:40.497 INFO:teuthology.orchestra.run.smithi086.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-05-12T10:55:40.586 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-05-12T10:55:40.639 INFO:teuthology.orchestra.run.smithi086.stdout:(150/156): librbd1-19.0.0-3517.gf1ec8823.el9.x8 9.2 MB/s | 3.1 MB 00:00 2024-05-12T10:55:40.660 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-12T10:55:40.698 INFO:teuthology.orchestra.run.smithi086.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 716 kB/s | 42 kB 00:00 2024-05-12T10:55:40.699 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-12T10:55:40.753 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-12T10:55:40.773 INFO:teuthology.orchestra.run.smithi086.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 3.2 MB/s | 248 kB 00:00 2024-05-12T10:55:40.787 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-12T10:55:40.812 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-12T10:55:40.855 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-12T10:55:40.882 INFO:teuthology.orchestra.run.smithi086.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-05-12T10:55:40.932 INFO:teuthology.orchestra.run.smithi086.stdout:(154/156): librados2-19.0.0-3517.gf1ec8823.el9. 5.1 MB/s | 3.4 MB 00:00 2024-05-12T10:55:41.074 INFO:teuthology.orchestra.run.smithi086.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-05-12T10:55:41.166 INFO:teuthology.orchestra.run.smithi086.stdout:(156/156): NetworkManager-libnm-1.47.5-1.el9.x8 2.7 MB/s | 1.8 MB 00:00 2024-05-12T10:55:41.172 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-05-12T10:55:41.172 INFO:teuthology.orchestra.run.smithi086.stdout:Total 8.3 MB/s | 226 MB 00:27 2024-05-12T10:55:41.178 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-12T10:55:41.341 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:55:41.535 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:55:41.556 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:55:41.648 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:55:41.677 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 10/164 2024-05-12T10:55:41.832 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-12T10:55:41.891 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-12T10:55:41.918 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:55:42.021 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:55:42.044 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 14/164 2024-05-12T10:55:42.107 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 14/164 2024-05-12T10:55:42.129 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-12T10:55:42.153 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-12T10:55:42.312 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-12T10:55:42.384 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-05-12T10:55:42.444 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-12T10:55:42.535 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-05-12T10:55:42.535 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-05-12T10:55:42.585 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-12T10:55:42.645 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-12T10:55:42.762 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:42.830 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:43.020 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:43.127 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-12T10:55:43.159 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-12T10:55:43.194 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-12T10:55:43.268 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-12T10:55:43.310 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-12T10:55:43.353 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-12T10:55:43.387 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-12T10:55:43.415 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-12T10:55:43.484 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-12T10:55:43.537 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-12T10:55:43.567 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-12T10:55:43.602 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-12T10:55:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-12T10:55:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9. 32/164 2024-05-12T10:55:43.758 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el 33/164 2024-05-12T10:55:43.786 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_6 34/164 2024-05-12T10:55:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-12T10:55:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-12T10:55:43.977 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-12T10:55:44.124 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-12T10:55:44.170 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-12T10:55:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-05-12T10:55:44.677 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-05-12T10:55:44.678 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-05-12T10:55:44.715 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-12T10:55:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-12T10:55:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-12T10:55:44.801 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-12T10:55:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-12T10:55:44.837 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-12T10:55:44.856 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-12T10:55:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-12T10:55:44.881 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-12T10:55:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_6 44/164 2024-05-12T10:55:44.924 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-12T10:55:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-12T10:55:45.125 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-12T10:55:45.187 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-12T10:55:45.264 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-12T10:55:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-12T10:55:45.343 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-12T10:55:45.365 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:55:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-12T10:55:45.446 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-12T10:55:45.483 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-12T10:55:45.486 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:55:45.516 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:55:45.531 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-12T10:55:45.565 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-12T10:55:45.607 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:55:45.609 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-12T10:55:45.637 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 10/164 2024-05-12T10:55:45.651 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-12T10:55:45.790 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-12T10:55:45.791 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-12T10:55:45.834 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-12T10:55:45.862 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:55:45.965 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:55:45.989 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 14/164 2024-05-12T10:55:46.034 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 14/164 2024-05-12T10:55:46.056 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-12T10:55:46.059 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-12T10:55:46.081 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-12T10:55:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-12T10:55:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-12T10:55:46.239 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-12T10:55:46.272 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-12T10:55:46.279 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-12T10:55:46.319 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-12T10:55:46.344 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-12T10:55:46.369 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-12T10:55:46.402 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-12T10:55:46.446 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-12T10:55:46.570 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-12T10:55:46.580 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-12T10:55:46.618 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-12T10:55:46.630 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-12T10:55:46.646 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-12T10:55:46.688 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-12T10:55:46.728 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-12T10:55:46.751 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:46.767 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-12T10:55:46.797 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-12T10:55:46.823 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:46.832 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-12T10:55:46.865 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-12T10:55:46.907 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-12T10:55:46.941 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-12T10:55:47.030 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-12T10:55:47.040 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:47.072 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-12T10:55:47.103 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-12T10:55:47.149 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-12T10:55:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-12T10:55:47.186 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-12T10:55:47.221 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-12T10:55:47.250 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-12T10:55:47.295 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-12T10:55:47.305 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-12T10:55:47.328 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-12T10:55:47.372 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-12T10:55:47.405 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-12T10:55:47.433 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-12T10:55:47.502 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-12T10:55:47.555 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-12T10:55:47.585 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-12T10:55:47.621 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-12T10:55:47.698 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-12T10:55:47.732 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9. 32/164 2024-05-12T10:55:47.766 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el 33/164 2024-05-12T10:55:47.795 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_6 34/164 2024-05-12T10:55:47.866 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-12T10:55:47.909 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-12T10:55:47.985 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-12T10:55:48.059 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-12T10:55:48.110 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-12T10:55:48.144 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-12T10:55:48.146 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-12T10:55:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-12T10:55:48.247 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-12T10:55:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-12T10:55:48.392 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-12T10:55:48.429 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-12T10:55:48.608 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-12T10:55:48.636 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-12T10:55:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-12T10:55:48.729 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-12T10:55:48.808 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-12T10:55:48.836 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-12T10:55:48.879 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-12T10:55:48.917 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_6 44/164 2024-05-12T10:55:48.959 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-12T10:55:49.124 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-12T10:55:49.203 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-12T10:55:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-12T10:55:49.360 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-12T10:55:49.397 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-12T10:55:49.432 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-12T10:55:49.463 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-12T10:55:49.500 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-12T10:55:49.511 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-12T10:55:49.546 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-12T10:55:49.582 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-12T10:55:49.625 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-12T10:55:49.668 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-12T10:55:49.804 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-12T10:55:49.856 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-12T10:55:49.886 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-12T10:55:49.928 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-12T10:55:50.024 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-12T10:55:50.061 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-12T10:55:50.101 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-12T10:55:50.126 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-12T10:55:50.151 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-12T10:55:50.226 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-12T10:55:50.354 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-12T10:55:50.392 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-12T10:55:50.419 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-12T10:55:50.454 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-12T10:55:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-12T10:55:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-12T10:55:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-12T10:55:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-12T10:55:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-12T10:55:50.664 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-12T10:55:50.698 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-12T10:55:50.769 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-12T10:55:50.786 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-12T10:55:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-05-12T10:55:50.829 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-12T10:55:50.857 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-12T10:55:50.860 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-12T10:55:50.879 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-12T10:55:50.885 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-12T10:55:50.898 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-12T10:55:50.918 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-12T10:55:50.918 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-12T10:55:50.981 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-12T10:55:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-12T10:55:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-12T10:55:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-12T10:55:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-12T10:55:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-12T10:55:51.232 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-12T10:55:51.289 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 101/164 2024-05-12T10:55:51.380 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 101/164 2024-05-12T10:55:51.411 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 102/164 2024-05-12T10:55:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-12T10:55:51.455 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-12T10:55:51.548 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:55:51.685 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:55:51.716 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:55:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:55:51.791 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-12T10:55:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 10/164 2024-05-12T10:55:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-12T10:55:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-12T10:55:51.935 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-12T10:55:51.959 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 105/164 2024-05-12T10:55:51.983 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-12T10:55:52.009 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-12T10:55:52.030 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 105/164 2024-05-12T10:55:52.041 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-12T10:55:52.061 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 106/164 2024-05-12T10:55:52.067 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-12T10:55:52.094 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:55:52.130 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-12T10:55:52.160 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-12T10:55:52.205 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:55:52.246 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 14/164 2024-05-12T10:55:52.336 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-12T10:55:52.366 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-12T10:55:52.443 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-12T10:55:52.533 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 14/164 2024-05-12T10:55:52.555 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-12T10:55:52.575 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-12T10:55:52.724 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-12T10:55:52.891 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-12T10:55:53.027 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-12T10:55:53.071 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-12T10:55:53.088 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-12T10:55:53.186 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:53.198 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-12T10:55:53.280 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:53.494 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-12T10:55:53.601 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-12T10:55:53.627 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-12T10:55:53.661 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-12T10:55:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-12T10:55:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-12T10:55:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-12T10:55:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-12T10:55:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-12T10:55:53.932 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-12T10:55:53.986 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-12T10:55:54.025 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-12T10:55:54.069 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-12T10:55:54.144 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-12T10:55:54.180 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9. 32/164 2024-05-12T10:55:54.223 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el 33/164 2024-05-12T10:55:54.252 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_6 34/164 2024-05-12T10:55:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-12T10:55:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-12T10:55:54.416 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:55:54.444 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-12T10:55:54.449 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-12T10:55:54.450 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:55:54.527 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-12T10:55:54.555 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-12T10:55:54.579 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-12T10:55:54.588 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-12T10:55:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-12T10:55:54.901 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-12T10:55:54.943 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 101/164 2024-05-12T10:55:55.007 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:55:55.033 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 101/164 2024-05-12T10:55:55.046 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 108/164 2024-05-12T10:55:55.064 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 102/164 2024-05-12T10:55:55.100 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-12T10:55:55.147 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 108/164 2024-05-12T10:55:55.147 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-12T10:55:55.147 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-12T10:55:55.147 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:55:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-12T10:55:55.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 109/164 2024-05-12T10:55:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-12T10:55:55.269 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-12T10:55:55.311 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-12T10:55:55.358 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_6 44/164 2024-05-12T10:55:55.399 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-12T10:55:55.566 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-12T10:55:55.579 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-12T10:55:55.604 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 105/164 2024-05-12T10:55:55.627 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-12T10:55:55.658 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 105/164 2024-05-12T10:55:55.680 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 106/164 2024-05-12T10:55:55.721 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-12T10:55:55.799 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-12T10:55:55.872 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-12T10:55:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-12T10:55:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-12T10:55:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-12T10:55:56.031 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-12T10:55:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-12T10:55:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-12T10:55:56.258 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-12T10:55:56.305 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-12T10:55:56.335 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-12T10:55:56.377 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-12T10:55:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-12T10:55:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-12T10:55:56.543 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-12T10:55:56.576 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-12T10:55:56.601 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-12T10:55:56.708 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-12T10:55:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-12T10:55:56.874 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-12T10:55:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-12T10:55:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-12T10:55:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-12T10:55:57.007 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-12T10:55:57.046 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-12T10:55:57.080 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-12T10:55:57.113 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-12T10:55:57.155 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-12T10:55:57.190 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-12T10:55:57.275 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-12T10:55:57.328 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-12T10:55:57.359 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-12T10:55:57.406 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-12T10:55:57.504 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-12T10:55:57.552 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-12T10:55:57.957 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:55:57.993 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:55:58.262 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-12T10:55:58.308 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-12T10:55:58.341 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-12T10:55:58.438 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-12T10:55:58.491 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-12T10:55:58.538 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:55:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-12T10:55:58.580 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 108/164 2024-05-12T10:55:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-12T10:55:58.672 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 108/164 2024-05-12T10:55:58.672 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-12T10:55:58.672 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-12T10:55:58.672 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:55:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 109/164 2024-05-12T10:55:58.802 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-12T10:55:58.833 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-12T10:55:58.910 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-12T10:55:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-12T10:55:59.663 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-12T10:56:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-12T10:56:00.995 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-12T10:56:01.022 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-12T10:56:01.056 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-12T10:56:01.371 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-12T10:56:01.410 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 101/164 2024-05-12T10:56:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 101/164 2024-05-12T10:56:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 102/164 2024-05-12T10:56:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-12T10:56:02.052 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-12T10:56:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 105/164 2024-05-12T10:56:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 105/164 2024-05-12T10:56:02.181 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 106/164 2024-05-12T10:56:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:56:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:56:05.052 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 107/164 2024-05-12T10:56:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 108/164 2024-05-12T10:56:05.164 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 108/164 2024-05-12T10:56:05.164 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-12T10:56:05.164 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-12T10:56:05.164 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:05.199 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 109/164 2024-05-12T10:56:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 109/164 2024-05-12T10:56:06.688 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-05-12T10:56:06.688 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-05-12T10:56:06.688 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-05-12T10:56:06.688 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-05-12T10:56:06.688 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-05-12T10:56:06.688 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-05-12T10:56:06.688 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-05-12T10:56:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:06.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 110/164 2024-05-12T10:56:06.877 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 110/164 2024-05-12T10:56:06.877 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:06.877 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-12T10:56:06.877 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:08.347 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 111/164 2024-05-12T10:56:08.373 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 111/164 2024-05-12T10:56:08.373 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:08.373 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-12T10:56:08.373 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-12T10:56:08.373 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-12T10:56:08.374 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:08.598 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 112/164 2024-05-12T10:56:08.620 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 112/164 2024-05-12T10:56:08.621 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:08.621 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-12T10:56:08.621 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-12T10:56:08.621 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-12T10:56:08.621 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 113/164 2024-05-12T10:56:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 113/164 2024-05-12T10:56:09.121 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:09.121 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-12T10:56:09.121 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-12T10:56:09.121 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-12T10:56:09.121 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:09.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-12T10:56:09.295 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-12T10:56:09.350 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-12T10:56:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-12T10:56:09.592 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-12T10:56:09.687 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-12T10:56:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-12T10:56:09.918 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-12T10:56:09.966 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-12T10:56:10.006 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-12T10:56:10.022 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 109/164 2024-05-12T10:56:10.022 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-05-12T10:56:10.022 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-05-12T10:56:10.022 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-05-12T10:56:10.022 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-05-12T10:56:10.023 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-05-12T10:56:10.023 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-05-12T10:56:10.023 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-05-12T10:56:10.023 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:10.034 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-12T10:56:10.187 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 110/164 2024-05-12T10:56:10.202 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 110/164 2024-05-12T10:56:10.202 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:10.202 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-12T10:56:10.202 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 125/164 2024-05-12T10:56:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 125/164 2024-05-12T10:56:10.457 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.e 126/164 2024-05-12T10:56:10.519 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823. 127/164 2024-05-12T10:56:10.547 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 128/164 2024-05-12T10:56:11.596 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 128/164 2024-05-12T10:56:11.632 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 129/164 2024-05-12T10:56:11.697 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 111/164 2024-05-12T10:56:11.729 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 111/164 2024-05-12T10:56:11.729 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:11.729 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-12T10:56:11.729 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-12T10:56:11.730 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-12T10:56:11.730 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 112/164 2024-05-12T10:56:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 112/164 2024-05-12T10:56:11.995 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:11.995 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-12T10:56:11.996 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-12T10:56:11.996 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-12T10:56:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:12.442 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 113/164 2024-05-12T10:56:12.465 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 113/164 2024-05-12T10:56:12.465 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:12.465 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-12T10:56:12.465 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-12T10:56:12.465 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-12T10:56:12.465 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:12.572 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-12T10:56:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 129/164 2024-05-12T10:56:12.629 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-12T10:56:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 130/164 2024-05-12T10:56:12.685 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-12T10:56:12.746 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 130/164 2024-05-12T10:56:12.872 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-12T10:56:12.903 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el 131/164 2024-05-12T10:56:12.918 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-12T10:56:12.935 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 132/164 2024-05-12T10:56:12.958 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 132/164 2024-05-12T10:56:12.958 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:12.958 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-12T10:56:12.959 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-12T10:56:12.959 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-12T10:56:12.959 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:12.996 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-12T10:56:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 133/164 2024-05-12T10:56:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 133/164 2024-05-12T10:56:13.093 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-12T10:56:13.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 134/164 2024-05-12T10:56:13.168 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 135/164 2024-05-12T10:56:13.233 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-12T10:56:13.276 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-12T10:56:13.308 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-12T10:56:13.336 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-12T10:56:13.703 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 125/164 2024-05-12T10:56:13.734 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 125/164 2024-05-12T10:56:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.e 126/164 2024-05-12T10:56:13.836 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823. 127/164 2024-05-12T10:56:13.874 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 128/164 2024-05-12T10:56:14.098 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-12T10:56:14.129 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 137/164 2024-05-12T10:56:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 137/164 2024-05-12T10:56:14.153 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:14.153 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-12T10:56:14.153 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:56:14.153 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:56:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:14.197 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 138/164 2024-05-12T10:56:14.219 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 138/164 2024-05-12T10:56:14.220 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:14.220 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-12T10:56:14.220 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:14.264 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 139/164 2024-05-12T10:56:14.287 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 139/164 2024-05-12T10:56:14.287 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:14.287 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-12T10:56:14.287 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:56:14.287 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:56:14.287 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:14.598 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 140/164 2024-05-12T10:56:14.621 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 140/164 2024-05-12T10:56:14.621 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:14.621 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-12T10:56:14.621 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-12T10:56:14.621 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-12T10:56:14.622 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:14.916 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 128/164 2024-05-12T10:56:14.951 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 129/164 2024-05-12T10:56:15.920 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 129/164 2024-05-12T10:56:15.951 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 130/164 2024-05-12T10:56:16.061 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 130/164 2024-05-12T10:56:16.230 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el 131/164 2024-05-12T10:56:16.261 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 132/164 2024-05-12T10:56:16.284 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 132/164 2024-05-12T10:56:16.285 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:16.285 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-12T10:56:16.285 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-12T10:56:16.285 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-12T10:56:16.285 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:16.329 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 133/164 2024-05-12T10:56:16.341 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 133/164 2024-05-12T10:56:16.438 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 134/164 2024-05-12T10:56:16.494 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 135/164 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 109/164 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /root 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2024-05-12T10:56:17.267 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:17.417 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-12T10:56:17.438 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 110/164 2024-05-12T10:56:17.456 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 110/164 2024-05-12T10:56:17.456 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:17.457 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-12T10:56:17.457 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:17.457 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 137/164 2024-05-12T10:56:17.479 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 137/164 2024-05-12T10:56:17.479 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:17.479 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-12T10:56:17.479 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:56:17.479 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:56:17.480 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:17.524 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 138/164 2024-05-12T10:56:17.546 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 138/164 2024-05-12T10:56:17.546 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:17.546 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-12T10:56:17.546 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:17.591 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 139/164 2024-05-12T10:56:17.613 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 139/164 2024-05-12T10:56:17.614 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:17.614 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-12T10:56:17.614 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:56:17.614 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:56:17.614 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:17.917 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 140/164 2024-05-12T10:56:17.939 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 140/164 2024-05-12T10:56:17.939 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:17.939 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-12T10:56:17.939 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-12T10:56:17.939 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-12T10:56:17.939 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 111/164 2024-05-12T10:56:18.995 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 111/164 2024-05-12T10:56:18.995 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:18.995 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-12T10:56:18.995 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-12T10:56:18.995 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-12T10:56:18.995 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 112/164 2024-05-12T10:56:19.251 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 141/164 2024-05-12T10:56:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 112/164 2024-05-12T10:56:19.259 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:19.259 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-12T10:56:19.259 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-12T10:56:19.259 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-12T10:56:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 142/164 2024-05-12T10:56:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 143/164 2024-05-12T10:56:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-12T10:56:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-12T10:56:19.592 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 146/164 2024-05-12T10:56:19.639 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-12T10:56:19.669 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_ 148/164 2024-05-12T10:56:19.699 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-12T10:56:19.703 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 113/164 2024-05-12T10:56:19.727 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 113/164 2024-05-12T10:56:19.727 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:19.727 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-12T10:56:19.727 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-12T10:56:19.727 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-12T10:56:19.727 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:19.745 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-12T10:56:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-12T10:56:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-12T10:56:19.945 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-12T10:56:20.128 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-12T10:56:20.178 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-12T10:56:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-12T10:56:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-12T10:56:20.381 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:20.417 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:20.438 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:20.492 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-12T10:56:20.546 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-12T10:56:20.603 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-12T10:56:20.629 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-12T10:56:21.041 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 125/164 2024-05-12T10:56:21.070 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 125/164 2024-05-12T10:56:21.102 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.e 126/164 2024-05-12T10:56:21.163 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823. 127/164 2024-05-12T10:56:21.193 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 128/164 2024-05-12T10:56:21.291 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 152/164 2024-05-12T10:56:21.381 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-12T10:56:21.423 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-12T10:56:21.507 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-12T10:56:21.542 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-12T10:56:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-12T10:56:21.568 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-12T10:56:21.653 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-12T10:56:21.677 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-12T10:56:21.677 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-12T10:56:21.761 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-12T10:56:21.786 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-12T10:56:21.792 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:21.792 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:21.972 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-12T10:56:22.056 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-12T10:56:22.128 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:22.233 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 128/164 2024-05-12T10:56:22.270 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 129/164 2024-05-12T10:56:22.520 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 141/164 2024-05-12T10:56:22.561 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 142/164 2024-05-12T10:56:22.603 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 143/164 2024-05-12T10:56:22.635 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-12T10:56:22.670 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-12T10:56:22.854 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 146/164 2024-05-12T10:56:22.899 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-12T10:56:22.929 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_ 148/164 2024-05-12T10:56:22.959 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-12T10:56:23.005 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-12T10:56:23.240 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 129/164 2024-05-12T10:56:23.270 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 130/164 2024-05-12T10:56:23.383 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 130/164 2024-05-12T10:56:23.556 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el 131/164 2024-05-12T10:56:23.589 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 132/164 2024-05-12T10:56:23.594 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:23.613 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 132/164 2024-05-12T10:56:23.614 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:23.614 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-12T10:56:23.614 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-12T10:56:23.614 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-12T10:56:23.614 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:23.628 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:23.648 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 133/164 2024-05-12T10:56:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 133/164 2024-05-12T10:56:23.766 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 134/164 2024-05-12T10:56:23.827 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 135/164 2024-05-12T10:56:24.483 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 152/164 2024-05-12T10:56:24.574 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-12T10:56:24.615 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-12T10:56:24.706 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-12T10:56:24.735 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-12T10:56:24.759 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-12T10:56:24.762 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-12T10:56:24.762 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-12T10:56:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 137/164 2024-05-12T10:56:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 137/164 2024-05-12T10:56:24.816 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:24.816 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-12T10:56:24.816 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:56:24.817 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-12T10:56:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:24.846 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-12T10:56:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 138/164 2024-05-12T10:56:24.879 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-12T10:56:24.879 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-12T10:56:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 138/164 2024-05-12T10:56:24.883 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:24.883 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-12T10:56:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:24.935 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 139/164 2024-05-12T10:56:24.959 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 139/164 2024-05-12T10:56:24.959 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:24.959 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-12T10:56:24.959 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:56:24.959 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-12T10:56:24.960 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:24.963 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-12T10:56:24.988 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-12T10:56:24.993 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:24.994 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:25.173 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:25.174 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-12T10:56:25.257 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-12T10:56:25.269 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 140/164 2024-05-12T10:56:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 140/164 2024-05-12T10:56:25.293 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-12T10:56:25.293 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-12T10:56:25.293 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-12T10:56:25.294 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-12T10:56:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:27.609 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:27.609 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 1/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 2/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 3/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 4/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 5/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 6/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 7/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 10/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 11/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 12/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 14/164 2024-05-12T10:56:27.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_ 15/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 16/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 17/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_6 18/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 19/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 20/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el 21/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9. 22/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_6 23/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 24/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 25/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 26/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 27/164 2024-05-12T10:56:27.611 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 28/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 29/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823. 30/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 31/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 32/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 33/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el 34/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 35/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.e 36/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 37/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 38/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 39/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-12T10:56:27.612 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-12T10:56:27.613 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-12T10:56:27.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-12T10:56:27.615 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-12T10:56:27.616 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-12T10:56:27.617 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-12T10:56:27.618 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-12T10:56:27.619 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 149/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 151/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-12T10:56:27.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-12T10:56:27.621 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-12T10:56:27.621 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-12T10:56:27.621 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-12T10:56:27.621 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-12T10:56:27.621 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-12T10:56:27.621 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-12T10:56:29.894 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-12T10:56:29.895 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.896 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.897 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.898 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-12T10:56:29.899 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.14-1.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-12T10:56:29.900 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-12T10:56:29.901 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-12T10:56:29.902 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-12T10:56:29.903 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-12T10:56:29.904 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-12T10:56:29.905 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-12T10:56:29.906 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-12T10:56:29.907 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-12T10:56:29.907 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-12T10:56:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 141/164 2024-05-12T10:56:29.907 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-12T10:56:29.907 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-12T10:56:29.907 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-05-12T10:56:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 142/164 2024-05-12T10:56:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 143/164 2024-05-12T10:56:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-12T10:56:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-12T10:56:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 146/164 2024-05-12T10:56:30.299 DEBUG:teuthology.parallel:result is None 2024-05-12T10:56:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-12T10:56:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_ 148/164 2024-05-12T10:56:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-12T10:56:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-12T10:56:30.885 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:30.885 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 1/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 2/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 3/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 4/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 5/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 6/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 7/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 10/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 11/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 12/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:56:30.886 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 14/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_ 15/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 16/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 17/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_6 18/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 19/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 20/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el 21/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9. 22/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_6 23/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 24/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 25/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 26/164 2024-05-12T10:56:30.887 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 27/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 28/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 29/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823. 30/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 31/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 32/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 33/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el 34/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 35/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.e 36/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 37/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 38/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 39/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-12T10:56:30.888 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-12T10:56:30.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-12T10:56:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-12T10:56:30.891 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-12T10:56:30.892 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-12T10:56:30.893 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-12T10:56:30.894 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-12T10:56:30.895 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 149/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-12T10:56:30.896 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 151/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-12T10:56:30.897 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-12T10:56:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:31.039 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:31.060 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-12T10:56:31.887 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 152/164 2024-05-12T10:56:31.977 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-12T10:56:32.022 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-12T10:56:32.121 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-12T10:56:32.155 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-12T10:56:32.181 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-12T10:56:32.181 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-12T10:56:32.265 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-12T10:56:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-12T10:56:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-12T10:56:32.391 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-12T10:56:32.416 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-12T10:56:32.423 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:32.423 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:32.610 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-12T10:56:32.610 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-12T10:56:32.694 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-12T10:56:32.767 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:33.635 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: automake-1.16.2-8.el9.noarch 2024-05-12T10:56:33.636 INFO:teuthology.orchestra.run.smithi176.stdout: bison-3.7.4-5.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.637 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-12T10:56:33.638 INFO:teuthology.orchestra.run.smithi176.stdout: flex-2.6.4-9.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-12T10:56:33.639 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-12T10:56:33.640 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-13.14-1.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-12T10:56:33.641 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-12T10:56:33.642 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-12T10:56:33.643 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-12T10:56:33.644 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-12T10:56:33.645 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-3.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-12T10:56:33.646 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-12T10:56:33.647 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-12T10:56:33.647 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:56:33.647 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-05-12T10:56:34.058 DEBUG:teuthology.parallel:result is None 2024-05-12T10:56:38.119 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 1/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 2/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 3/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 4/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8 5/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 6/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 7/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 8/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 9/164 2024-05-12T10:56:38.120 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 10/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 11/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 12/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 13/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 14/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_ 15/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 16/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 17/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_6 18/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86 19/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 20/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el 21/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9. 22/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_6 23/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 24/164 2024-05-12T10:56:38.121 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 25/164 2024-05-12T10:56:38.122 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 26/164 2024-05-12T10:56:38.122 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 27/164 2024-05-12T10:56:38.122 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 28/164 2024-05-12T10:56:38.122 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 29/164 2024-05-12T10:56:38.122 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823. 30/164 2024-05-12T10:56:38.134 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noa 31/164 2024-05-12T10:56:38.134 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.n 32/164 2024-05-12T10:56:38.134 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1e 33/164 2024-05-12T10:56:38.134 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el 34/164 2024-05-12T10:56:38.134 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 35/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.e 36/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 37/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 38/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 39/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-12T10:56:38.135 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-12T10:56:38.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-12T10:56:38.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-12T10:56:38.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-12T10:56:38.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-12T10:56:38.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-12T10:56:38.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-12T10:56:38.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 149/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 151/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-12T10:56:38.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-12T10:56:38.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-12T10:56:40.791 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-12T10:56:40.791 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:40.791 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-05-12T10:56:40.791 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:40.791 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:40.791 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.2-8.el9.noarch 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.7.4-5.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.792 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.793 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-shell-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top-2:19.0.0-3517.gf1ec8823.el9.noarch 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.4-9.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-12T10:56:40.794 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-12T10:56:40.795 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: lua-5.4.4-4.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-12T10:56:40.796 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-13.14-1.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-12T10:56:40.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-12T10:56:40.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-12T10:56:40.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply-3.11-14.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-12T10:56:40.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-12T10:56:40.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-12T10:56:40.802 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:19.0.0-3517.gf1ec8823.el9.x86_64 2024-05-12T10:56:40.803 INFO:teuthology.orchestra.run.smithi086.stdout: re2-1:20211101-3.el9.x86_64 2024-05-12T10:56:40.804 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-12T10:56:40.804 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-12T10:56:40.804 INFO:teuthology.orchestra.run.smithi086.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-12T10:56:40.804 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-12T10:56:40.804 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-12T10:56:40.805 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-12T10:56:40.805 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:56:40.805 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-05-12T10:56:41.194 DEBUG:teuthology.parallel:result is None 2024-05-12T10:56:41.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:56:41.342 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-12T10:56:41.364 INFO:teuthology.orchestra.run.smithi086.stdout:19.0.0-3517.gf1ec8823.el9 2024-05-12T10:56:41.364 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3517.gf1ec8823.el9 2024-05-12T10:56:41.365 INFO:teuthology.task.install:The correct ceph version 19.0.0-3517.gf1ec8823 is installed. 2024-05-12T10:56:41.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:56:41.510 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-12T10:56:41.535 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-3517.gf1ec8823.el9 2024-05-12T10:56:41.535 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3517.gf1ec8823.el9 2024-05-12T10:56:41.535 INFO:teuthology.task.install:The correct ceph version 19.0.0-3517.gf1ec8823 is installed. 2024-05-12T10:56:41.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:56:41.754 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-12T10:56:41.781 INFO:teuthology.orchestra.run.smithi176.stdout:19.0.0-3517.gf1ec8823.el9 2024-05-12T10:56:41.781 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3517.gf1ec8823.el9 2024-05-12T10:56:41.781 INFO:teuthology.task.install:The correct ceph version 19.0.0-3517.gf1ec8823 is installed. 2024-05-12T10:56:41.783 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-12T10:56:41.783 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:56:41.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-12T10:56:41.811 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:56:41.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-12T10:56:41.842 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:56:41.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-12T10:56:41.872 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-12T10:56:41.872 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:56:41.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-05-12T10:56:41.899 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-12T10:56:41.964 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:56:41.964 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-05-12T10:56:41.993 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-12T10:56:42.061 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:56:42.062 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-05-12T10:56:42.089 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-12T10:56:42.156 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-12T10:56:42.156 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:56:42.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-12T10:56:42.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-12T10:56:42.246 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:56:42.247 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-12T10:56:42.274 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-12T10:56:42.343 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:56:42.343 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-12T10:56:42.371 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-12T10:56:42.440 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-12T10:56:42.440 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:56:42.440 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-05-12T10:56:42.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-12T10:56:42.531 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:56:42.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-05-12T10:56:42.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-12T10:56:42.626 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:56:42.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-05-12T10:56:42.654 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-12T10:56:42.721 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-12T10:56:42.818 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-05-12T10:56:42.818 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:56:42.818 INFO:tasks.cephadm:Cluster fsid is 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:56:42.819 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-12T10:56:42.819 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.86', 'mon.b': '172.21.15.172', 'mon.c': '172.21.15.176'} 2024-05-12T10:56:42.819 INFO:tasks.cephadm:First mon is mon.a on smithi086 2024-05-12T10:56:42.819 INFO:tasks.cephadm:First mgr is x 2024-05-12T10:56:42.819 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-12T10:56:42.819 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname $(hostname -s) 2024-05-12T10:56:42.845 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-05-12T10:56:42.874 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname $(hostname -s) 2024-05-12T10:56:42.902 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-12T10:56:42.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:56:43.056 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f1ec882358465db8f363a3865fa83f099183688a', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79301/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3517-gf1ec8823', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3517.gf1ec8823'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-12 07:27:12.903653', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-quiesce-lock-auth', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-05-12T10:56:43.197 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-lusov-quiesce-lock-auth, sha1 f1ec882358465db8f363a3865fa83f099183688a from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:56:43.198 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/x86_64/flavors/default/cephadm 2024-05-12T10:56:43.198 DEBUG:teuthology.orchestra.run.smithi086:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:43.647 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r--. 1 ubuntu ubuntu 782843 May 12 10:56 /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:43.647 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:44.262 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 782843 May 12 10:56 /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:44.263 DEBUG:teuthology.orchestra.run.smithi176:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-lusov-quiesce-lock-auth/f1ec882358465db8f363a3865fa83f099183688a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:44.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r--. 1 ubuntu ubuntu 782843 May 12 10:56 /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:44.716 DEBUG:teuthology.orchestra.run.smithi086:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:44.736 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:44.752 DEBUG:teuthology.orchestra.run.smithi176:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-12T10:56:44.786 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a on all hosts... 2024-05-12T10:56:44.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a pull 2024-05-12T10:56:44.789 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a pull 2024-05-12T10:56:44.794 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a pull 2024-05-12T10:56:46.381 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a... 2024-05-12T10:56:46.467 INFO:teuthology.orchestra.run.smithi176.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a... 2024-05-12T10:56:46.490 INFO:teuthology.orchestra.run.smithi086.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a... 2024-05-12T10:57:27.158 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T10:57:27.158 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 19.0.0-3517-gf1ec8823 (f1ec882358465db8f363a3865fa83f099183688a) squid (dev)", 2024-05-12T10:57:27.159 INFO:teuthology.orchestra.run.smithi086.stdout: "image_id": "6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413", 2024-05-12T10:57:27.159 INFO:teuthology.orchestra.run.smithi086.stdout: "repo_digests": [ 2024-05-12T10:57:27.159 INFO:teuthology.orchestra.run.smithi086.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4" 2024-05-12T10:57:27.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T10:57:27.159 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T10:57:28.265 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-05-12T10:57:28.265 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_version": "ceph version 19.0.0-3517-gf1ec8823 (f1ec882358465db8f363a3865fa83f099183688a) squid (dev)", 2024-05-12T10:57:28.265 INFO:teuthology.orchestra.run.smithi176.stdout: "image_id": "6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413", 2024-05-12T10:57:28.265 INFO:teuthology.orchestra.run.smithi176.stdout: "repo_digests": [ 2024-05-12T10:57:28.265 INFO:teuthology.orchestra.run.smithi176.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4" 2024-05-12T10:57:28.265 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-05-12T10:57:28.265 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-05-12T10:57:28.931 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-12T10:57:28.931 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.0.0-3517-gf1ec8823 (f1ec882358465db8f363a3865fa83f099183688a) squid (dev)", 2024-05-12T10:57:28.931 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413", 2024-05-12T10:57:28.931 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-05-12T10:57:28.931 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4" 2024-05-12T10:57:28.931 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-05-12T10:57:28.931 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-12T10:57:28.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph 2024-05-12T10:57:28.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-05-12T10:57:29.013 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph 2024-05-12T10:57:29.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /etc/ceph 2024-05-12T10:57:29.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-05-12T10:57:29.090 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /etc/ceph 2024-05-12T10:57:29.114 INFO:tasks.cephadm:Writing seed config... 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-12T10:57:29.115 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-12T10:57:29.116 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-12T10:57:29.117 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-12T10:57:29.118 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-12T10:57:29.118 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-12T10:57:29.118 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-12T10:57:29.118 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-12T10:57:29.118 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-12T10:57:29.118 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-12T10:57:29.118 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-12T10:57:29.119 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:57:29.119 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-12T10:57:29.136 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 513c80a2-104e-11ef-bc98-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-12T10:57:29.136 DEBUG:teuthology.orchestra.run.smithi086:mon.a> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.a.service 2024-05-12T10:57:29.178 DEBUG:teuthology.orchestra.run.smithi086:mgr.x> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.x.service 2024-05-12T10:57:29.221 INFO:tasks.cephadm:Bootstrapping... 2024-05-12T10:57:29.222 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a -v bootstrap --fsid 513c80a2-104e-11ef-bc98-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.86 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-12T10:57:29.418 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-05-12T10:57:29.418 INFO:teuthology.orchestra.run.smithi086.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a', '-v', 'bootstrap', '--fsid', '513c80a2-104e-11ef-bc98-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.86', '--skip-admin-label'] 2024-05-12T10:57:29.419 INFO:teuthology.orchestra.run.smithi086.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-12T10:57:29.419 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying podman|docker is present... 2024-05-12T10:57:29.446 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-12T10:57:29.446 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying lvm2 is present... 2024-05-12T10:57:29.446 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying time synchronization is in place... 2024-05-12T10:57:29.454 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-12T10:57:29.454 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-12T10:57:29.461 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-12T10:57:29.461 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-05-12T10:57:29.468 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout enabled 2024-05-12T10:57:29.475 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout active 2024-05-12T10:57:29.475 INFO:teuthology.orchestra.run.smithi086.stdout:Unit chronyd.service is enabled and running 2024-05-12T10:57:29.476 INFO:teuthology.orchestra.run.smithi086.stdout:Repeating the final host check... 2024-05-12T10:57:29.502 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-12T10:57:29.502 INFO:teuthology.orchestra.run.smithi086.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-12T10:57:29.503 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl is present 2024-05-12T10:57:29.503 INFO:teuthology.orchestra.run.smithi086.stdout:lvcreate is present 2024-05-12T10:57:29.509 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-12T10:57:29.509 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-12T10:57:29.516 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-12T10:57:29.516 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-05-12T10:57:29.523 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout enabled 2024-05-12T10:57:29.531 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout active 2024-05-12T10:57:29.532 INFO:teuthology.orchestra.run.smithi086.stdout:Unit chronyd.service is enabled and running 2024-05-12T10:57:29.532 INFO:teuthology.orchestra.run.smithi086.stdout:Host looks OK 2024-05-12T10:57:29.532 INFO:teuthology.orchestra.run.smithi086.stdout:Cluster fsid: 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:29.532 INFO:teuthology.orchestra.run.smithi086.stdout:Acquiring lock 139646295572192 on /run/cephadm/513c80a2-104e-11ef-bc98-c7b262605968.lock 2024-05-12T10:57:29.532 INFO:teuthology.orchestra.run.smithi086.stdout:Lock 139646295572192 acquired on /run/cephadm/513c80a2-104e-11ef-bc98-c7b262605968.lock 2024-05-12T10:57:29.533 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying IP 172.21.15.86 port 3300 ... 2024-05-12T10:57:29.533 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying IP 172.21.15.86 port 6789 ... 2024-05-12T10:57:29.533 INFO:teuthology.orchestra.run.smithi086.stdout:Base mon IP(s) is [172.21.15.86:3300, 172.21.15.86:6789], mon addrv is [v2:172.21.15.86:3300,v1:172.21.15.86:6789] 2024-05-12T10:57:29.535 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.86 metric 100 2024-05-12T10:57:29.535 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.86 metric 100 2024-05-12T10:57:29.538 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-12T10:57:29.538 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-12T10:57:29.538 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2024-05-12T10:57:29.541 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-12T10:57:29.542 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-12T10:57:29.542 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-12T10:57:29.542 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-12T10:57:29.542 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2024-05-12T10:57:29.542 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-12T10:57:29.542 INFO:teuthology.orchestra.run.smithi086.stdout:Mon IP `172.21.15.86` is in CIDR network `172.21.0.0/20` 2024-05-12T10:57:29.543 INFO:teuthology.orchestra.run.smithi086.stdout:Mon IP `172.21.15.86` is in CIDR network `172.21.0.0/20` 2024-05-12T10:57:29.543 INFO:teuthology.orchestra.run.smithi086.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-12T10:57:29.543 INFO:teuthology.orchestra.run.smithi086.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-12T10:57:29.544 INFO:teuthology.orchestra.run.smithi086.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a... 2024-05-12T10:57:33.132 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stdout 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 2024-05-12T10:57:33.132 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a... 2024-05-12T10:57:33.132 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Getting image source signatures 2024-05-12T10:57:33.132 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Copying blob sha256:2f00f4668c768f2d2a7cc3362ef1db499c5f80b89672121a1cc4a727fdc39ca0 2024-05-12T10:57:33.132 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-12T10:57:33.132 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Copying config sha256:6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 2024-05-12T10:57:33.132 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-12T10:57:41.992 INFO:teuthology.orchestra.run.smithi086.stdout:ceph: stdout ceph version 19.0.0-3517-gf1ec8823 (f1ec882358465db8f363a3865fa83f099183688a) squid (dev) 2024-05-12T10:57:41.993 INFO:teuthology.orchestra.run.smithi086.stdout:Ceph version: ceph version 19.0.0-3517-gf1ec8823 (f1ec882358465db8f363a3865fa83f099183688a) squid (dev) 2024-05-12T10:57:41.993 INFO:teuthology.orchestra.run.smithi086.stdout:Extracting ceph user uid/gid from container image... 2024-05-12T10:57:42.914 INFO:teuthology.orchestra.run.smithi086.stdout:stat: stdout 167 167 2024-05-12T10:57:42.915 INFO:teuthology.orchestra.run.smithi086.stdout:Creating initial keys... 2024-05-12T10:57:43.919 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph-authtool: stdout AQCnoEBmcKGoDhAAiSEn0nHclhSx9MTsND7Lrw== 2024-05-12T10:57:44.749 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph-authtool: stdout AQCooEBmCZutDBAAIuTsEnM5+MFVsYEDFEen+w== 2024-05-12T10:57:45.754 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph-authtool: stdout AQCpoEBm1NiYBhAAarP4xFXjbKBUwDGwerbJtw== 2024-05-12T10:57:45.755 INFO:teuthology.orchestra.run.smithi086.stdout:Creating initial monmap... 2024-05-12T10:57:46.619 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-12T10:57:46.619 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-12T10:57:46.619 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:46.619 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-12T10:57:46.619 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool for a [v2:172.21.15.86:3300,v1:172.21.15.86:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-12T10:57:46.619 INFO:teuthology.orchestra.run.smithi086.stdout:setting min_mon_release = quincy 2024-05-12T10:57:46.620 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: set fsid to 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:46.620 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-12T10:57:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:57:46.620 INFO:teuthology.orchestra.run.smithi086.stdout:Creating mon... 2024-05-12T10:57:47.567 INFO:teuthology.orchestra.run.smithi086.stdout:create mon.a on 2024-05-12T10:57:48.034 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-12T10:57:48.235 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-12T10:57:48.416 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-513c80a2-104e-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-513c80a2-104e-11ef-bc98-c7b262605968.target. 2024-05-12T10:57:48.416 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-513c80a2-104e-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-513c80a2-104e-11ef-bc98-c7b262605968.target. 2024-05-12T10:57:48.646 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.a 2024-05-12T10:57:48.646 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Failed to reset failed state of unit ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.a.service: Unit ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.a.service not loaded. 2024-05-12T10:57:48.815 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-513c80a2-104e-11ef-bc98-c7b262605968.target.wants/ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.a.service → /etc/systemd/system/ceph-513c80a2-104e-11ef-bc98-c7b262605968@.service. 2024-05-12T10:57:49.303 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:49 smithi086 ceph-mon[29741]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-12T10:57:49.319 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-12T10:57:49.319 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout disabled 2024-05-12T10:57:49.326 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-12T10:57:49.326 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-05-12T10:57:49.326 INFO:teuthology.orchestra.run.smithi086.stdout:firewalld.service is not enabled 2024-05-12T10:57:49.326 INFO:teuthology.orchestra.run.smithi086.stdout:Not possible to enable service . firewalld.service is not available 2024-05-12T10:57:49.327 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mon to start... 2024-05-12T10:57:49.327 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mon... 2024-05-12T10:57:49.570 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:49 smithi086 bash[29723]: 5e59600a956b7e4a551fb712ca8dff1346650e3990bac37ab4d1ee1044c40870 2024-05-12T10:57:49.570 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:49 smithi086 systemd[1]: Started Ceph mon.a for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T10:57:50.430 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout cluster: 2024-05-12T10:57:50.430 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout id: 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:50.430 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-12T10:57:50.430 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout services: 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.558204s) 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout data: 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout pgs: 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.763+0000 7faed36b9700 1 Processor -- start 2024-05-12T10:57:50.431 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.763+0000 7faed36b9700 1 -- start start 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.763+0000 7faed36b9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc109250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.763+0000 7faed36b9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faecc109790 con 0x7faecc108e30 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.764+0000 7faed1455700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.764+0000 7faed1455700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36978/0 (socket says 172.21.15.86:36978) 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.764+0000 7faed1455700 1 -- 172.21.15.86:0/888802324 learned_addr learned my addr 172.21.15.86:0/888802324 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.764+0000 7faed1455700 1 -- 172.21.15.86:0/888802324 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc109f90 con 0x7faecc108e30 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.764+0000 7faed1455700 1 --2- 172.21.15.86:0/888802324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc109250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faebc0098a0 tx=0x7faebc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce98c614658923d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.764+0000 7faec3fff700 1 -- 172.21.15.86:0/888802324 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faebc004160 con 0x7faecc108e30 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.764+0000 7faec3fff700 1 -- 172.21.15.86:0/888802324 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc004300 con 0x7faecc108e30 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.764+0000 7faec3fff700 1 -- 172.21.15.86:0/888802324 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faebc0036a0 con 0x7faecc108e30 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.765+0000 7faed36b9700 1 -- 172.21.15.86:0/888802324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 msgr2=0x7faecc109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.765+0000 7faed36b9700 1 --2- 172.21.15.86:0/888802324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc109250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faebc0098a0 tx=0x7faebc009bb0 comp rx=0 tx=0).stop 2024-05-12T10:57:50.432 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.765+0000 7faed36b9700 1 -- 172.21.15.86:0/888802324 shutdown_connections 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.765+0000 7faed36b9700 1 --2- 172.21.15.86:0/888802324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc109250 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.765+0000 7faed36b9700 1 -- 172.21.15.86:0/888802324 >> 172.21.15.86:0/888802324 conn(0x7faecc104410 msgr2=0x7faecc106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.765+0000 7faed36b9700 1 -- 172.21.15.86:0/888802324 shutdown_connections 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.765+0000 7faed36b9700 1 -- 172.21.15.86:0/888802324 wait complete. 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed36b9700 1 Processor -- start 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed36b9700 1 -- start start 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed36b9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc07f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed36b9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10a460 con 0x7faecc108e30 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed1455700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc07f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed1455700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc07f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36994/0 (socket says 172.21.15.86:36994) 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed1455700 1 -- 172.21.15.86:0/4268983329 learned_addr learned my addr 172.21.15.86:0/4268983329 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:50.433 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed1455700 1 -- 172.21.15.86:0/4268983329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc07db10 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.766+0000 7faed1455700 1 --2- 172.21.15.86:0/4268983329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc07f5c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faebc000c00 tx=0x7faebc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.767+0000 7faec27fc700 1 -- 172.21.15.86:0/4268983329 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faebc003db0 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.767+0000 7faec27fc700 1 -- 172.21.15.86:0/4268983329 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc011630 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.767+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc07dda0 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.767+0000 7faec27fc700 1 -- 172.21.15.86:0/4268983329 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faebc011950 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.767+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc07e280 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.767+0000 7faec27fc700 1 -- 172.21.15.86:0/4268983329 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faebc011af0 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.767+0000 7faec27fc700 1 -- 172.21.15.86:0/4268983329 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faebc01c450 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.768+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc064b00 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.770+0000 7faec27fc700 1 -- 172.21.15.86:0/4268983329 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7faebc032020 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.840+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7faecc02e540 con 0x7faecc108e30 2024-05-12T10:57:50.434 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.841+0000 7faec27fc700 1 -- 172.21.15.86:0/4268983329 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7faebc004260 con 0x7faecc108e30 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.841+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 msgr2=0x7faecc07f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.841+0000 7faed36b9700 1 --2- 172.21.15.86:0/4268983329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc07f5c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faebc000c00 tx=0x7faebc004750 comp rx=0 tx=0).stop 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.841+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 shutdown_connections 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.841+0000 7faed36b9700 1 --2- 172.21.15.86:0/4268983329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faecc108e30 0x7faecc07f5c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.841+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 >> 172.21.15.86:0/4268983329 conn(0x7faecc104410 msgr2=0x7faecc192fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.841+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 shutdown_connections 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:49.841+0000 7faed36b9700 1 -- 172.21.15.86:0/4268983329 wait complete. 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:mon is available 2024-05-12T10:57:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:Assimilating anything we can from ceph.conf... 2024-05-12T10:57:50.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-12T10:57:50.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: monmap epoch 1 2024-05-12T10:57:50.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:50.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: last_changed 2024-05-12T10:57:46.072176+0000 2024-05-12T10:57:50.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: created 2024-05-12T10:57:46.072176+0000 2024-05-12T10:57:50.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: min_mon_release 19 (squid) 2024-05-12T10:57:50.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: election_strategy: 1 2024-05-12T10:57:50.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: 0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-05-12T10:57:50.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: fsmap 2024-05-12T10:57:50.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: osdmap e1: 0 total, 0 up, 0 in 2024-05-12T10:57:50.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: mgrmap e1: no daemons active 2024-05-12T10:57:50.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:50 smithi086 ceph-mon[29741]: from='client.? 172.21.15.86:0/4268983329' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-12T10:57:51.551 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:51 smithi086 ceph-mon[29741]: from='client.? 172.21.15.86:0/980578296' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-12T10:57:51.551 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:51 smithi086 ceph-mon[29741]: from='client.? 172.21.15.86:0/980578296' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-12T10:57:51.560 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [global] 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout fsid = 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.86:3300,v1:172.21.15.86:6789] 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-12T10:57:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [osd] 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.904+0000 7f4c0b8fc700 1 Processor -- start 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.905+0000 7f4c0b8fc700 1 -- start start 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.905+0000 7f4c0b8fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c04109250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.905+0000 7f4c0b8fc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04109790 con 0x7f4c04108e30 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.905+0000 7f4c09698700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c04109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:51.562 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.905+0000 7f4c09698700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c04109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37008/0 (socket says 172.21.15.86:37008) 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.905+0000 7f4c09698700 1 -- 172.21.15.86:0/3353343904 learned_addr learned my addr 172.21.15.86:0/3353343904 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.905+0000 7f4c09698700 1 -- 172.21.15.86:0/3353343904 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c04109f90 con 0x7f4c04108e30 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.905+0000 7f4c09698700 1 --2- 172.21.15.86:0/3353343904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c04109250 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40098a0 tx=0x7f4bf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e594f625972b788 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4bfbfff700 1 -- 172.21.15.86:0/3353343904 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf4004160 con 0x7f4c04108e30 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4bfbfff700 1 -- 172.21.15.86:0/3353343904 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf4004300 con 0x7f4c04108e30 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4bfbfff700 1 -- 172.21.15.86:0/3353343904 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf40036a0 con 0x7f4c04108e30 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/3353343904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 msgr2=0x7f4c04109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4c0b8fc700 1 --2- 172.21.15.86:0/3353343904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c04109250 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40098a0 tx=0x7f4bf4009bb0 comp rx=0 tx=0).stop 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/3353343904 shutdown_connections 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4c0b8fc700 1 --2- 172.21.15.86:0/3353343904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c04109250 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/3353343904 >> 172.21.15.86:0/3353343904 conn(0x7f4c04104410 msgr2=0x7f4c04106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:51.563 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/3353343904 shutdown_connections 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.906+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/3353343904 wait complete. 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.907+0000 7f4c0b8fc700 1 Processor -- start 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.907+0000 7f4c0b8fc700 1 -- start start 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.907+0000 7f4c0b8fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c0419e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.907+0000 7f4c0b8fc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0410a460 con 0x7f4c04108e30 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.907+0000 7f4c09698700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c0419e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.907+0000 7f4c09698700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c0419e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37022/0 (socket says 172.21.15.86:37022) 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.907+0000 7f4c09698700 1 -- 172.21.15.86:0/980578296 learned_addr learned my addr 172.21.15.86:0/980578296 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.907+0000 7f4c09698700 1 -- 172.21.15.86:0/980578296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0419ecc0 con 0x7f4c04108e30 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.908+0000 7f4c09698700 1 --2- 172.21.15.86:0/980578296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c0419e780 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4000c00 tx=0x7f4bf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.908+0000 7f4bfa7fc700 1 -- 172.21.15.86:0/980578296 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf4003db0 con 0x7f4c04108e30 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.908+0000 7f4bfa7fc700 1 -- 172.21.15.86:0/980578296 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf4011630 con 0x7f4c04108e30 2024-05-12T10:57:51.564 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.908+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0419ef50 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.908+0000 7f4bfa7fc700 1 -- 172.21.15.86:0/980578296 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf4011950 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.908+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0419fa70 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.908+0000 7f4bfa7fc700 1 -- 172.21.15.86:0/980578296 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4bf4011af0 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.908+0000 7f4bfa7fc700 1 -- 172.21.15.86:0/980578296 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4bf401c450 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.909+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c04064b00 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.911+0000 7f4bfa7fc700 1 -- 172.21.15.86:0/980578296 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4bf4004260 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.978+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f4c0419fe30 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.981+0000 7f4bfa7fc700 1 -- 172.21.15.86:0/980578296 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f4bf401b450 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.982+0000 7f4bfa7fc700 1 -- 172.21.15.86:0/980578296 <== mon.0 v2:172.21.15.86:3300/0 8 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4bf401b630 con 0x7f4c04108e30 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.983+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 msgr2=0x7f4c0419e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.983+0000 7f4c0b8fc700 1 --2- 172.21.15.86:0/980578296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c0419e780 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4000c00 tx=0x7f4bf4004750 comp rx=0 tx=0).stop 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.983+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 shutdown_connections 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.983+0000 7f4c0b8fc700 1 --2- 172.21.15.86:0/980578296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c04108e30 0x7f4c0419e780 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:51.565 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.983+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 >> 172.21.15.86:0/980578296 conn(0x7f4c04104410 msgr2=0x7f4c0407e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:51.566 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.983+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 shutdown_connections 2024-05-12T10:57:51.566 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:50.983+0000 7f4c0b8fc700 1 -- 172.21.15.86:0/980578296 wait complete. 2024-05-12T10:57:51.566 INFO:teuthology.orchestra.run.smithi086.stdout:Generating new minimal ceph.conf... 2024-05-12T10:57:52.573 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:52 smithi086 ceph-mon[29741]: from='client.? 172.21.15.86:0/364332871' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:57:52.581 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.951+0000 7ff848417700 1 Processor -- start 2024-05-12T10:57:52.581 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.951+0000 7ff848417700 1 -- start start 2024-05-12T10:57:52.581 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.952+0000 7ff848417700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff840109250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:52.581 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.952+0000 7ff848417700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff840109790 con 0x7ff840108e30 2024-05-12T10:57:52.581 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.952+0000 7ff8461b3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff840109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:52.581 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.952+0000 7ff8461b3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff840109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33546/0 (socket says 172.21.15.86:33546) 2024-05-12T10:57:52.581 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.952+0000 7ff8461b3700 1 -- 172.21.15.86:0/2392924132 learned_addr learned my addr 172.21.15.86:0/2392924132 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.952+0000 7ff8461b3700 1 -- 172.21.15.86:0/2392924132 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff840109f90 con 0x7ff840108e30 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.952+0000 7ff8461b3700 1 --2- 172.21.15.86:0/2392924132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff840109250 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff830009e80 tx=0x7ff83000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8779bbfef4662b38 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff8451b1700 1 -- 172.21.15.86:0/2392924132 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff830017070 con 0x7ff840108e30 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff8451b1700 1 -- 172.21.15.86:0/2392924132 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff83000b8c0 con 0x7ff840108e30 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff8451b1700 1 -- 172.21.15.86:0/2392924132 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff830004490 con 0x7ff840108e30 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff848417700 1 -- 172.21.15.86:0/2392924132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 msgr2=0x7ff840109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff848417700 1 --2- 172.21.15.86:0/2392924132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff840109250 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff830009e80 tx=0x7ff83000b330 comp rx=0 tx=0).stop 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff848417700 1 -- 172.21.15.86:0/2392924132 shutdown_connections 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff848417700 1 --2- 172.21.15.86:0/2392924132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff840109250 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff848417700 1 -- 172.21.15.86:0/2392924132 >> 172.21.15.86:0/2392924132 conn(0x7ff840104410 msgr2=0x7ff840106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff848417700 1 -- 172.21.15.86:0/2392924132 shutdown_connections 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.953+0000 7ff848417700 1 -- 172.21.15.86:0/2392924132 wait complete. 2024-05-12T10:57:52.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff848417700 1 Processor -- start 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff848417700 1 -- start start 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff848417700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff84019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff848417700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff84010d3d0 con 0x7ff840108e30 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff8461b3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff84019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff8461b3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff84019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33552/0 (socket says 172.21.15.86:33552) 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff8461b3700 1 -- 172.21.15.86:0/364332871 learned_addr learned my addr 172.21.15.86:0/364332871 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff8461b3700 1 -- 172.21.15.86:0/364332871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84019d2f0 con 0x7ff840108e30 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.954+0000 7ff8461b3700 1 --2- 172.21.15.86:0/364332871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff84019cdb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff83000b7b0 tx=0x7ff83000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.955+0000 7ff83f7fe700 1 -- 172.21.15.86:0/364332871 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff830020020 con 0x7ff840108e30 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.955+0000 7ff83f7fe700 1 -- 172.21.15.86:0/364332871 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff830003d10 con 0x7ff840108e30 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.955+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84019d580 con 0x7ff840108e30 2024-05-12T10:57:52.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.955+0000 7ff83f7fe700 1 -- 172.21.15.86:0/364332871 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff830017040 con 0x7ff840108e30 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.955+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84019e1b0 con 0x7ff840108e30 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.955+0000 7ff83f7fe700 1 -- 172.21.15.86:0/364332871 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff830023020 con 0x7ff840108e30 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.955+0000 7ff83f7fe700 1 -- 172.21.15.86:0/364332871 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff83000f050 con 0x7ff840108e30 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.956+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff840064b00 con 0x7ff840108e30 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:51.958+0000 7ff83f7fe700 1 -- 172.21.15.86:0/364332871 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff83002a020 con 0x7ff840108e30 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.025+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff84019e480 con 0x7ff840108e30 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.025+0000 7ff83f7fe700 1 -- 172.21.15.86:0/364332871 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7ff830003ec0 con 0x7ff840108e30 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.026+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 msgr2=0x7ff84019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.026+0000 7ff848417700 1 --2- 172.21.15.86:0/364332871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff84019cdb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff83000b7b0 tx=0x7ff83000be90 comp rx=0 tx=0).stop 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.026+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 shutdown_connections 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.026+0000 7ff848417700 1 --2- 172.21.15.86:0/364332871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff840108e30 0x7ff84019cdb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.026+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 >> 172.21.15.86:0/364332871 conn(0x7ff840104410 msgr2=0x7ff840104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.026+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 shutdown_connections 2024-05-12T10:57:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:52.026+0000 7ff848417700 1 -- 172.21.15.86:0/364332871 wait complete. 2024-05-12T10:57:52.585 INFO:teuthology.orchestra.run.smithi086.stdout:Restarting the monitor... 2024-05-12T10:57:52.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:52 smithi086 systemd[1]: Stopping Ceph mon.a for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T10:57:53.444 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:53 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a[29737]: 2024-05-12T10:57:53.036+0000 7f06960f3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T10:57:53.444 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:53 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a[29737]: 2024-05-12T10:57:53.036+0000 7f06960f3700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-12T10:57:53.444 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:53 smithi086 podman[29986]: 2024-05-12 10:57:53.230876281 +0000 UTC m=+0.475144410 container died 5e59600a956b7e4a551fb712ca8dff1346650e3990bac37ab4d1ee1044c40870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-12T10:57:53.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:53 smithi086 podman[29986]: 2024-05-12 10:57:53.543312733 +0000 UTC m=+0.787580870 container cleanup 5e59600a956b7e4a551fb712ca8dff1346650e3990bac37ab4d1ee1044c40870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T10:57:53.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:53 smithi086 bash[29986]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a 2024-05-12T10:57:54.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:53 smithi086 podman[30000]: 2024-05-12 10:57:53.919503669 +0000 UTC m=+0.684237651 container remove 5e59600a956b7e4a551fb712ca8dff1346650e3990bac37ab4d1ee1044c40870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-12T10:57:54.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 systemd[1]: ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-12T10:57:54.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 systemd[1]: Stopped Ceph mon.a for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T10:57:54.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 systemd[1]: Starting Ceph mon.a for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T10:57:54.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 podman[30092]: 2024-05-12 10:57:54.24351241 +0000 UTC m=+0.018595180 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:57:54.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 podman[30092]: 2024-05-12 10:57:54.353922582 +0000 UTC m=+0.129005383 container create 272d40c7cd9355ebae8cf1356cc9604daf3745117e39953916f8c7231265c96a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T10:57:54.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 podman[30092]: 2024-05-12 10:57:54.564689107 +0000 UTC m=+0.339771875 container init 272d40c7cd9355ebae8cf1356cc9604daf3745117e39953916f8c7231265c96a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-12T10:57:54.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 podman[30092]: 2024-05-12 10:57:54.568023929 +0000 UTC m=+0.343106684 container start 272d40c7cd9355ebae8cf1356cc9604daf3745117e39953916f8c7231265c96a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-12T10:57:54.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: set uid:gid to 167:167 (ceph:ceph) 2024-05-12T10:57:54.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: ceph version 19.0.0-3517-gf1ec8823 (f1ec882358465db8f363a3865fa83f099183688a) squid (dev), process ceph-mon, pid 2 2024-05-12T10:57:54.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: pidfile_write: ignore empty --pid-file 2024-05-12T10:57:54.660 INFO:teuthology.orchestra.run.smithi086.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-12T10:57:54.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: load: jerasure load: lrc 2024-05-12T10:57:54.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: RocksDB version: 7.9.2 2024-05-12T10:57:54.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Git sha 0 2024-05-12T10:57:54.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Compile date 2024-05-12 01:22:03 2024-05-12T10:57:54.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: DB SUMMARY 2024-05-12T10:57:54.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: DB Session ID: SPEXY9O5BQR73EZMFOLV 2024-05-12T10:57:54.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: CURRENT file: CURRENT 2024-05-12T10:57:54.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: IDENTITY file: IDENTITY 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105114 ; 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.error_if_exists: 0 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.create_if_missing: 0 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.paranoid_checks: 1 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.env: 0x55fb07f53cc0 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.fs: PosixFileSystem 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.info_log: 0x55fb09c1dda0 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_file_opening_threads: 16 2024-05-12T10:57:54.885 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.statistics: (nil) 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.use_fsync: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_log_file_size: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.keep_log_file_num: 1000 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.recycle_log_file_num: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.allow_fallocate: 1 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.allow_mmap_reads: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.allow_mmap_writes: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.use_direct_reads: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.create_missing_column_families: 0 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.db_log_dir: 2024-05-12T10:57:54.886 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.wal_dir: 2024-05-12T10:57:54.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-12T10:57:54.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-12T10:57:54.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-12T10:57:54.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-12T10:57:54.888 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-12T10:57:54.888 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-12T10:57:54.888 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.advise_random_on_open: 1 2024-05-12T10:57:54.888 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.db_write_buffer_size: 0 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.write_buffer_manager: 0x55fb09bef0e0 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.rate_limiter: (nil) 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.wal_recovery_mode: 2 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.enable_thread_tracking: 0 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.enable_pipelined_write: 0 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.unordered_write: 0 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-12T10:57:54.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.row_cache: None 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.wal_filter: None 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.allow_ingest_behind: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.two_write_queues: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.manual_wal_flush: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.wal_compression: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.atomic_flush: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.log_readahead_size: 0 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-12T10:57:54.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.best_efforts_recovery: 0 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.allow_data_in_errors: 0 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.db_host_id: __hostname__ 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_background_jobs: 2 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_background_compactions: -1 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_subcompactions: 1 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_total_wal_size: 0 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-12T10:57:54.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_open_files: -1 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bytes_per_sync: 0 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_readahead_size: 0 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_background_flushes: -1 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Compression algorithms supported: 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: kZSTD supported: 0 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: kXpressCompression supported: 0 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: kLZ4HCCompression supported: 1 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: kZlibCompression supported: 1 2024-05-12T10:57:54.892 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: kSnappyCompression supported: 1 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: kLZ4Compression supported: 1 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: kBZip2Compression supported: 0 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.merge_operator: 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_filter: None 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_filter_factory: None 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.sst_partitioner_factory: None 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fb09c1df60) 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout: cache_index_and_filter_blocks: 1 2024-05-12T10:57:54.893 INFO:journalctl@ceph.mon.a.smithi086.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: pin_top_level_index_and_filter: 1 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: index_type: 0 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: data_block_index_type: 0 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: index_shortening: 1 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: checksum: 4 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: no_block_cache: 0 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_cache: 0x55fb09c211f0 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_cache_name: BinnedLRUCache 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_cache_options: 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: capacity : 536870912 2024-05-12T10:57:54.894 INFO:journalctl@ceph.mon.a.smithi086.stdout: num_shard_bits : 4 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: strict_capacity_limit : 0 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: high_pri_pool_ratio: 0.000 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_cache_compressed: (nil) 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: persistent_cache: (nil) 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_size: 4096 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_size_deviation: 10 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_restart_interval: 16 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: index_block_restart_interval: 1 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: metadata_block_size: 4096 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: partition_filters: 0 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: use_delta_encoding: 1 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: filter_policy: bloomfilter 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: whole_key_filtering: 1 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: verify_compression: 0 2024-05-12T10:57:54.895 INFO:journalctl@ceph.mon.a.smithi086.stdout: read_amp_bytes_per_bit: 0 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout: format_version: 5 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout: enable_index_compression: 1 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_align: 0 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout: max_auto_readahead_size: 262144 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout: prepopulate_block_cache: 0 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout: initial_auto_readahead_size: 8192 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout: num_file_reads_for_auto_readahead: 2 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.write_buffer_size: 33554432 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_write_buffer_number: 2 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression: NoCompression 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression: Disabled 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.prefix_extractor: nullptr 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.num_levels: 7 2024-05-12T10:57:54.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.level: 32767 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.strategy: 0 2024-05-12T10:57:54.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.enabled: false 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.target_file_size_base: 67108864 2024-05-12T10:57:54.898 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.arena_block_size: 1048576 2024-05-12T10:57:54.899 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.disable_auto_compactions: 0 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.inplace_update_support: 0 2024-05-12T10:57:54.900 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.bloom_locality: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.max_successive_merges: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.paranoid_file_checks: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.force_consistency_checks: 1 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.report_bg_io_stats: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.ttl: 2592000 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-12T10:57:54.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.enable_blob_files: false 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.min_blob_size: 0 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.blob_file_size: 268435456 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.blob_file_starting_level: 0 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9c04829c-58fe-4ec4-9dbb-895f757641b1 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715511474597093, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-12T10:57:54.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715511474598121, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100281, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 98166, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14169, "raw_average_key_size": 49, "raw_value_size": 90450, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715511474, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9c04829c-58fe-4ec4-9dbb-895f757641b1", "db_session_id": "SPEXY9O5BQR73EZMFOLV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715511474598200, "job": 1, "event": "recovery_finished"} 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fb09d3e000 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: DB pointer 0x55fb09d2a000 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout: ** DB Stats ** 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-12T10:57:54.903 INFO:journalctl@ceph.mon.a.smithi086.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: ** Compaction Stats [default] ** 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: L0 2/0 99.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: Sum 2/0 99.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: ** Compaction Stats [default] ** 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-12T10:57:54.904 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: Cumulative compaction: 0.00 GB write, 31.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: Interval compaction: 0.00 GB write, 31.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: Block cache BinnedLRUCache@0x55fb09c211f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-12T10:57:54.905 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: starting mon.a rank 0 at public addrs [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] at bind addrs [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a@-1(???) e1 preinit fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a@-1(???).mds e1 new map 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a@-1(???).mds e1 print_map 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout: e1 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout: legacy client fscid: -1 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout: No filesystems configured 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:57:54.906 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: monmap epoch 1 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: last_changed 2024-05-12T10:57:46.072176+0000 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: created 2024-05-12T10:57:46.072176+0000 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: min_mon_release 19 (squid) 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: election_strategy: 1 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: 0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: fsmap 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: osdmap e1: 0 total, 0 up, 0 in 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 ceph-mon[30110]: mgrmap e1: no daemons active 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 bash[30092]: 272d40c7cd9355ebae8cf1356cc9604daf3745117e39953916f8c7231265c96a 2024-05-12T10:57:54.907 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:54 smithi086 systemd[1]: Started Ceph mon.a for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T10:57:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.095+0000 7f5101a28700 1 Processor -- start 2024-05-12T10:57:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.095+0000 7f5101a28700 1 -- start start 2024-05-12T10:57:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.095+0000 7f5101a28700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc07db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.095+0000 7f5101a28700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc07e0b0 con 0x7f50fc07f670 2024-05-12T10:57:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.096+0000 7f50faffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc07db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.096+0000 7f50faffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc07db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33554/0 (socket says 172.21.15.86:33554) 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.096+0000 7f50faffd700 1 -- 172.21.15.86:0/58591835 learned_addr learned my addr 172.21.15.86:0/58591835 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.096+0000 7f50faffd700 1 -- 172.21.15.86:0/58591835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc07e230 con 0x7f50fc07f670 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.096+0000 7f50faffd700 1 --2- 172.21.15.86:0/58591835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc07db70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0098a0 tx=0x7f50ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b3f74a3f9258f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.096+0000 7f50fa7fc700 1 -- 172.21.15.86:0/58591835 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50ec004160 con 0x7f50fc07f670 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.096+0000 7f50fa7fc700 1 -- 172.21.15.86:0/58591835 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f50ec004300 con 0x7f50fc07f670 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.096+0000 7f50fa7fc700 1 -- 172.21.15.86:0/58591835 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50ec011af0 con 0x7f50fc07f670 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.097+0000 7f5101a28700 1 -- 172.21.15.86:0/58591835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 msgr2=0x7f50fc07db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.097+0000 7f5101a28700 1 --2- 172.21.15.86:0/58591835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc07db70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0098a0 tx=0x7f50ec009bb0 comp rx=0 tx=0).stop 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.097+0000 7f5101a28700 1 -- 172.21.15.86:0/58591835 shutdown_connections 2024-05-12T10:57:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.097+0000 7f5101a28700 1 --2- 172.21.15.86:0/58591835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc07db70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.097+0000 7f5101a28700 1 -- 172.21.15.86:0/58591835 >> 172.21.15.86:0/58591835 conn(0x7f50fc1044a0 msgr2=0x7f50fc1068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.097+0000 7f5101a28700 1 -- 172.21.15.86:0/58591835 shutdown_connections 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.097+0000 7f5101a28700 1 -- 172.21.15.86:0/58591835 wait complete. 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.097+0000 7f5101a28700 1 Processor -- start 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.098+0000 7f5101a28700 1 -- start start 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.098+0000 7f5101a28700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.098+0000 7f5101a28700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc10f430 con 0x7f50fc07f670 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.098+0000 7f50faffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.098+0000 7f50faffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc19f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33566/0 (socket says 172.21.15.86:33566) 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.098+0000 7f50faffd700 1 -- 172.21.15.86:0/1829575716 learned_addr learned my addr 172.21.15.86:0/1829575716 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:55.729 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.098+0000 7f50faffd700 1 -- 172.21.15.86:0/1829575716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc19f560 con 0x7f50fc07f670 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.098+0000 7f50faffd700 1 --2- 172.21.15.86:0/1829575716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc19f020 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009fb0 tx=0x7f50ec011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.099+0000 7f5100a26700 1 -- 172.21.15.86:0/1829575716 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50ec0036a0 con 0x7f50fc07f670 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.099+0000 7f5100a26700 1 -- 172.21.15.86:0/1829575716 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f50ec01a430 con 0x7f50fc07f670 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.099+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50fc19f7f0 con 0x7f50fc07f670 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.099+0000 7f5100a26700 1 -- 172.21.15.86:0/1829575716 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50ec019550 con 0x7f50fc07f670 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.099+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50fc1a0310 con 0x7f50fc07f670 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.099+0000 7f5100a26700 1 -- 172.21.15.86:0/1829575716 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f50ec019be0 con 0x7f50fc07f670 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.099+0000 7f5100a26700 1 -- 172.21.15.86:0/1829575716 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f50ec024730 con 0x7f50fc07f670 2024-05-12T10:57:55.730 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.100+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50fc064b00 con 0x7f50fc07f670 2024-05-12T10:57:55.731 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.102+0000 7f5100a26700 1 -- 172.21.15.86:0/1829575716 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f50ec043ec0 con 0x7f50fc07f670 2024-05-12T10:57:55.731 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.168+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f50fc1a07c0 con 0x7f50fc07f670 2024-05-12T10:57:55.731 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.170+0000 7f5100a26700 1 -- 172.21.15.86:0/1829575716 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f50ec032020 con 0x7f50fc07f670 2024-05-12T10:57:55.731 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.171+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 msgr2=0x7f50fc19f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:55.731 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.171+0000 7f5101a28700 1 --2- 172.21.15.86:0/1829575716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc19f020 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009fb0 tx=0x7f50ec011940 comp rx=0 tx=0).stop 2024-05-12T10:57:55.731 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.171+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 shutdown_connections 2024-05-12T10:57:55.731 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.171+0000 7f5101a28700 1 --2- 172.21.15.86:0/1829575716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc07f670 0x7f50fc19f020 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:55.731 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.171+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 >> 172.21.15.86:0/1829575716 conn(0x7f50fc1044a0 msgr2=0x7f50fc104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:55.732 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.171+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 shutdown_connections 2024-05-12T10:57:55.732 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:55.171+0000 7f5101a28700 1 -- 172.21.15.86:0/1829575716 wait complete. 2024-05-12T10:57:55.732 INFO:teuthology.orchestra.run.smithi086.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-12T10:57:55.770 INFO:teuthology.orchestra.run.smithi086.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-12T10:57:55.770 INFO:teuthology.orchestra.run.smithi086.stdout:Creating mgr... 2024-05-12T10:57:55.770 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-12T10:57:55.770 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-12T10:57:56.012 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.x 2024-05-12T10:57:56.012 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Failed to reset failed state of unit ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.x.service: Unit ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.x.service not loaded. 2024-05-12T10:57:56.150 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-513c80a2-104e-11ef-bc98-c7b262605968.target.wants/ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-513c80a2-104e-11ef-bc98-c7b262605968@.service. 2024-05-12T10:57:56.405 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:56 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1829575716' entity='client.admin' 2024-05-12T10:57:56.405 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 systemd[1]: Starting Ceph mgr.x for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T10:57:56.683 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 podman[30325]: 2024-05-12 10:57:56.315790429 +0000 UTC m=+0.031083342 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T10:57:56.683 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 podman[30325]: 2024-05-12 10:57:56.413932955 +0000 UTC m=+0.129225872 container create c006a90d75fa0840b2ab35a2689ed7ac09b708dfc0d17675b10a024596278d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-12T10:57:56.683 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 podman[30325]: 2024-05-12 10:57:56.616395161 +0000 UTC m=+0.331688063 container init c006a90d75fa0840b2ab35a2689ed7ac09b708dfc0d17675b10a024596278d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-05-12T10:57:56.683 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 podman[30325]: 2024-05-12 10:57:56.619086921 +0000 UTC m=+0.334379814 container start c006a90d75fa0840b2ab35a2689ed7ac09b708dfc0d17675b10a024596278d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-12T10:57:56.683 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 bash[30325]: c006a90d75fa0840b2ab35a2689ed7ac09b708dfc0d17675b10a024596278d1b 2024-05-12T10:57:56.697 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-12T10:57:56.697 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout disabled 2024-05-12T10:57:56.705 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-12T10:57:56.705 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-05-12T10:57:56.705 INFO:teuthology.orchestra.run.smithi086.stdout:firewalld.service is not enabled 2024-05-12T10:57:56.706 INFO:teuthology.orchestra.run.smithi086.stdout:Not possible to enable service . firewalld.service is not available 2024-05-12T10:57:56.715 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-12T10:57:56.715 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout disabled 2024-05-12T10:57:56.723 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-12T10:57:56.723 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-05-12T10:57:56.723 INFO:teuthology.orchestra.run.smithi086.stdout:firewalld.service is not enabled 2024-05-12T10:57:56.723 INFO:teuthology.orchestra.run.smithi086.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-12T10:57:56.723 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mgr to start... 2024-05-12T10:57:56.723 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mgr... 2024-05-12T10:57:56.960 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 systemd[1]: Started Ceph mgr.x for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T10:57:56.960 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:56.780+0000 7fe86eaab200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T10:57:56.961 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:56 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:56.968+0000 7fe86eaab200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:57:57.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:57 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:57.073+0000 7fe86eaab200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T10:57:57.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:57:57 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/687837274' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-12T10:57:57.631 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:57 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:57.400+0000 7fe86eaab200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T10:57:57.631 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:57 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:57.486+0000 7fe86eaab200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T10:57:57.919 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "health": { 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-12T10:57:57.920 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 0 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "a" 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:57:57.921 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-12T10:57:57.922 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-12T10:57:57.923 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "restful" 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modified": "2024-05-12T10:57:49.284800+0000", 2024-05-12T10:57:57.924 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.195+0000 7f9fa513d700 1 Processor -- start 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.195+0000 7f9fa513d700 1 -- start start 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.195+0000 7f9fa513d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa0107560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.195+0000 7f9fa513d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0107b30 con 0x7f9fa0107140 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.195+0000 7f9f9ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa0107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.195+0000 7f9f9ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa0107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33596/0 (socket says 172.21.15.86:33596) 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.195+0000 7f9f9ed9d700 1 -- 172.21.15.86:0/804081013 learned_addr learned my addr 172.21.15.86:0/804081013 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.196+0000 7f9f9ed9d700 1 -- 172.21.15.86:0/804081013 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa010a0d0 con 0x7f9fa0107140 2024-05-12T10:57:57.925 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.196+0000 7f9f9ed9d700 1 --2- 172.21.15.86:0/804081013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa0107560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9f900098a0 tx=0x7f9f90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8759407fcc8232 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.196+0000 7f9f9dd9b700 1 -- 172.21.15.86:0/804081013 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f90004160 con 0x7f9fa0107140 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.196+0000 7f9f9dd9b700 1 -- 172.21.15.86:0/804081013 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9f90004300 con 0x7f9fa0107140 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.196+0000 7f9f9dd9b700 1 -- 172.21.15.86:0/804081013 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f90011af0 con 0x7f9fa0107140 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.197+0000 7f9fa513d700 1 -- 172.21.15.86:0/804081013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 msgr2=0x7f9fa0107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.197+0000 7f9fa513d700 1 --2- 172.21.15.86:0/804081013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa0107560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9f900098a0 tx=0x7f9f90009bb0 comp rx=0 tx=0).stop 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.197+0000 7f9fa513d700 1 -- 172.21.15.86:0/804081013 shutdown_connections 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.197+0000 7f9fa513d700 1 --2- 172.21.15.86:0/804081013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa0107560 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.197+0000 7f9fa513d700 1 -- 172.21.15.86:0/804081013 >> 172.21.15.86:0/804081013 conn(0x7f9fa0102a30 msgr2=0x7f9fa0104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.197+0000 7f9fa513d700 1 -- 172.21.15.86:0/804081013 shutdown_connections 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.197+0000 7f9fa513d700 1 -- 172.21.15.86:0/804081013 wait complete. 2024-05-12T10:57:57.926 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.198+0000 7f9fa513d700 1 Processor -- start 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.198+0000 7f9fa513d700 1 -- start start 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.198+0000 7f9fa513d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.198+0000 7f9fa513d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa010d480 con 0x7f9fa0107140 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.198+0000 7f9f9ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.198+0000 7f9f9ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33610/0 (socket says 172.21.15.86:33610) 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.198+0000 7f9f9ed9d700 1 -- 172.21.15.86:0/687837274 learned_addr learned my addr 172.21.15.86:0/687837274 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9f9ed9d700 1 -- 172.21.15.86:0/687837274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa019d3c0 con 0x7f9fa0107140 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9f9ed9d700 1 --2- 172.21.15.86:0/687837274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa019ce80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009fb0 tx=0x7f9f90011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9f87fff700 1 -- 172.21.15.86:0/687837274 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f900036a0 con 0x7f9fa0107140 2024-05-12T10:57:57.927 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa019d650 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9f87fff700 1 -- 172.21.15.86:0/687837274 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9f9001a430 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9f87fff700 1 -- 172.21.15.86:0/687837274 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f90019550 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa019e170 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9f87fff700 1 -- 172.21.15.86:0/687837274 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9f90019be0 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.199+0000 7f9f87fff700 1 -- 172.21.15.86:0/687837274 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9f90024730 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.200+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa0064b00 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.204+0000 7f9f87fff700 1 -- 172.21.15.86:0/687837274 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9f90043ec0 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.277+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9fa019e580 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.278+0000 7f9f87fff700 1 -- 172.21.15.86:0/687837274 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f9f90032020 con 0x7f9fa0107140 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.279+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 msgr2=0x7f9fa019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:57:57.928 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.279+0000 7f9fa513d700 1 --2- 172.21.15.86:0/687837274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa019ce80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009fb0 tx=0x7f9f90011940 comp rx=0 tx=0).stop 2024-05-12T10:57:57.929 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.279+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 shutdown_connections 2024-05-12T10:57:57.929 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.279+0000 7f9fa513d700 1 --2- 172.21.15.86:0/687837274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0107140 0x7f9fa019ce80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:57:57.929 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.279+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 >> 172.21.15.86:0/687837274 conn(0x7f9fa0102a30 msgr2=0x7f9fa0103560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:57:57.929 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.279+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 shutdown_connections 2024-05-12T10:57:57.929 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:57:57.279+0000 7f9fa513d700 1 -- 172.21.15.86:0/687837274 wait complete. 2024-05-12T10:57:57.929 INFO:teuthology.orchestra.run.smithi086.stdout:mgr not available, waiting (1/15)... 2024-05-12T10:57:58.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:58 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:58.682+0000 7fe86eaab200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T10:57:58.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:58 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:58.855+0000 7fe86eaab200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T10:57:59.303 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:59 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:59.024+0000 7fe86eaab200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T10:57:59.304 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:59 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:59.311+0000 7fe86eaab200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T10:57:59.610 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:59 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:59.408+0000 7fe86eaab200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T10:57:59.610 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:59 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:59.617+0000 7fe86eaab200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T10:57:59.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:57:59 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:57:59.810+0000 7fe86eaab200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:58:00.662 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:00 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4279533475' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-12T10:58:00.662 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:00 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:00.434+0000 7fe86eaab200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-12T10:58:00.662 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:00 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:00.669+0000 7fe86eaab200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-12T10:58:01.060 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:58:01.060 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-05-12T10:58:01.060 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T10:58:01.060 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "health": { 2024-05-12T10:58:01.060 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-12T10:58:01.060 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 0 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "a" 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:01.061 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-12T10:58:01.062 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-12T10:58:01.063 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-12T10:58:01.069 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-12T10:58:01.069 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-12T10:58:01.070 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "restful" 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modified": "2024-05-12T10:57:49.284800+0000", 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:01.071 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.371+0000 7fa8227ca700 1 Processor -- start 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.371+0000 7fa8227ca700 1 -- start start 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.371+0000 7fa8227ca700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.371+0000 7fa8227ca700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c07d680 con 0x7fa81c107780 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.372+0000 7fa81bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.372+0000 7fa81bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33622/0 (socket says 172.21.15.86:33622) 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.372+0000 7fa81bfff700 1 -- 172.21.15.86:0/2869012669 learned_addr learned my addr 172.21.15.86:0/2869012669 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.372+0000 7fa81bfff700 1 -- 172.21.15.86:0/2869012669 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c1080e0 con 0x7fa81c107780 2024-05-12T10:58:01.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.372+0000 7fa81bfff700 1 --2- 172.21.15.86:0/2869012669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c107ba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8040098a0 tx=0x7fa804009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34978d1841030bd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.372+0000 7fa81affd700 1 -- 172.21.15.86:0/2869012669 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa804004160 con 0x7fa81c107780 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.372+0000 7fa81affd700 1 -- 172.21.15.86:0/2869012669 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa804004300 con 0x7fa81c107780 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.372+0000 7fa81affd700 1 -- 172.21.15.86:0/2869012669 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa804011af0 con 0x7fa81c107780 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.373+0000 7fa8227ca700 1 -- 172.21.15.86:0/2869012669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 msgr2=0x7fa81c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.373+0000 7fa8227ca700 1 --2- 172.21.15.86:0/2869012669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c107ba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8040098a0 tx=0x7fa804009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.373+0000 7fa8227ca700 1 -- 172.21.15.86:0/2869012669 shutdown_connections 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.373+0000 7fa8227ca700 1 --2- 172.21.15.86:0/2869012669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c107ba0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.373+0000 7fa8227ca700 1 -- 172.21.15.86:0/2869012669 >> 172.21.15.86:0/2869012669 conn(0x7fa81c103360 msgr2=0x7fa81c105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.373+0000 7fa8227ca700 1 -- 172.21.15.86:0/2869012669 shutdown_connections 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.373+0000 7fa8227ca700 1 -- 172.21.15.86:0/2869012669 wait complete. 2024-05-12T10:58:01.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.373+0000 7fa8227ca700 1 Processor -- start 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.374+0000 7fa8227ca700 1 -- start start 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.374+0000 7fa8227ca700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.374+0000 7fa8227ca700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c109110 con 0x7fa81c107780 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.374+0000 7fa81bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.374+0000 7fa81bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c19eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33638/0 (socket says 172.21.15.86:33638) 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.374+0000 7fa81bfff700 1 -- 172.21.15.86:0/4279533475 learned_addr learned my addr 172.21.15.86:0/4279533475 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.374+0000 7fa81bfff700 1 -- 172.21.15.86:0/4279533475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c19f530 con 0x7fa81c107780 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.374+0000 7fa81bfff700 1 --2- 172.21.15.86:0/4279533475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c19eff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa804003f40 tx=0x7fa804011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.375+0000 7fa8197fa700 1 -- 172.21.15.86:0/4279533475 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8040038b0 con 0x7fa81c107780 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.375+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81c19f7c0 con 0x7fa81c107780 2024-05-12T10:58:01.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.375+0000 7fa8197fa700 1 -- 172.21.15.86:0/4279533475 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa804003a50 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.375+0000 7fa8197fa700 1 -- 172.21.15.86:0/4279533475 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa80401a5c0 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.375+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81c1a02e0 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.375+0000 7fa8197fa700 1 -- 172.21.15.86:0/4279533475 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa80401ac00 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.375+0000 7fa8197fa700 1 -- 172.21.15.86:0/4279533475 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa804019700 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.376+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81c064b00 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.380+0000 7fa8197fa700 1 -- 172.21.15.86:0/4279533475 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa804019900 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.452+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa81c06bcb0 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.452+0000 7fa8197fa700 1 -- 172.21.15.86:0/4279533475 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fa804019ae0 con 0x7fa81c107780 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.453+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 msgr2=0x7fa81c19eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:01.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.453+0000 7fa8227ca700 1 --2- 172.21.15.86:0/4279533475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c19eff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa804003f40 tx=0x7fa804011890 comp rx=0 tx=0).stop 2024-05-12T10:58:01.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.454+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 shutdown_connections 2024-05-12T10:58:01.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.454+0000 7fa8227ca700 1 --2- 172.21.15.86:0/4279533475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c107780 0x7fa81c19eff0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:01.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.454+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 >> 172.21.15.86:0/4279533475 conn(0x7fa81c103360 msgr2=0x7fa81c195ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:01.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.454+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 shutdown_connections 2024-05-12T10:58:01.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:00.454+0000 7fa8227ca700 1 -- 172.21.15.86:0/4279533475 wait complete. 2024-05-12T10:58:01.076 INFO:teuthology.orchestra.run.smithi086.stdout:mgr not available, waiting (2/15)... 2024-05-12T10:58:01.463 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:01 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:01.102+0000 7fe86eaab200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T10:58:01.463 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:01 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:01.206+0000 7fe86eaab200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T10:58:01.916 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:01 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:01.573+0000 7fe86eaab200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-12T10:58:01.917 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:01 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:01.924+0000 7fe86eaab200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T10:58:02.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:02.016+0000 7fe86eaab200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T10:58:02.713 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:02.258+0000 7fe86eaab200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T10:58:02.713 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:02.390+0000 7fe86eaab200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T10:58:02.713 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:02.484+0000 7fe86eaab200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T10:58:03.187 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:02.806+0000 7fe86eaab200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T10:58:03.187 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:02.898+0000 7fe86eaab200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T10:58:03.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:03 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3785116335' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-12T10:58:03.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:03 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:03.512+0000 7fe86eaab200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T10:58:03.964 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:03 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:03.741+0000 7fe86eaab200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T10:58:04.179 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:58:04.182 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-05-12T10:58:04.182 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T10:58:04.182 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "health": { 2024-05-12T10:58:04.182 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-12T10:58:04.182 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-12T10:58:04.182 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 0 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "a" 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:04.183 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-12T10:58:04.184 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:04.184 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-12T10:58:04.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-12T10:58:04.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-12T10:58:04.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-12T10:58:04.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-12T10:58:04.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-12T10:58:04.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:04.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:04.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "restful" 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-12T10:58:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modified": "2024-05-12T10:57:49.284800+0000", 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.514+0000 7f6a8b983700 1 Processor -- start 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.514+0000 7f6a8b983700 1 -- start start 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.514+0000 7f6a8b983700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8410bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.514+0000 7f6a8b983700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8407ce50 con 0x7f6a84109900 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.514+0000 7f6a8971f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8410bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.514+0000 7f6a8971f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8410bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47642/0 (socket says 172.21.15.86:47642) 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.514+0000 7f6a8971f700 1 -- 172.21.15.86:0/2489671528 learned_addr learned my addr 172.21.15.86:0/2489671528 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.515+0000 7f6a8971f700 1 -- 172.21.15.86:0/2489671528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8410c230 con 0x7f6a84109900 2024-05-12T10:58:04.195 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.515+0000 7f6a8971f700 1 --2- 172.21.15.86:0/2489671528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8410bcf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a800098a0 tx=0x7f6a80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e81fbcbd56e9b1a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.515+0000 7f6a7bfff700 1 -- 172.21.15.86:0/2489671528 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a80004160 con 0x7f6a84109900 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.515+0000 7f6a7bfff700 1 -- 172.21.15.86:0/2489671528 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6a80004300 con 0x7f6a84109900 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.515+0000 7f6a7bfff700 1 -- 172.21.15.86:0/2489671528 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a80011af0 con 0x7f6a84109900 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.516+0000 7f6a8b983700 1 -- 172.21.15.86:0/2489671528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 msgr2=0x7f6a8410bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.516+0000 7f6a8b983700 1 --2- 172.21.15.86:0/2489671528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8410bcf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a800098a0 tx=0x7f6a80009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.516+0000 7f6a8b983700 1 -- 172.21.15.86:0/2489671528 shutdown_connections 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.516+0000 7f6a8b983700 1 --2- 172.21.15.86:0/2489671528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8410bcf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.516+0000 7f6a8b983700 1 -- 172.21.15.86:0/2489671528 >> 172.21.15.86:0/2489671528 conn(0x7f6a841032b0 msgr2=0x7f6a84105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.516+0000 7f6a8b983700 1 -- 172.21.15.86:0/2489671528 shutdown_connections 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.516+0000 7f6a8b983700 1 -- 172.21.15.86:0/2489671528 wait complete. 2024-05-12T10:58:04.196 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8b983700 1 Processor -- start 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8b983700 1 -- start start 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8b983700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8419f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8b983700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8410d1f0 con 0x7f6a84109900 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8971f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8419f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8971f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8419f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47644/0 (socket says 172.21.15.86:47644) 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8971f700 1 -- 172.21.15.86:0/3785116335 learned_addr learned my addr 172.21.15.86:0/3785116335 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8971f700 1 -- 172.21.15.86:0/3785116335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8419f590 con 0x7f6a84109900 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8971f700 1 --2- 172.21.15.86:0/3785116335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8419f050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a80011ac0 tx=0x7f6a80011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a7a7fc700 1 -- 172.21.15.86:0/3785116335 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a80003970 con 0x7f6a84109900 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a7a7fc700 1 -- 172.21.15.86:0/3785116335 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6a80003b10 con 0x7f6a84109900 2024-05-12T10:58:04.197 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.517+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8419f820 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.518+0000 7f6a7a7fc700 1 -- 172.21.15.86:0/3785116335 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a80024610 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.518+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a841a0340 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.518+0000 7f6a7a7fc700 1 -- 172.21.15.86:0/3785116335 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a80024bd0 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.518+0000 7f6a7a7fc700 1 -- 172.21.15.86:0/3785116335 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6a80019700 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.519+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a84064b00 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.521+0000 7f6a7a7fc700 1 -- 172.21.15.86:0/3785116335 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6a80043ec0 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.593+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6a8406bcb0 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.594+0000 7f6a7a7fc700 1 -- 172.21.15.86:0/3785116335 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f6a80032030 con 0x7f6a84109900 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.595+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 msgr2=0x7f6a8419f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.595+0000 7f6a8b983700 1 --2- 172.21.15.86:0/3785116335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8419f050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a80011ac0 tx=0x7f6a80011ba0 comp rx=0 tx=0).stop 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.595+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 shutdown_connections 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.595+0000 7f6a8b983700 1 --2- 172.21.15.86:0/3785116335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a84109900 0x7f6a8419f050 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.595+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 >> 172.21.15.86:0/3785116335 conn(0x7f6a841032b0 msgr2=0x7f6a84103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:04.199 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.595+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 shutdown_connections 2024-05-12T10:58:04.199 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:03.595+0000 7f6a8b983700 1 -- 172.21.15.86:0/3785116335 wait complete. 2024-05-12T10:58:04.199 INFO:teuthology.orchestra.run.smithi086.stdout:mgr not available, waiting (3/15)... 2024-05-12T10:58:04.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: Activating manager daemon x 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: mgrmap e2: x(active, starting, since 0.00304928s) 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: Manager daemon x is now available 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' 2024-05-12T10:58:04.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:04 smithi086 ceph-mon[30110]: from='mgr.14100 172.21.15.86:0/2245859952' entity='mgr.x' 2024-05-12T10:58:06.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:05 smithi086 ceph-mon[30110]: mgrmap e3: x(active, since 1.00707s) 2024-05-12T10:58:06.944 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:06 smithi086 ceph-mon[30110]: mgrmap e4: x(active, since 2s) 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "health": { 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-12T10:58:07.529 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 0 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "a" 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:07.530 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-12T10:58:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-12T10:58:07.532 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "restful" 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modified": "2024-05-12T10:57:49.284800+0000", 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52b5273700 1 Processor -- start 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52b5273700 1 -- start start 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52b5273700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b0108170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52b5273700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0108740 con 0x7f52b0107d50 2024-05-12T10:58:07.533 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52aeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b0108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52aeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b0108170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47718/0 (socket says 172.21.15.86:47718) 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52aeffd700 1 -- 172.21.15.86:0/1587571317 learned_addr learned my addr 172.21.15.86:0/1587571317 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52aeffd700 1 -- 172.21.15.86:0/1587571317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b0108f50 con 0x7f52b0107d50 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.656+0000 7f52aeffd700 1 --2- 172.21.15.86:0/1587571317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b0108170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52a40098a0 tx=0x7f52a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78350ef165fda9db server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52adffb700 1 -- 172.21.15.86:0/1587571317 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a4004160 con 0x7f52b0107d50 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52adffb700 1 -- 172.21.15.86:0/1587571317 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f52a4004300 con 0x7f52b0107d50 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52adffb700 1 -- 172.21.15.86:0/1587571317 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a4011af0 con 0x7f52b0107d50 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52b5273700 1 -- 172.21.15.86:0/1587571317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 msgr2=0x7f52b0108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52b5273700 1 --2- 172.21.15.86:0/1587571317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b0108170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52a40098a0 tx=0x7f52a4009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52b5273700 1 -- 172.21.15.86:0/1587571317 shutdown_connections 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52b5273700 1 --2- 172.21.15.86:0/1587571317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b0108170 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52b5273700 1 -- 172.21.15.86:0/1587571317 >> 172.21.15.86:0/1587571317 conn(0x7f52b01032b0 msgr2=0x7f52b0105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52b5273700 1 -- 172.21.15.86:0/1587571317 shutdown_connections 2024-05-12T10:58:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.657+0000 7f52b5273700 1 -- 172.21.15.86:0/1587571317 wait complete. 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.658+0000 7f52b5273700 1 Processor -- start 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.658+0000 7f52b5273700 1 -- start start 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.658+0000 7f52b5273700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.658+0000 7f52b5273700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f52b010c300 con 0x7f52b0107d50 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.658+0000 7f52aeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f52aeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47732/0 (socket says 172.21.15.86:47732) 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f52aeffd700 1 -- 172.21.15.86:0/2480984424 learned_addr learned my addr 172.21.15.86:0/2480984424 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f52aeffd700 1 -- 172.21.15.86:0/2480984424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b019c360 con 0x7f52b0107d50 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f52aeffd700 1 --2- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b019be20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f52a40117b0 tx=0x7f52a4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f5297fff700 1 -- 172.21.15.86:0/2480984424 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a4003af0 con 0x7f52b0107d50 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b019c5f0 con 0x7f52b0107d50 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f5297fff700 1 -- 172.21.15.86:0/2480984424 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f52a4020070 con 0x7f52b0107d50 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f5297fff700 1 -- 172.21.15.86:0/2480984424 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a4019630 con 0x7f52b0107d50 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.659+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b019cfd0 con 0x7f52b0107d50 2024-05-12T10:58:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.660+0000 7f5297fff700 1 -- 172.21.15.86:0/2480984424 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f52a401a9c0 con 0x7f52b0107d50 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.660+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b0064b00 con 0x7f52b0107d50 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.660+0000 7f5297fff700 1 --2- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f529803e4e0 0x7f52980409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.660+0000 7f5297fff700 1 -- 172.21.15.86:0/2480984424 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f52a4053a60 con 0x7f52b0107d50 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.661+0000 7f52ae7fc700 1 --2- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f529803e4e0 0x7f52980409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.661+0000 7f52ae7fc700 1 --2- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f529803e4e0 0x7f52980409a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f52a0006fd0 tx=0x7f52a0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.666+0000 7f5297fff700 1 -- 172.21.15.86:0/2480984424 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f52a40172b0 con 0x7f52b0107d50 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.952+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f52b006bcb0 con 0x7f52b0107d50 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.952+0000 7f5297fff700 1 -- 172.21.15.86:0/2480984424 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f52a400be30 con 0x7f52b0107d50 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.954+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f529803e4e0 msgr2=0x7f52980409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.954+0000 7f52b5273700 1 --2- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f529803e4e0 0x7f52980409a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f52a0006fd0 tx=0x7f52a0006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.954+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 msgr2=0x7f52b019be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.954+0000 7f52b5273700 1 --2- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b019be20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f52a40117b0 tx=0x7f52a4011b70 comp rx=0 tx=0).stop 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.954+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 shutdown_connections 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.954+0000 7f52b5273700 1 --2- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f529803e4e0 0x7f52980409a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:07.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.954+0000 7f52b5273700 1 --2- 172.21.15.86:0/2480984424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52b0107d50 0x7f52b019be20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:07.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.954+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 >> 172.21.15.86:0/2480984424 conn(0x7f52b01032b0 msgr2=0x7f52b0103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:07.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.955+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 shutdown_connections 2024-05-12T10:58:07.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:06.955+0000 7f52b5273700 1 -- 172.21.15.86:0/2480984424 wait complete. 2024-05-12T10:58:07.537 INFO:teuthology.orchestra.run.smithi086.stdout:mgr is available 2024-05-12T10:58:07.910 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:07 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2480984424' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-12T10:58:08.747 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:08 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3067747857' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [global] 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout fsid = 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-12T10:58:08.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [osd] 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.935+0000 7fecb67da700 1 Processor -- start 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.935+0000 7fecb67da700 1 -- start start 2024-05-12T10:58:08.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.935+0000 7fecb67da700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb0109250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.935+0000 7fecb67da700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fecb0109790 con 0x7fecb0108e30 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.935+0000 7fecaffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb0109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.935+0000 7fecaffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb0109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47742/0 (socket says 172.21.15.86:47742) 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.935+0000 7fecaffff700 1 -- 172.21.15.86:0/2235384253 learned_addr learned my addr 172.21.15.86:0/2235384253 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.935+0000 7fecaffff700 1 -- 172.21.15.86:0/2235384253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb0109f90 con 0x7fecb0108e30 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecaffff700 1 --2- 172.21.15.86:0/2235384253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb0109250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feca00098a0 tx=0x7feca0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b22df27d051b00 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecaeffd700 1 -- 172.21.15.86:0/2235384253 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0004160 con 0x7fecb0108e30 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecaeffd700 1 -- 172.21.15.86:0/2235384253 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7feca0004300 con 0x7fecb0108e30 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecaeffd700 1 -- 172.21.15.86:0/2235384253 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0011af0 con 0x7fecb0108e30 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecb67da700 1 -- 172.21.15.86:0/2235384253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 msgr2=0x7fecb0109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:08.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecb67da700 1 --2- 172.21.15.86:0/2235384253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb0109250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feca00098a0 tx=0x7feca0009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecb67da700 1 -- 172.21.15.86:0/2235384253 shutdown_connections 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecb67da700 1 --2- 172.21.15.86:0/2235384253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb0109250 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecb67da700 1 -- 172.21.15.86:0/2235384253 >> 172.21.15.86:0/2235384253 conn(0x7fecb0104410 msgr2=0x7fecb0106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecb67da700 1 -- 172.21.15.86:0/2235384253 shutdown_connections 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.936+0000 7fecb67da700 1 -- 172.21.15.86:0/2235384253 wait complete. 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.937+0000 7fecb67da700 1 Processor -- start 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.937+0000 7fecb67da700 1 -- start start 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.937+0000 7fecb67da700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb007f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.937+0000 7fecb67da700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fecb010d3d0 con 0x7fecb0108e30 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.937+0000 7fecaffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb007f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.937+0000 7fecaffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb007f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47750/0 (socket says 172.21.15.86:47750) 2024-05-12T10:58:08.760 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.937+0000 7fecaffff700 1 -- 172.21.15.86:0/3067747857 learned_addr learned my addr 172.21.15.86:0/3067747857 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:08.761 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.938+0000 7fecaffff700 1 -- 172.21.15.86:0/3067747857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb007db10 con 0x7fecb0108e30 2024-05-12T10:58:08.761 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.938+0000 7fecaffff700 1 --2- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb007f5c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feca0003f40 tx=0x7feca0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:08.761 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.938+0000 7fecad7fa700 1 -- 172.21.15.86:0/3067747857 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca00038b0 con 0x7fecb0108e30 2024-05-12T10:58:08.761 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.938+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb007dda0 con 0x7fecb0108e30 2024-05-12T10:58:08.761 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.938+0000 7fecad7fa700 1 -- 172.21.15.86:0/3067747857 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7feca0003a50 con 0x7fecb0108e30 2024-05-12T10:58:08.761 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.938+0000 7fecad7fa700 1 -- 172.21.15.86:0/3067747857 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca001a5c0 con 0x7fecb0108e30 2024-05-12T10:58:08.761 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.938+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb007e280 con 0x7fecb0108e30 2024-05-12T10:58:08.761 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.939+0000 7fecad7fa700 1 -- 172.21.15.86:0/3067747857 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7feca001a8c0 con 0x7fecb0108e30 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.939+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb0064b00 con 0x7fecb0108e30 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.939+0000 7fecad7fa700 1 --2- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fec9803e490 0x7fec98040950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.939+0000 7fecad7fa700 1 -- 172.21.15.86:0/3067747857 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7feca0053c20 con 0x7fecb0108e30 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.939+0000 7fecaf7fe700 1 --2- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fec9803e490 0x7fec98040950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.940+0000 7fecaf7fe700 1 --2- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fec9803e490 0x7fec98040950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feca4006fd0 tx=0x7feca4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:07.944+0000 7fecad7fa700 1 -- 172.21.15.86:0/3067747857 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feca000e260 con 0x7fecb0108e30 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.142+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fecb007e830 con 0x7fecb0108e30 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.143+0000 7fecad7fa700 1 -- 172.21.15.86:0/3067747857 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7feca0053640 con 0x7fecb0108e30 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.145+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fec9803e490 msgr2=0x7fec98040950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.145+0000 7fecb67da700 1 --2- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fec9803e490 0x7fec98040950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feca4006fd0 tx=0x7feca4006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.145+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 msgr2=0x7fecb007f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.145+0000 7fecb67da700 1 --2- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb007f5c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feca0003f40 tx=0x7feca0011890 comp rx=0 tx=0).stop 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.146+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 shutdown_connections 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.146+0000 7fecb67da700 1 --2- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fec9803e490 0x7fec98040950 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.146+0000 7fecb67da700 1 --2- 172.21.15.86:0/3067747857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb0108e30 0x7fecb007f5c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.146+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 >> 172.21.15.86:0/3067747857 conn(0x7fecb0104410 msgr2=0x7fecb0104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.146+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 shutdown_connections 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:08.146+0000 7fecb67da700 1 -- 172.21.15.86:0/3067747857 wait complete. 2024-05-12T10:58:08.763 INFO:teuthology.orchestra.run.smithi086.stdout:Enabling cephadm module... 2024-05-12T10:58:10.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:09 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3532908613' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-12T10:58:10.103 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:09 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: ignoring --setuser ceph since I am not root 2024-05-12T10:58:10.103 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:09 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: ignoring --setgroup ceph since I am not root 2024-05-12T10:58:10.103 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:09 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:09.925+0000 7f4807908200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T10:58:10.411 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:10 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:10.111+0000 7f4807908200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:58:10.412 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:10 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:10.221+0000 7f4807908200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.169+0000 7fc1b79b4700 1 Processor -- start 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.169+0000 7fc1b79b4700 1 -- start start 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.169+0000 7fc1b79b4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b0109250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.169+0000 7fc1b79b4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b0109790 con 0x7fc1b0108e30 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.170+0000 7fc1b5750700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b0109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.170+0000 7fc1b5750700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b0109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47756/0 (socket says 172.21.15.86:47756) 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.170+0000 7fc1b5750700 1 -- 172.21.15.86:0/2621924207 learned_addr learned my addr 172.21.15.86:0/2621924207 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.170+0000 7fc1b5750700 1 -- 172.21.15.86:0/2621924207 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b0109f90 con 0x7fc1b0108e30 2024-05-12T10:58:10.421 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.170+0000 7fc1b5750700 1 --2- 172.21.15.86:0/2621924207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b0109250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0098a0 tx=0x7fc1ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d31eb5c3bdf204f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.170+0000 7fc1a7fff700 1 -- 172.21.15.86:0/2621924207 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac004160 con 0x7fc1b0108e30 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.170+0000 7fc1a7fff700 1 -- 172.21.15.86:0/2621924207 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc1ac004300 con 0x7fc1b0108e30 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.170+0000 7fc1a7fff700 1 -- 172.21.15.86:0/2621924207 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac011af0 con 0x7fc1b0108e30 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 -- 172.21.15.86:0/2621924207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 msgr2=0x7fc1b0109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 --2- 172.21.15.86:0/2621924207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b0109250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0098a0 tx=0x7fc1ac009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 -- 172.21.15.86:0/2621924207 shutdown_connections 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 --2- 172.21.15.86:0/2621924207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b0109250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 -- 172.21.15.86:0/2621924207 >> 172.21.15.86:0/2621924207 conn(0x7fc1b0104410 msgr2=0x7fc1b0106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 -- 172.21.15.86:0/2621924207 shutdown_connections 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 -- 172.21.15.86:0/2621924207 wait complete. 2024-05-12T10:58:10.422 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 Processor -- start 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.171+0000 7fc1b79b4700 1 -- start start 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b79b4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b79b4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b010d3d0 con 0x7fc1b0108e30 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b5750700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b5750700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47762/0 (socket says 172.21.15.86:47762) 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b5750700 1 -- 172.21.15.86:0/3532908613 learned_addr learned my addr 172.21.15.86:0/3532908613 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b5750700 1 -- 172.21.15.86:0/3532908613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b019d360 con 0x7fc1b0108e30 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b5750700 1 --2- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b019ce20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac003f40 tx=0x7fc1ac011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1a67fc700 1 -- 172.21.15.86:0/3532908613 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac0038b0 con 0x7fc1b0108e30 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1a67fc700 1 -- 172.21.15.86:0/3532908613 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc1ac003a50 con 0x7fc1b0108e30 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1a67fc700 1 -- 172.21.15.86:0/3532908613 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac01a5c0 con 0x7fc1b0108e30 2024-05-12T10:58:10.423 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b019d5f0 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.172+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b019dfd0 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.173+0000 7fc1a67fc700 1 -- 172.21.15.86:0/3532908613 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fc1ac01a870 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.173+0000 7fc1a67fc700 1 --2- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fc19c03e4e0 0x7fc19c0409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.173+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b0064b00 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.173+0000 7fc1a67fc700 1 -- 172.21.15.86:0/3532908613 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc1ac053a40 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.173+0000 7fc1b4f4f700 1 --2- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fc19c03e4e0 0x7fc19c0409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.174+0000 7fc1b4f4f700 1 --2- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fc19c03e4e0 0x7fc19c0409a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0006fd0 tx=0x7fc1a0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.179+0000 7fc1a67fc700 1 -- 172.21.15.86:0/3532908613 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc1ac00b3e0 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.434+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fc1b006bcb0 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.755+0000 7fc1a67fc700 1 -- 172.21.15.86:0/3532908613 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fc1ac00e260 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.756+0000 7fc1a67fc700 1 -- 172.21.15.86:0/3532908613 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fc1ac02d3f0 con 0x7fc1b0108e30 2024-05-12T10:58:10.424 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fc19c03e4e0 msgr2=0x7fc19c0409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 --2- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fc19c03e4e0 0x7fc19c0409a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0006fd0 tx=0x7fc1a0006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 msgr2=0x7fc1b019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 --2- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b019ce20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac003f40 tx=0x7fc1ac011890 comp rx=0 tx=0).stop 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 shutdown_connections 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 --2- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7fc19c03e4e0 0x7fc19c0409a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 --2- 172.21.15.86:0/3532908613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0108e30 0x7fc1b019ce20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 >> 172.21.15.86:0/3532908613 conn(0x7fc1b0104410 msgr2=0x7fc1b0104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 shutdown_connections 2024-05-12T10:58:10.425 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:09.758+0000 7fc1b79b4700 1 -- 172.21.15.86:0/3532908613 wait complete. 2024-05-12T10:58:10.697 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:10 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:10.533+0000 7f4807908200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T10:58:10.697 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:10 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:10.623+0000 7f4807908200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T10:58:10.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:10 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3532908613' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-12T10:58:10.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:10 smithi086 ceph-mon[30110]: mgrmap e5: x(active, since 6s) 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.807+0000 7f22cc6e4700 1 Processor -- start 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.807+0000 7f22cc6e4700 1 -- start start 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.808+0000 7f22cc6e4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c410bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.808+0000 7f22cc6e4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f22c407ce70 con 0x7f22c41098e0 2024-05-12T10:58:11.694 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.808+0000 7f22ca480700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c410bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.808+0000 7f22ca480700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c410bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47804/0 (socket says 172.21.15.86:47804) 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.808+0000 7f22ca480700 1 -- 172.21.15.86:0/200159716 learned_addr learned my addr 172.21.15.86:0/200159716 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.808+0000 7f22ca480700 1 -- 172.21.15.86:0/200159716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c410c210 con 0x7f22c41098e0 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.808+0000 7f22ca480700 1 --2- 172.21.15.86:0/200159716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c410bcd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f22c00098a0 tx=0x7f22c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbf964cf74dab22 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.808+0000 7f22c947e700 1 -- 172.21.15.86:0/200159716 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c0004160 con 0x7f22c41098e0 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22c947e700 1 -- 172.21.15.86:0/200159716 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f22c0004300 con 0x7f22c41098e0 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22c947e700 1 -- 172.21.15.86:0/200159716 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c0011af0 con 0x7f22c41098e0 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22cc6e4700 1 -- 172.21.15.86:0/200159716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 msgr2=0x7f22c410bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22cc6e4700 1 --2- 172.21.15.86:0/200159716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c410bcd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f22c00098a0 tx=0x7f22c0009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22cc6e4700 1 -- 172.21.15.86:0/200159716 shutdown_connections 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22cc6e4700 1 --2- 172.21.15.86:0/200159716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c410bcd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22cc6e4700 1 -- 172.21.15.86:0/200159716 >> 172.21.15.86:0/200159716 conn(0x7f22c41032b0 msgr2=0x7f22c4105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22cc6e4700 1 -- 172.21.15.86:0/200159716 shutdown_connections 2024-05-12T10:58:11.695 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.809+0000 7f22cc6e4700 1 -- 172.21.15.86:0/200159716 wait complete. 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.810+0000 7f22cc6e4700 1 Processor -- start 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.810+0000 7f22cc6e4700 1 -- start start 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.810+0000 7f22cc6e4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c4109340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.810+0000 7f22cc6e4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f22c410d160 con 0x7f22c41098e0 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.810+0000 7f22ca480700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c4109340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.810+0000 7f22ca480700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c4109340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47812/0 (socket says 172.21.15.86:47812) 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.810+0000 7f22ca480700 1 -- 172.21.15.86:0/258067056 learned_addr learned my addr 172.21.15.86:0/258067056 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.811+0000 7f22ca480700 1 -- 172.21.15.86:0/258067056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c4107890 con 0x7f22c41098e0 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.811+0000 7f22ca480700 1 --2- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c4109340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009fb0 tx=0x7f22c0011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.811+0000 7f22bb7fe700 1 -- 172.21.15.86:0/258067056 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c00036a0 con 0x7f22c41098e0 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.811+0000 7f22bb7fe700 1 -- 172.21.15.86:0/258067056 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f22c001a430 con 0x7f22c41098e0 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.811+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c4107b80 con 0x7f22c41098e0 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.811+0000 7f22bb7fe700 1 -- 172.21.15.86:0/258067056 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c0019550 con 0x7f22c41098e0 2024-05-12T10:58:11.696 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.811+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c41080c0 con 0x7f22c41098e0 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.812+0000 7f22bb7fe700 1 -- 172.21.15.86:0/258067056 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f22c0019800 con 0x7f22c41098e0 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.812+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c4064b00 con 0x7f22c41098e0 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.812+0000 7f22bb7fe700 1 --2- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f22b003e530 0x7f22b00409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.812+0000 7f22c9c7f700 1 -- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f22b003e530 msgr2=0x7f22b00409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/1257416774 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.812+0000 7f22bb7fe700 1 -- 172.21.15.86:0/258067056 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f22c00537c0 con 0x7f22c41098e0 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.812+0000 7f22c9c7f700 1 --2- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f22b003e530 0x7f22b00409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:10.817+0000 7f22bb7fe700 1 -- 172.21.15.86:0/258067056 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f22c0020e20 con 0x7f22c41098e0 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.013+0000 7f22c9c7f700 1 -- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f22b003e530 msgr2=0x7f22b00409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/1257416774 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.013+0000 7f22c9c7f700 1 --2- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f22b003e530 0x7f22b00409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.123+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f22c4108600 con 0x7f22c41098e0 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.123+0000 7f22bb7fe700 1 -- 172.21.15.86:0/258067056 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f22c0023e00 con 0x7f22c41098e0 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.125+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f22b003e530 msgr2=0x7f22b00409f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.125+0000 7f22cc6e4700 1 --2- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f22b003e530 0x7f22b00409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:11.697 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.125+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 msgr2=0x7f22c4109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.125+0000 7f22cc6e4700 1 --2- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c4109340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009fb0 tx=0x7f22c0011940 comp rx=0 tx=0).stop 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.125+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 shutdown_connections 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.125+0000 7f22cc6e4700 1 --2- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f22b003e530 0x7f22b00409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.125+0000 7f22cc6e4700 1 --2- 172.21.15.86:0/258067056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22c41098e0 0x7f22c4109340 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.125+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 >> 172.21.15.86:0/258067056 conn(0x7f22c41032b0 msgr2=0x7f22c4103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.126+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 shutdown_connections 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:11.126+0000 7f22cc6e4700 1 -- 172.21.15.86:0/258067056 wait complete. 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for the mgr to restart... 2024-05-12T10:58:11.698 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mgr epoch 5... 2024-05-12T10:58:11.813 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:11 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/258067056' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-12T10:58:12.137 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:11 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:11.863+0000 7f4807908200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T10:58:12.137 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:12.038+0000 7f4807908200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T10:58:12.463 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:12.214+0000 7f4807908200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T10:58:12.763 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:12.501+0000 7f4807908200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T10:58:12.763 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:12.592+0000 7f4807908200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T10:58:13.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:12.794+0000 7f4807908200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T10:58:13.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:12.985+0000 7f4807908200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:58:13.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:13 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:13.584+0000 7f4807908200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-12T10:58:13.964 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:13 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:13.805+0000 7f4807908200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-12T10:58:14.686 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:14.231+0000 7f4807908200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T10:58:14.686 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:14.328+0000 7f4807908200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T10:58:14.686 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:14.694+0000 7f4807908200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-12T10:58:15.379 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:15.049+0000 7f4807908200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T10:58:15.379 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:15.142+0000 7f4807908200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T10:58:15.713 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:15.387+0000 7f4807908200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T10:58:15.713 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:15.518+0000 7f4807908200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T10:58:15.713 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:15.612+0000 7f4807908200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T10:58:16.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:15.933+0000 7f4807908200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T10:58:16.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:16.024+0000 7f4807908200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T10:58:16.878 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:16.617+0000 7f4807908200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T10:58:16.878 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:16.832+0000 7f4807908200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T10:58:17.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: Active manager daemon x restarted 2024-05-12T10:58:17.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: Activating manager daemon x 2024-05-12T10:58:17.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: osdmap e2: 0 total, 0 up, 0 in 2024-05-12T10:58:17.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: mgrmap e6: x(active, starting, since 0.00343594s) 2024-05-12T10:58:17.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:58:17.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-12T10:58:17.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-12T10:58:17.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-12T10:58:17.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-12T10:58:17.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: Manager daemon x is now available 2024-05-12T10:58:17.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:17.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:17.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:58:17.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:58:17.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:16 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-12T10:58:18.165 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:17 smithi086 ceph-mon[30110]: Found migration_current of "None". Setting to last migration. 2024-05-12T10:58:18.165 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:17 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-12T10:58:18.165 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:17 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:18.165 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:17 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:18.165 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:17 smithi086 ceph-mon[30110]: [12/May/2024:10:58:17] ENGINE Bus STARTING 2024-05-12T10:58:18.165 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:17 smithi086 ceph-mon[30110]: [12/May/2024:10:58:17] ENGINE Serving on http://172.21.15.86:8765 2024-05-12T10:58:18.166 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:17 smithi086 ceph-mon[30110]: mgrmap e7: x(active, since 1.00834s) 2024-05-12T10:58:18.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.164+0000 7f8511067700 1 Processor -- start 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.164+0000 7f8511067700 1 -- start start 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.164+0000 7f8511067700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c10bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.164+0000 7f8511067700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f850c07ce50 con 0x7f850c109910 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.164+0000 7f850ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c10bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.164+0000 7f850ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c10bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38334/0 (socket says 172.21.15.86:38334) 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.164+0000 7f850ad9d700 1 -- 172.21.15.86:0/3801696840 learned_addr learned my addr 172.21.15.86:0/3801696840 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.165+0000 7f850ad9d700 1 -- 172.21.15.86:0/3801696840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c10c240 con 0x7f850c109910 2024-05-12T10:58:18.410 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.165+0000 7f850ad9d700 1 --2- 172.21.15.86:0/3801696840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c10bd00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0098a0 tx=0x7f84fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a050e0cbbc93ed server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.165+0000 7f8509d9b700 1 -- 172.21.15.86:0/3801696840 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84fc004160 con 0x7f850c109910 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.165+0000 7f8509d9b700 1 -- 172.21.15.86:0/3801696840 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f84fc004300 con 0x7f850c109910 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.165+0000 7f8509d9b700 1 -- 172.21.15.86:0/3801696840 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84fc011af0 con 0x7f850c109910 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.165+0000 7f8511067700 1 -- 172.21.15.86:0/3801696840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 msgr2=0x7f850c10bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.165+0000 7f8511067700 1 --2- 172.21.15.86:0/3801696840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c10bd00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0098a0 tx=0x7f84fc009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.166+0000 7f8511067700 1 -- 172.21.15.86:0/3801696840 shutdown_connections 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.166+0000 7f8511067700 1 --2- 172.21.15.86:0/3801696840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c10bd00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.166+0000 7f8511067700 1 -- 172.21.15.86:0/3801696840 >> 172.21.15.86:0/3801696840 conn(0x7f850c1032c0 msgr2=0x7f850c105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.166+0000 7f8511067700 1 -- 172.21.15.86:0/3801696840 shutdown_connections 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.166+0000 7f8511067700 1 -- 172.21.15.86:0/3801696840 wait complete. 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.166+0000 7f8511067700 1 Processor -- start 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f8511067700 1 -- start start 2024-05-12T10:58:18.411 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f8511067700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f8511067700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f850c10d200 con 0x7f850c109910 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f850ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f850ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38350/0 (socket says 172.21.15.86:38350) 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f850ad9d700 1 -- 172.21.15.86:0/1259186775 learned_addr learned my addr 172.21.15.86:0/1259186775 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f850ad9d700 1 -- 172.21.15.86:0/1259186775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c19d2d0 con 0x7f850c109910 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f850ad9d700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c19cd90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f84fc011ac0 tx=0x7f84fc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84fc003970 con 0x7f850c109910 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f84fc003b10 con 0x7f850c109910 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c19d560 con 0x7f850c109910 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.167+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84fc024610 con 0x7f850c109910 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.168+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c1a0210 con 0x7f850c109910 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.168+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f84fc024890 con 0x7f850c109910 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.169+0000 7f84f3fff700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 0x7f84f40409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:18.412 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.169+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 --> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f84f4041100 con 0x7f84f403e530 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.169+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f84fc0538c0 con 0x7f850c109910 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.169+0000 7f850a59c700 1 -- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 msgr2=0x7f84f40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/1257416774 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.169+0000 7f850a59c700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 0x7f84f40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.370+0000 7f850a59c700 1 -- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 msgr2=0x7f84f40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/1257416774 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.370+0000 7f850a59c700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 0x7f84f40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.771+0000 7f850a59c700 1 -- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 msgr2=0x7f84f40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/1257416774 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:12.771+0000 7f850a59c700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 0x7f84f40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:13.572+0000 7f850a59c700 1 -- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 msgr2=0x7f84f40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/1257416774 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:13.572+0000 7f850a59c700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 0x7f84f40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:15.173+0000 7f850a59c700 1 -- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 msgr2=0x7f84f40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/1257416774 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:15.173+0000 7f850a59c700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 0x7f84f40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-12T10:58:18.413 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:16.836+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f84fc024b80 con 0x7f850c109910 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:16.836+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 msgr2=0x7f84f40409f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:16.836+0000 7f84f3fff700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 0x7f84f40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.839+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f84fc008d00 con 0x7f850c109910 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.839+0000 7f84f3fff700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f84f4041e20 0x7f84f4044210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.839+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f84fc04de50 con 0x7f84f4041e20 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.840+0000 7f850a59c700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f84f4041e20 0x7f84f4044210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.841+0000 7f850a59c700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f84f4041e20 0x7f84f4044210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8500003a10 tx=0x7f8500009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.841+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mgr.14120 v2:172.21.15.86:6800/3515811906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f84fc04de50 con 0x7f84f4041e20 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.849+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f850c06a5d0 con 0x7f84f4041e20 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.849+0000 7f84f3fff700 1 -- 172.21.15.86:0/1259186775 <== mgr.14120 v2:172.21.15.86:6800/3515811906 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f850c06a5d0 con 0x7f84f4041e20 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f84f4041e20 msgr2=0x7f84f4044210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f84f4041e20 0x7f84f4044210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8500003a10 tx=0x7f8500009290 comp rx=0 tx=0).stop 2024-05-12T10:58:18.414 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 msgr2=0x7f850c19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c19cd90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f84fc011ac0 tx=0x7f84fc011ba0 comp rx=0 tx=0).stop 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 shutdown_connections 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f84f4041e20 0x7f84f4044210 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f850c109910 0x7f850c19cd90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 --2- 172.21.15.86:0/1259186775 >> [v2:172.21.15.86:6800/1257416774,v1:172.21.15.86:6801/1257416774] conn(0x7f84f403e530 0x7f84f40409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 >> 172.21.15.86:0/1259186775 conn(0x7f850c1032c0 msgr2=0x7f850c103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 shutdown_connections 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:17.850+0000 7f8511067700 1 -- 172.21.15.86:0/1259186775 wait complete. 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:mgr epoch 5 is available 2024-05-12T10:58:18.415 INFO:teuthology.orchestra.run.smithi086.stdout:Setting orchestrator backend to cephadm... 2024-05-12T10:58:19.120 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:18 smithi086 ceph-mon[30110]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-12T10:58:19.120 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:18 smithi086 ceph-mon[30110]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-12T10:58:19.121 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:18 smithi086 ceph-mon[30110]: [12/May/2024:10:58:17] ENGINE Serving on https://172.21.15.86:7150 2024-05-12T10:58:19.121 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:18 smithi086 ceph-mon[30110]: [12/May/2024:10:58:17] ENGINE Bus STARTED 2024-05-12T10:58:19.121 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:18 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.903+0000 7f6b92c30700 1 Processor -- start 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.903+0000 7f6b92c30700 1 -- start start 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b92c30700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c109250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b92c30700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c109790 con 0x7f6b8c108e30 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b909cc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b909cc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38440/0 (socket says 172.21.15.86:38440) 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b909cc700 1 -- 172.21.15.86:0/1811819076 learned_addr learned my addr 172.21.15.86:0/1811819076 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b909cc700 1 -- 172.21.15.86:0/1811819076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c109f90 con 0x7f6b8c108e30 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b909cc700 1 --2- 172.21.15.86:0/1811819076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c109250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b800098a0 tx=0x7f6b80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacf347be7c35c3e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:19.755 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b8b7fe700 1 -- 172.21.15.86:0/1811819076 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b80004160 con 0x7f6b8c108e30 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b8b7fe700 1 -- 172.21.15.86:0/1811819076 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6b80004300 con 0x7f6b8c108e30 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.904+0000 7f6b8b7fe700 1 -- 172.21.15.86:0/1811819076 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b80011af0 con 0x7f6b8c108e30 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.905+0000 7f6b92c30700 1 -- 172.21.15.86:0/1811819076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 msgr2=0x7f6b8c109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.905+0000 7f6b92c30700 1 --2- 172.21.15.86:0/1811819076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c109250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b800098a0 tx=0x7f6b80009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.905+0000 7f6b92c30700 1 -- 172.21.15.86:0/1811819076 shutdown_connections 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.905+0000 7f6b92c30700 1 --2- 172.21.15.86:0/1811819076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c109250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.905+0000 7f6b92c30700 1 -- 172.21.15.86:0/1811819076 >> 172.21.15.86:0/1811819076 conn(0x7f6b8c104410 msgr2=0x7f6b8c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.905+0000 7f6b92c30700 1 -- 172.21.15.86:0/1811819076 shutdown_connections 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.905+0000 7f6b92c30700 1 -- 172.21.15.86:0/1811819076 wait complete. 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b92c30700 1 Processor -- start 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b92c30700 1 -- start start 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b92c30700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b92c30700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c10d3d0 con 0x7f6b8c108e30 2024-05-12T10:58:19.756 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b909cc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b909cc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38452/0 (socket says 172.21.15.86:38452) 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b909cc700 1 -- 172.21.15.86:0/2952437043 learned_addr learned my addr 172.21.15.86:0/2952437043 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b909cc700 1 -- 172.21.15.86:0/2952437043 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c19d360 con 0x7f6b8c108e30 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b909cc700 1 --2- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c19ce20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6b80011ac0 tx=0x7f6b80011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b89ffb700 1 -- 172.21.15.86:0/2952437043 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b80003b20 con 0x7f6b8c108e30 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b89ffb700 1 -- 172.21.15.86:0/2952437043 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6b8001a8c0 con 0x7f6b8c108e30 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b89ffb700 1 -- 172.21.15.86:0/2952437043 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b800248d0 con 0x7f6b8c108e30 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.906+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8c19d5f0 con 0x7f6b8c108e30 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.907+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8c19dfd0 con 0x7f6b8c108e30 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.908+0000 7f6b89ffb700 1 -- 172.21.15.86:0/2952437043 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f6b80022020 con 0x7f6b8c108e30 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.908+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b8c064b00 con 0x7f6b8c108e30 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.908+0000 7f6b89ffb700 1 --2- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6b7c03e580 0x7f6b7c040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:19.757 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.908+0000 7f6b89ffb700 1 -- 172.21.15.86:0/2952437043 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6b80053800 con 0x7f6b8c108e30 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.908+0000 7f6b8bfff700 1 --2- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6b7c03e580 0x7f6b7c040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.908+0000 7f6b8bfff700 1 --2- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6b7c03e580 0x7f6b7c040a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b78006fd0 tx=0x7f6b78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:18.913+0000 7f6b89ffb700 1 -- 172.21.15.86:0/2952437043 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6b8001ab20 con 0x7f6b8c108e30 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.128+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f6b8c105510 con 0x7f6b7c03e580 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.133+0000 7f6b89ffb700 1 -- 172.21.15.86:0/2952437043 <== mgr.14120 v2:172.21.15.86:6800/3515811906 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6b8c105510 con 0x7f6b7c03e580 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.135+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6b7c03e580 msgr2=0x7f6b7c040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.135+0000 7f6b92c30700 1 --2- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6b7c03e580 0x7f6b7c040a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b78006fd0 tx=0x7f6b78006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.135+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 msgr2=0x7f6b8c19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.135+0000 7f6b92c30700 1 --2- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c19ce20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6b80011ac0 tx=0x7f6b80011ba0 comp rx=0 tx=0).stop 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.135+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 shutdown_connections 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.135+0000 7f6b92c30700 1 --2- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6b7c03e580 0x7f6b7c040a40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.135+0000 7f6b92c30700 1 --2- 172.21.15.86:0/2952437043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8c108e30 0x7f6b8c19ce20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.135+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 >> 172.21.15.86:0/2952437043 conn(0x7f6b8c104410 msgr2=0x7f6b8c104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:19.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.136+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 shutdown_connections 2024-05-12T10:58:19.759 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:19.136+0000 7f6b92c30700 1 -- 172.21.15.86:0/2952437043 wait complete. 2024-05-12T10:58:20.099 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:19 smithi086 ceph-mon[30110]: mgrmap e8: x(active, since 2s) 2024-05-12T10:58:20.100 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:19 smithi086 ceph-mon[30110]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:20.100 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:19 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:20.100 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:19 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:58:21.078 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:20 smithi086 ceph-mon[30110]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:21.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-12T10:58:21.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.207+0000 7fd211cb3700 1 Processor -- start 2024-05-12T10:58:21.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.207+0000 7fd211cb3700 1 -- start start 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd211cb3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c108150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd211cb3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c108720 con 0x7fd20c107d30 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd20b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c108150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd20b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c108150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38460/0 (socket says 172.21.15.86:38460) 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd20b7fe700 1 -- 172.21.15.86:0/552785150 learned_addr learned my addr 172.21.15.86:0/552785150 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd20b7fe700 1 -- 172.21.15.86:0/552785150 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c108f30 con 0x7fd20c107d30 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd20b7fe700 1 --2- 172.21.15.86:0/552785150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c108150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd2000098a0 tx=0x7fd200009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1803a63ecf20a57f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd20a7fc700 1 -- 172.21.15.86:0/552785150 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd200004160 con 0x7fd20c107d30 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd20a7fc700 1 -- 172.21.15.86:0/552785150 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd200004300 con 0x7fd20c107d30 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.208+0000 7fd20a7fc700 1 -- 172.21.15.86:0/552785150 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd200011af0 con 0x7fd20c107d30 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.209+0000 7fd211cb3700 1 -- 172.21.15.86:0/552785150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 msgr2=0x7fd20c108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.209+0000 7fd211cb3700 1 --2- 172.21.15.86:0/552785150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c108150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd2000098a0 tx=0x7fd200009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:21.087 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.209+0000 7fd211cb3700 1 -- 172.21.15.86:0/552785150 shutdown_connections 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.209+0000 7fd211cb3700 1 --2- 172.21.15.86:0/552785150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c108150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.209+0000 7fd211cb3700 1 -- 172.21.15.86:0/552785150 >> 172.21.15.86:0/552785150 conn(0x7fd20c103310 msgr2=0x7fd20c105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.209+0000 7fd211cb3700 1 -- 172.21.15.86:0/552785150 shutdown_connections 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.209+0000 7fd211cb3700 1 -- 172.21.15.86:0/552785150 wait complete. 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.210+0000 7fd211cb3700 1 Processor -- start 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.210+0000 7fd211cb3700 1 -- start start 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.210+0000 7fd211cb3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c192ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.210+0000 7fd211cb3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c10c2e0 con 0x7fd20c107d30 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.210+0000 7fd20b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c192ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.210+0000 7fd20b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c192ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38468/0 (socket says 172.21.15.86:38468) 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.210+0000 7fd20b7fe700 1 -- 172.21.15.86:0/1796902307 learned_addr learned my addr 172.21.15.86:0/1796902307 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.210+0000 7fd20b7fe700 1 -- 172.21.15.86:0/1796902307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c1933e0 con 0x7fd20c107d30 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.211+0000 7fd20b7fe700 1 --2- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c192ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd200003f40 tx=0x7fd200011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:21.088 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.211+0000 7fd208ff9700 1 -- 172.21.15.86:0/1796902307 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2000038b0 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.211+0000 7fd208ff9700 1 -- 172.21.15.86:0/1796902307 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd200003a50 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.211+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c1915d0 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.211+0000 7fd208ff9700 1 -- 172.21.15.86:0/1796902307 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20001a5c0 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.211+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c191b10 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.212+0000 7fd208ff9700 1 -- 172.21.15.86:0/1796902307 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fd200024430 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.212+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c06a5d0 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.212+0000 7fd208ff9700 1 --2- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fd1f403e530 0x7fd1f40409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.212+0000 7fd208ff9700 1 -- 172.21.15.86:0/1796902307 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd2000539f0 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.212+0000 7fd20affd700 1 --2- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fd1f403e530 0x7fd1f40409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.213+0000 7fd20affd700 1 --2- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fd1f403e530 0x7fd1f40409f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc006fd0 tx=0x7fd1fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.217+0000 7fd208ff9700 1 -- 172.21.15.86:0/1796902307 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd200019de0 con 0x7fd20c107d30 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.423+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fd20c196c90 con 0x7fd1f403e530 2024-05-12T10:58:21.089 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.423+0000 7fd208ff9700 1 -- 172.21.15.86:0/1796902307 <== mgr.14120 v2:172.21.15.86:6800/3515811906 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fd20c196c90 con 0x7fd1f403e530 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.425+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fd1f403e530 msgr2=0x7fd1f40409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.425+0000 7fd211cb3700 1 --2- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fd1f403e530 0x7fd1f40409f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc006fd0 tx=0x7fd1fc006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.426+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 msgr2=0x7fd20c192ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.426+0000 7fd211cb3700 1 --2- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c192ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd200003f40 tx=0x7fd200011890 comp rx=0 tx=0).stop 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.426+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 shutdown_connections 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.426+0000 7fd211cb3700 1 --2- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fd1f403e530 0x7fd1f40409f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.426+0000 7fd211cb3700 1 --2- 172.21.15.86:0/1796902307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd20c107d30 0x7fd20c192ea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.426+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 >> 172.21.15.86:0/1796902307 conn(0x7fd20c103310 msgr2=0x7fd20c1040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.426+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 shutdown_connections 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:20.426+0000 7fd211cb3700 1 -- 172.21.15.86:0/1796902307 wait complete. 2024-05-12T10:58:21.090 INFO:teuthology.orchestra.run.smithi086.stdout:Generating ssh key... 2024-05-12T10:58:22.158 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:21 smithi086 ceph-mon[30110]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:22.158 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:21 smithi086 ceph-mon[30110]: Generating ssh key... 2024-05-12T10:58:22.159 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:21 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:22.159 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:21 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:22.159 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: Generating public/private rsa key pair. 2024-05-12T10:58:22.159 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: Your identification has been saved in /tmp/tmp6ogq4kj8/key. 2024-05-12T10:58:22.159 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: Your public key has been saved in /tmp/tmp6ogq4kj8/key.pub. 2024-05-12T10:58:22.159 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: The key fingerprint is: 2024-05-12T10:58:22.159 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: SHA256:SG2n0fGr/o5v95GC29R83iTgVfv8u87yQfbviCNR/EA ceph-513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:58:22.159 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: The key's randomart image is: 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: +---[RSA 3072]----+ 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | . | 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | . . oE | 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | . + oo. .| 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | . o + +. ..| 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | . S .oo.+ | 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | .o.o*.+| 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | .o.o.**| 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | ...*o+=B| 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: | oB=+=OX| 2024-05-12T10:58:22.160 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: +----[SHA256]-----+ 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.509+0000 7fa522680700 1 Processor -- start 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.509+0000 7fa522680700 1 -- start start 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.509+0000 7fa522680700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c107580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.509+0000 7fa522680700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c107b50 con 0x7fa51c107160 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.509+0000 7fa51bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.509+0000 7fa51bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c107580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34598/0 (socket says 172.21.15.86:34598) 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.509+0000 7fa51bfff700 1 -- 172.21.15.86:0/3263288791 learned_addr learned my addr 172.21.15.86:0/3263288791 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.510+0000 7fa51bfff700 1 -- 172.21.15.86:0/3263288791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c10a0f0 con 0x7fa51c107160 2024-05-12T10:58:22.459 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.510+0000 7fa51bfff700 1 --2- 172.21.15.86:0/3263288791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c107580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0098a0 tx=0x7fa50c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dfd2a02f7ed44a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.510+0000 7fa51affd700 1 -- 172.21.15.86:0/3263288791 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa50c004160 con 0x7fa51c107160 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.510+0000 7fa51affd700 1 -- 172.21.15.86:0/3263288791 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa50c004300 con 0x7fa51c107160 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.510+0000 7fa51affd700 1 -- 172.21.15.86:0/3263288791 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa50c011af0 con 0x7fa51c107160 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.510+0000 7fa522680700 1 -- 172.21.15.86:0/3263288791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 msgr2=0x7fa51c107580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.510+0000 7fa522680700 1 --2- 172.21.15.86:0/3263288791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c107580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0098a0 tx=0x7fa50c009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.511+0000 7fa522680700 1 -- 172.21.15.86:0/3263288791 shutdown_connections 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.511+0000 7fa522680700 1 --2- 172.21.15.86:0/3263288791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c107580 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.511+0000 7fa522680700 1 -- 172.21.15.86:0/3263288791 >> 172.21.15.86:0/3263288791 conn(0x7fa51c102ab0 msgr2=0x7fa51c104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.511+0000 7fa522680700 1 -- 172.21.15.86:0/3263288791 shutdown_connections 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.511+0000 7fa522680700 1 -- 172.21.15.86:0/3263288791 wait complete. 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.511+0000 7fa522680700 1 Processor -- start 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.511+0000 7fa522680700 1 -- start start 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa522680700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c109b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa522680700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c10d4a0 con 0x7fa51c107160 2024-05-12T10:58:22.460 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa51bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa51bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34610/0 (socket says 172.21.15.86:34610) 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa51bfff700 1 -- 172.21.15.86:0/2855717320 learned_addr learned my addr 172.21.15.86:0/2855717320 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa51bfff700 1 -- 172.21.15.86:0/2855717320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c1080a0 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa51bfff700 1 --2- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c109b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa50c003f40 tx=0x7fa50c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa5197fa700 1 -- 172.21.15.86:0/2855717320 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa50c0038b0 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa5197fa700 1 -- 172.21.15.86:0/2855717320 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa50c003a50 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa5197fa700 1 -- 172.21.15.86:0/2855717320 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa50c01a5c0 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c108330 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.512+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c108810 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.513+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51c064b00 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.513+0000 7fa5197fa700 1 -- 172.21.15.86:0/2855717320 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fa50c01a870 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.513+0000 7fa5197fa700 1 --2- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa50403e530 0x7fa5040409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.513+0000 7fa5197fa700 1 -- 172.21.15.86:0/2855717320 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa50c053a00 con 0x7fa51c107160 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.514+0000 7fa51b7fe700 1 --2- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa50403e530 0x7fa5040409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:22.461 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.514+0000 7fa51b7fe700 1 --2- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa50403e530 0x7fa5040409f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa510006fd0 tx=0x7fa510006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.518+0000 7fa5197fa700 1 -- 172.21.15.86:0/2855717320 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa50c0172b0 con 0x7fa51c107160 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.722+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa51c108e30 con 0x7fa50403e530 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.858+0000 7fa5197fa700 1 -- 172.21.15.86:0/2855717320 <== mgr.14120 v2:172.21.15.86:6800/3515811906 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa51c108e30 con 0x7fa50403e530 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa50403e530 msgr2=0x7fa5040409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 --2- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa50403e530 0x7fa5040409f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa510006fd0 tx=0x7fa510006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 msgr2=0x7fa51c109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 --2- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c109b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa50c003f40 tx=0x7fa50c011890 comp rx=0 tx=0).stop 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 shutdown_connections 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 --2- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa50403e530 0x7fa5040409f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 --2- 172.21.15.86:0/2855717320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c107160 0x7fa51c109b50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 >> 172.21.15.86:0/2855717320 conn(0x7fa51c102ab0 msgr2=0x7fa51c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 shutdown_connections 2024-05-12T10:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:21.860+0000 7fa522680700 1 -- 172.21.15.86:0/2855717320 wait complete. 2024-05-12T10:58:23.590 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjEhvJIzG1hTRCccWH1PH0Hge7eaQrJ1nq+Qjw21BrPyIpR9CPpy2+F1yNauwQ1izX6jBVtKP4hHPizthGUv63qCo7YXEn0BDdqcjp7Ux2L21N/9FzJ+0n1nbo2AhSEQIvLT5pcWb3qT8L/GX6b7U+cW99bZ7vKmh/k+F+3ou86srwKdNNAHMsKm6jk6sn81w8CcAp/iCz91F6knLW4eCQLLkHV3Gs+Hf3CdcnOBb86g9e+IkYL6zGu3319OMrcS5A2e49jhzd9F2Jj/bnIsMWpBrNKvIneNbCtFlm6rBA7Ks8oPI4V+iVP0zGwYlWleEIGeDNs11JK7rpBLhD5F/DKgCPwzV3/Mo93Ym1d7sNZPhTqziGqLE/Z0TI1dIWeYYgdwRYj9Lf/vcaOAvYX1vXcILb6z1c3ovQ6XFbzy2lwWkX+CQhnm45k3HOFpNeG8ib4twRl3l7D9z1Wz5xRzNhf51PT3+PEPK7JdpuacaZqlzqbhAk6lycTwhHLurZtYE= ceph-513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:58:23.590 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.889+0000 7f79084f1700 1 Processor -- start 2024-05-12T10:58:23.590 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.889+0000 7f79084f1700 1 -- start start 2024-05-12T10:58:23.590 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.889+0000 7f79084f1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790010bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:23.590 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.889+0000 7f79084f1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f790007d6c0 con 0x7f7900109900 2024-05-12T10:58:23.590 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.889+0000 7f790628d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790010bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:23.590 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.889+0000 7f790628d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790010bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34616/0 (socket says 172.21.15.86:34616) 2024-05-12T10:58:23.590 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.889+0000 7f790628d700 1 -- 172.21.15.86:0/3630120692 learned_addr learned my addr 172.21.15.86:0/3630120692 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.889+0000 7f790628d700 1 -- 172.21.15.86:0/3630120692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790010c230 con 0x7f7900109900 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f790628d700 1 --2- 172.21.15.86:0/3630120692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790010bcf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098a0 tx=0x7f78fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3369a1656a204fe0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f790528b700 1 -- 172.21.15.86:0/3630120692 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78fc004160 con 0x7f7900109900 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f790528b700 1 -- 172.21.15.86:0/3630120692 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f78fc004300 con 0x7f7900109900 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f790528b700 1 -- 172.21.15.86:0/3630120692 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78fc011af0 con 0x7f7900109900 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f79084f1700 1 -- 172.21.15.86:0/3630120692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 msgr2=0x7f790010bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f79084f1700 1 --2- 172.21.15.86:0/3630120692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790010bcf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098a0 tx=0x7f78fc009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f79084f1700 1 -- 172.21.15.86:0/3630120692 shutdown_connections 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f79084f1700 1 --2- 172.21.15.86:0/3630120692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790010bcf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f79084f1700 1 -- 172.21.15.86:0/3630120692 >> 172.21.15.86:0/3630120692 conn(0x7f7900103310 msgr2=0x7f7900105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.890+0000 7f79084f1700 1 -- 172.21.15.86:0/3630120692 shutdown_connections 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.891+0000 7f79084f1700 1 -- 172.21.15.86:0/3630120692 wait complete. 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.891+0000 7f79084f1700 1 Processor -- start 2024-05-12T10:58:23.591 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.891+0000 7f79084f1700 1 -- start start 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.891+0000 7f79084f1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.891+0000 7f79084f1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f790010d1a0 con 0x7f7900109900 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.891+0000 7f790628d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.891+0000 7f790628d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34618/0 (socket says 172.21.15.86:34618) 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.891+0000 7f790628d700 1 -- 172.21.15.86:0/1709997693 learned_addr learned my addr 172.21.15.86:0/1709997693 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.892+0000 7f790628d700 1 -- 172.21.15.86:0/1709997693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790019d350 con 0x7f7900109900 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.892+0000 7f790628d700 1 --2- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790019ce10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f78fc011ac0 tx=0x7f78fc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.892+0000 7f78f37fe700 1 -- 172.21.15.86:0/1709997693 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78fc003b20 con 0x7f7900109900 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.892+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790019d5e0 con 0x7f7900109900 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.892+0000 7f78f37fe700 1 -- 172.21.15.86:0/1709997693 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f78fc01a8c0 con 0x7f7900109900 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.892+0000 7f78f37fe700 1 -- 172.21.15.86:0/1709997693 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78fc0248d0 con 0x7f7900109900 2024-05-12T10:58:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.892+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790019dfc0 con 0x7f7900109900 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.893+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7900064b00 con 0x7f7900109900 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.893+0000 7f78f37fe700 1 -- 172.21.15.86:0/1709997693 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f78fc022020 con 0x7f7900109900 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.894+0000 7f78f37fe700 1 --2- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f78ec03e530 0x7f78ec0409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.894+0000 7f78f37fe700 1 -- 172.21.15.86:0/1709997693 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f78fc053ca0 con 0x7f7900109900 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.894+0000 7f7905a8c700 1 --2- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f78ec03e530 0x7f78ec0409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.894+0000 7f7905a8c700 1 --2- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f78ec03e530 0x7f78ec0409f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78f4006fd0 tx=0x7f78f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:22.898+0000 7f78f37fe700 1 -- 172.21.15.86:0/1709997693 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f78fc01aa70 con 0x7f7900109900 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.102+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f7900104470 con 0x7f78ec03e530 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.103+0000 7f78f37fe700 1 -- 172.21.15.86:0/1709997693 <== mgr.14120 v2:172.21.15.86:6800/3515811906 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f7900104470 con 0x7f78ec03e530 2024-05-12T10:58:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f78ec03e530 msgr2=0x7f78ec0409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 --2- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f78ec03e530 0x7f78ec0409f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78f4006fd0 tx=0x7f78f4006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 msgr2=0x7f790019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 --2- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790019ce10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f78fc011ac0 tx=0x7f78fc011ba0 comp rx=0 tx=0).stop 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 shutdown_connections 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 --2- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f78ec03e530 0x7f78ec0409f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 --2- 172.21.15.86:0/1709997693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900109900 0x7f790019ce10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 >> 172.21.15.86:0/1709997693 conn(0x7f7900103310 msgr2=0x7f7900103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.105+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 shutdown_connections 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:23.106+0000 7f79084f1700 1 -- 172.21.15.86:0/1709997693 wait complete. 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:Adding key to root@localhost authorized_keys... 2024-05-12T10:58:23.594 INFO:teuthology.orchestra.run.smithi086.stdout:Adding host smithi086... 2024-05-12T10:58:24.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:23 smithi086 ceph-mon[30110]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:25.079 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:24 smithi086 ceph-mon[30110]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi086", "addr": "172.21.15.86", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:25.079 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:24 smithi086 ceph-mon[30110]: Deploying cephadm binary to smithi086 2024-05-12T10:58:28.847 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout Added host 'smithi086' with addr '172.21.15.86' 2024-05-12T10:58:28.847 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.018+0000 7f3af2954700 1 Processor -- start 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3af2954700 1 -- start start 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3af2954700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec108170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3af2954700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec108740 con 0x7f3aec107d50 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3aebfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3aebfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec108170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34626/0 (socket says 172.21.15.86:34626) 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3aebfff700 1 -- 172.21.15.86:0/806057728 learned_addr learned my addr 172.21.15.86:0/806057728 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3aebfff700 1 -- 172.21.15.86:0/806057728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec108f50 con 0x7f3aec107d50 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3aebfff700 1 --2- 172.21.15.86:0/806057728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec108170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0098a0 tx=0x7f3adc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c28ae0554d17967 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.019+0000 7f3aeb7fe700 1 -- 172.21.15.86:0/806057728 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3adc004160 con 0x7f3aec107d50 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3aeb7fe700 1 -- 172.21.15.86:0/806057728 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3adc004300 con 0x7f3aec107d50 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3aeb7fe700 1 -- 172.21.15.86:0/806057728 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3adc011af0 con 0x7f3aec107d50 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3af2954700 1 -- 172.21.15.86:0/806057728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 msgr2=0x7f3aec108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.848 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3af2954700 1 --2- 172.21.15.86:0/806057728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec108170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0098a0 tx=0x7f3adc009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3af2954700 1 -- 172.21.15.86:0/806057728 shutdown_connections 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3af2954700 1 --2- 172.21.15.86:0/806057728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec108170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3af2954700 1 -- 172.21.15.86:0/806057728 >> 172.21.15.86:0/806057728 conn(0x7f3aec1032b0 msgr2=0x7f3aec105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3af2954700 1 -- 172.21.15.86:0/806057728 shutdown_connections 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.020+0000 7f3af2954700 1 -- 172.21.15.86:0/806057728 wait complete. 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.021+0000 7f3af2954700 1 Processor -- start 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.021+0000 7f3af2954700 1 -- start start 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.021+0000 7f3af2954700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.021+0000 7f3af2954700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec10c300 con 0x7f3aec107d50 2024-05-12T10:58:28.849 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.021+0000 7f3aebfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.021+0000 7f3aebfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34636/0 (socket says 172.21.15.86:34636) 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.021+0000 7f3aebfff700 1 -- 172.21.15.86:0/2016823493 learned_addr learned my addr 172.21.15.86:0/2016823493 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.021+0000 7f3aebfff700 1 -- 172.21.15.86:0/2016823493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec19d400 con 0x7f3aec107d50 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.022+0000 7f3aebfff700 1 --2- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec19cec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009fb0 tx=0x7f3adc011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.022+0000 7f3ae9ffb700 1 -- 172.21.15.86:0/2016823493 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3adc0036a0 con 0x7f3aec107d50 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.022+0000 7f3ae9ffb700 1 -- 172.21.15.86:0/2016823493 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3adc01a430 con 0x7f3aec107d50 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.022+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aec19d690 con 0x7f3aec107d50 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.022+0000 7f3ae9ffb700 1 -- 172.21.15.86:0/2016823493 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3adc019550 con 0x7f3aec107d50 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.022+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aec19e1b0 con 0x7f3aec107d50 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.023+0000 7f3ae9ffb700 1 -- 172.21.15.86:0/2016823493 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f3adc01a8e0 con 0x7f3aec107d50 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.023+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aec064b00 con 0x7f3aec107d50 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.023+0000 7f3ae9ffb700 1 --2- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ad803e4e0 0x7f3ad80409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:28.850 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.023+0000 7f3ae9ffb700 1 -- 172.21.15.86:0/2016823493 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3adc053870 con 0x7f3aec107d50 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.023+0000 7f3ae3fff700 1 --2- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ad803e4e0 0x7f3ad80409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.023+0000 7f3ae3fff700 1 --2- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ad803e4e0 0x7f3ad80409a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4006fd0 tx=0x7f3ad4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.028+0000 7f3ae9ffb700 1 -- 172.21.15.86:0/2016823493 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3adc00b3e0 con 0x7f3aec107d50 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:24.236+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi086", "addr": "172.21.15.86", "target": ["mon-mgr", ""]}) -- 0x7f3aec19ef00 con 0x7f3ad803e4e0 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.310+0000 7f3ae9ffb700 1 -- 172.21.15.86:0/2016823493 <== mgr.14120 v2:172.21.15.86:6800/3515811906 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3aec19ef00 con 0x7f3ad803e4e0 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ad803e4e0 msgr2=0x7f3ad80409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 --2- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ad803e4e0 0x7f3ad80409a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4006fd0 tx=0x7f3ad4006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 msgr2=0x7f3aec19cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 --2- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec19cec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009fb0 tx=0x7f3adc011940 comp rx=0 tx=0).stop 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 shutdown_connections 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 --2- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ad803e4e0 0x7f3ad80409a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 --2- 172.21.15.86:0/2016823493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec107d50 0x7f3aec19cec0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 >> 172.21.15.86:0/2016823493 conn(0x7f3aec1032b0 msgr2=0x7f3aec104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:28.851 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 shutdown_connections 2024-05-12T10:58:28.852 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:28.313+0000 7f3af2954700 1 -- 172.21.15.86:0/2016823493 wait complete. 2024-05-12T10:58:28.852 INFO:teuthology.orchestra.run.smithi086.stdout:Deploying unmanaged mon service... 2024-05-12T10:58:29.520 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:29 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:29.520 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:29 smithi086 ceph-mon[30110]: Added host smithi086 2024-05-12T10:58:29.520 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:29 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:58:30.126 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-12T10:58:30.126 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.279+0000 7f5e17909700 1 Processor -- start 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.279+0000 7f5e17909700 1 -- start start 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.280+0000 7f5e17909700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e10109300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.280+0000 7f5e17909700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5e10109840 con 0x7f5e10108ee0 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.280+0000 7f5e156a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e10109300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.280+0000 7f5e156a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e10109300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34640/0 (socket says 172.21.15.86:34640) 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.280+0000 7f5e156a5700 1 -- 172.21.15.86:0/2424642848 learned_addr learned my addr 172.21.15.86:0/2424642848 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.280+0000 7f5e156a5700 1 -- 172.21.15.86:0/2424642848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e10109fa0 con 0x7f5e10108ee0 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.280+0000 7f5e156a5700 1 --2- 172.21.15.86:0/2424642848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e10109300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0098a0 tx=0x7f5e0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f7afde7a996ffd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:30.131 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e07fff700 1 -- 172.21.15.86:0/2424642848 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e0c004160 con 0x7f5e10108ee0 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e07fff700 1 -- 172.21.15.86:0/2424642848 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5e0c004300 con 0x7f5e10108ee0 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e07fff700 1 -- 172.21.15.86:0/2424642848 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e0c011af0 con 0x7f5e10108ee0 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e17909700 1 -- 172.21.15.86:0/2424642848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 msgr2=0x7f5e10109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e17909700 1 --2- 172.21.15.86:0/2424642848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e10109300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0098a0 tx=0x7f5e0c009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e17909700 1 -- 172.21.15.86:0/2424642848 shutdown_connections 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e17909700 1 --2- 172.21.15.86:0/2424642848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e10109300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e17909700 1 -- 172.21.15.86:0/2424642848 >> 172.21.15.86:0/2424642848 conn(0x7f5e101044a0 msgr2=0x7f5e101068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e17909700 1 -- 172.21.15.86:0/2424642848 shutdown_connections 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.281+0000 7f5e17909700 1 -- 172.21.15.86:0/2424642848 wait complete. 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.282+0000 7f5e17909700 1 Processor -- start 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.282+0000 7f5e17909700 1 -- start start 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.282+0000 7f5e17909700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e1019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.282+0000 7f5e17909700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1010d3e0 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.282+0000 7f5e156a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e1019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.282+0000 7f5e156a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e1019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34650/0 (socket says 172.21.15.86:34650) 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.282+0000 7f5e156a5700 1 -- 172.21.15.86:0/2322902405 learned_addr learned my addr 172.21.15.86:0/2322902405 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.282+0000 7f5e156a5700 1 -- 172.21.15.86:0/2322902405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1019d3f0 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.283+0000 7f5e156a5700 1 --2- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e1019ceb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009fb0 tx=0x7f5e0c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.283+0000 7f5e067fc700 1 -- 172.21.15.86:0/2322902405 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e0c0036a0 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.283+0000 7f5e067fc700 1 -- 172.21.15.86:0/2322902405 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5e0c01a430 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.283+0000 7f5e067fc700 1 -- 172.21.15.86:0/2322902405 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e0c019550 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.283+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1019d680 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.283+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e1019e060 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.284+0000 7f5e067fc700 1 -- 172.21.15.86:0/2322902405 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f5e0c01a8e0 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.284+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e10064b00 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.284+0000 7f5e067fc700 1 --2- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5dfc03e4e0 0x7f5dfc0409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.284+0000 7f5e067fc700 1 -- 172.21.15.86:0/2322902405 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e0c053840 con 0x7f5e10108ee0 2024-05-12T10:58:30.133 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.284+0000 7f5e14ea4700 1 --2- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5dfc03e4e0 0x7f5dfc0409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.284+0000 7f5e14ea4700 1 --2- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5dfc03e4e0 0x7f5dfc0409a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5e00006fd0 tx=0x7f5e00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.289+0000 7f5e067fc700 1 -- 172.21.15.86:0/2322902405 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5e0c00b3e0 con 0x7f5e10108ee0 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.507+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f5e10105670 con 0x7f5dfc03e4e0 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.515+0000 7f5e067fc700 1 -- 172.21.15.86:0/2322902405 <== mgr.14120 v2:172.21.15.86:6800/3515811906 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5e10105670 con 0x7f5dfc03e4e0 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.517+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5dfc03e4e0 msgr2=0x7f5dfc0409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.517+0000 7f5e17909700 1 --2- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5dfc03e4e0 0x7f5dfc0409a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5e00006fd0 tx=0x7f5e00006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.517+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 msgr2=0x7f5e1019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.517+0000 7f5e17909700 1 --2- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e1019ceb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009fb0 tx=0x7f5e0c011940 comp rx=0 tx=0).stop 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.517+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 shutdown_connections 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.517+0000 7f5e17909700 1 --2- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5dfc03e4e0 0x7f5dfc0409a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.134 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.517+0000 7f5e17909700 1 --2- 172.21.15.86:0/2322902405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10108ee0 0x7f5e1019ceb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:30.135 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.517+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 >> 172.21.15.86:0/2322902405 conn(0x7f5e101044a0 msgr2=0x7f5e10104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:30.135 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.518+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 shutdown_connections 2024-05-12T10:58:30.135 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:29.518+0000 7f5e17909700 1 -- 172.21.15.86:0/2322902405 wait complete. 2024-05-12T10:58:30.135 INFO:teuthology.orchestra.run.smithi086.stdout:Deploying unmanaged mgr service... 2024-05-12T10:58:30.703 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:30 smithi086 ceph-mon[30110]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:30.704 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:30 smithi086 ceph-mon[30110]: Saving service mon spec with placement count:5 2024-05-12T10:58:30.704 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:30 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:32.185 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-12T10:58:32.185 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.208+0000 7f6db111a700 1 Processor -- start 2024-05-12T10:58:32.185 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.208+0000 7f6db111a700 1 -- start start 2024-05-12T10:58:32.185 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.208+0000 7f6db111a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac1081a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.208+0000 7f6db111a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac108770 con 0x7f6dac107d80 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.208+0000 7f6daad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac1081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.208+0000 7f6daad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac1081a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34666/0 (socket says 172.21.15.86:34666) 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.208+0000 7f6daad9d700 1 -- 172.21.15.86:0/2664819448 learned_addr learned my addr 172.21.15.86:0/2664819448 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.209+0000 7f6daad9d700 1 -- 172.21.15.86:0/2664819448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac108f80 con 0x7f6dac107d80 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.209+0000 7f6daad9d700 1 --2- 172.21.15.86:0/2664819448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac1081a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6d940098a0 tx=0x7f6d94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0703d424fef49 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.209+0000 7f6da9d9b700 1 -- 172.21.15.86:0/2664819448 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d94004160 con 0x7f6dac107d80 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.209+0000 7f6da9d9b700 1 -- 172.21.15.86:0/2664819448 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6d94004300 con 0x7f6dac107d80 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.209+0000 7f6da9d9b700 1 -- 172.21.15.86:0/2664819448 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d94011af0 con 0x7f6dac107d80 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.209+0000 7f6db111a700 1 -- 172.21.15.86:0/2664819448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 msgr2=0x7f6dac1081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.209+0000 7f6db111a700 1 --2- 172.21.15.86:0/2664819448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac1081a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6d940098a0 tx=0x7f6d94009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.210+0000 7f6db111a700 1 -- 172.21.15.86:0/2664819448 shutdown_connections 2024-05-12T10:58:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.210+0000 7f6db111a700 1 --2- 172.21.15.86:0/2664819448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac1081a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.210+0000 7f6db111a700 1 -- 172.21.15.86:0/2664819448 >> 172.21.15.86:0/2664819448 conn(0x7f6dac103360 msgr2=0x7f6dac105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.210+0000 7f6db111a700 1 -- 172.21.15.86:0/2664819448 shutdown_connections 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.210+0000 7f6db111a700 1 -- 172.21.15.86:0/2664819448 wait complete. 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.211+0000 7f6db111a700 1 Processor -- start 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.211+0000 7f6db111a700 1 -- start start 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.211+0000 7f6db111a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac19f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.211+0000 7f6db111a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac10c330 con 0x7f6dac107d80 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.211+0000 7f6daad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac19f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.211+0000 7f6daad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac19f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34670/0 (socket says 172.21.15.86:34670) 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.211+0000 7f6daad9d700 1 -- 172.21.15.86:0/662269655 learned_addr learned my addr 172.21.15.86:0/662269655 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.211+0000 7f6daad9d700 1 -- 172.21.15.86:0/662269655 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac19f570 con 0x7f6dac107d80 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.212+0000 7f6daad9d700 1 --2- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac19f030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d94003f40 tx=0x7f6d94011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.187 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.212+0000 7f6da3fff700 1 -- 172.21.15.86:0/662269655 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d940038b0 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.212+0000 7f6da3fff700 1 -- 172.21.15.86:0/662269655 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6d94003a50 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.212+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac19f800 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.212+0000 7f6da3fff700 1 -- 172.21.15.86:0/662269655 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9401a5c0 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.212+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac1a0320 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.213+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac064b00 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.213+0000 7f6da3fff700 1 -- 172.21.15.86:0/662269655 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f6d9401a8c0 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.213+0000 7f6da3fff700 1 --2- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6d9803e4e0 0x7f6d980409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.213+0000 7f6da3fff700 1 -- 172.21.15.86:0/662269655 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6d94053a60 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.213+0000 7f6daa59c700 1 --2- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6d9803e4e0 0x7f6d980409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.214+0000 7f6daa59c700 1 --2- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6d9803e4e0 0x7f6d980409a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c006fd0 tx=0x7f6d9c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.218+0000 7f6da3fff700 1 -- 172.21.15.86:0/662269655 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6d9400e260 con 0x7f6dac107d80 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.444+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6dac1a1070 con 0x7f6d9803e4e0 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.448+0000 7f6da3fff700 1 -- 172.21.15.86:0/662269655 <== mgr.14120 v2:172.21.15.86:6800/3515811906 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6dac1a1070 con 0x7f6d9803e4e0 2024-05-12T10:58:32.188 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.450+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6d9803e4e0 msgr2=0x7f6d980409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.450+0000 7f6db111a700 1 --2- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6d9803e4e0 0x7f6d980409a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c006fd0 tx=0x7f6d9c006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.450+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 msgr2=0x7f6dac19f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.450+0000 7f6db111a700 1 --2- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac19f030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d94003f40 tx=0x7f6d94011890 comp rx=0 tx=0).stop 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.450+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 shutdown_connections 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.450+0000 7f6db111a700 1 --2- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f6d9803e4e0 0x7f6d980409a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.450+0000 7f6db111a700 1 --2- 172.21.15.86:0/662269655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6dac107d80 0x7f6dac19f030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.450+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 >> 172.21.15.86:0/662269655 conn(0x7f6dac103360 msgr2=0x7f6dac104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.451+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 shutdown_connections 2024-05-12T10:58:32.189 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:31.451+0000 7f6db111a700 1 -- 172.21.15.86:0/662269655 wait complete. 2024-05-12T10:58:32.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:32 smithi086 ceph-mon[30110]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:32.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:32 smithi086 ceph-mon[30110]: Saving service mgr spec with placement count:2 2024-05-12T10:58:32.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:32 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:32.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:32 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:33.491 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.636+0000 7fa23d57d700 1 Processor -- start 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.636+0000 7fa23d57d700 1 -- start start 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.636+0000 7fa23d57d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa23810bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.636+0000 7fa23d57d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa23807d690 con 0x7fa238109940 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.636+0000 7fa236ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa23810bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.636+0000 7fa236ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa23810bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34400/0 (socket says 172.21.15.86:34400) 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.637+0000 7fa236ffd700 1 -- 172.21.15.86:0/484842615 learned_addr learned my addr 172.21.15.86:0/484842615 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.637+0000 7fa236ffd700 1 -- 172.21.15.86:0/484842615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23810c270 con 0x7fa238109940 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.637+0000 7fa236ffd700 1 --2- 172.21.15.86:0/484842615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa23810bd30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0098a0 tx=0x7fa22c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde34ea3d4f60b16 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.637+0000 7fa235ffb700 1 -- 172.21.15.86:0/484842615 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa22c004160 con 0x7fa238109940 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.637+0000 7fa235ffb700 1 -- 172.21.15.86:0/484842615 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa22c004300 con 0x7fa238109940 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.637+0000 7fa235ffb700 1 -- 172.21.15.86:0/484842615 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa22c011a20 con 0x7fa238109940 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.638+0000 7fa23d57d700 1 -- 172.21.15.86:0/484842615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 msgr2=0x7fa23810bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.492 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.638+0000 7fa23d57d700 1 --2- 172.21.15.86:0/484842615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa23810bd30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0098a0 tx=0x7fa22c009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.638+0000 7fa23d57d700 1 -- 172.21.15.86:0/484842615 shutdown_connections 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.638+0000 7fa23d57d700 1 --2- 172.21.15.86:0/484842615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa23810bd30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.638+0000 7fa23d57d700 1 -- 172.21.15.86:0/484842615 >> 172.21.15.86:0/484842615 conn(0x7fa238103350 msgr2=0x7fa238105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.638+0000 7fa23d57d700 1 -- 172.21.15.86:0/484842615 shutdown_connections 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.638+0000 7fa23d57d700 1 -- 172.21.15.86:0/484842615 wait complete. 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.638+0000 7fa23d57d700 1 Processor -- start 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.639+0000 7fa23d57d700 1 -- start start 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.639+0000 7fa23d57d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa2381093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.639+0000 7fa23d57d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa23810d210 con 0x7fa238109940 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.639+0000 7fa236ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa2381093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.639+0000 7fa236ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa2381093a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34406/0 (socket says 172.21.15.86:34406) 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.639+0000 7fa236ffd700 1 -- 172.21.15.86:0/3313418753 learned_addr learned my addr 172.21.15.86:0/3313418753 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:33.493 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.639+0000 7fa236ffd700 1 -- 172.21.15.86:0/3313418753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2381078f0 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.639+0000 7fa236ffd700 1 --2- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa2381093a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa22c004660 tx=0x7fa22c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.640+0000 7fa21ffff700 1 -- 172.21.15.86:0/3313418753 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa22c003aa0 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.640+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa238107b80 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.640+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa238108060 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.640+0000 7fa21ffff700 1 -- 172.21.15.86:0/3313418753 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa22c01b8f0 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.640+0000 7fa21ffff700 1 -- 172.21.15.86:0/3313418753 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa22c023900 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.641+0000 7fa21ffff700 1 -- 172.21.15.86:0/3313418753 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fa22c023b70 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.641+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa224005360 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.641+0000 7fa21ffff700 1 --2- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa22003e580 0x7fa220040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.641+0000 7fa21ffff700 1 -- 172.21.15.86:0/3313418753 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa22c053d50 con 0x7fa238109940 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.641+0000 7fa2367fc700 1 --2- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa22003e580 0x7fa220040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.641+0000 7fa2367fc700 1 --2- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa22003e580 0x7fa220040a40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa228006fd0 tx=0x7fa228006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:33.494 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.646+0000 7fa21ffff700 1 -- 172.21.15.86:0/3313418753 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa22c057030 con 0x7fa238109940 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.852+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fa224005650 con 0x7fa238109940 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.857+0000 7fa21ffff700 1 -- 172.21.15.86:0/3313418753 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fa22c01f030 con 0x7fa238109940 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa22003e580 msgr2=0x7fa220040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 --2- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa22003e580 0x7fa220040a40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa228006fd0 tx=0x7fa228006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 msgr2=0x7fa2381093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 --2- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa2381093a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa22c004660 tx=0x7fa22c011aa0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 shutdown_connections 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 --2- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fa22003e580 0x7fa220040a40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 --2- 172.21.15.86:0/3313418753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa238109940 0x7fa2381093a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 >> 172.21.15.86:0/3313418753 conn(0x7fa238103350 msgr2=0x7fa238103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 shutdown_connections 2024-05-12T10:58:33.495 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:32.860+0000 7fa23d57d700 1 -- 172.21.15.86:0/3313418753 wait complete. 2024-05-12T10:58:33.731 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:33 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:33.731 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:33 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3313418753' entity='client.admin' 2024-05-12T10:58:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:35 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3184656526' entity='client.admin' 2024-05-12T10:58:35.243 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.939+0000 7f17fd291700 1 Processor -- start 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.939+0000 7f17fd291700 1 -- start start 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17fd291700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f810bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17fd291700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f17f807ce90 con 0x7f17f81098c0 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17f6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f810bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17f6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f810bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34408/0 (socket says 172.21.15.86:34408) 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17f6ffd700 1 -- 172.21.15.86:0/894360720 learned_addr learned my addr 172.21.15.86:0/894360720 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17f6ffd700 1 -- 172.21.15.86:0/894360720 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f810c1f0 con 0x7f17f81098c0 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17f6ffd700 1 --2- 172.21.15.86:0/894360720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f810bcb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17e00098a0 tx=0x7f17e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497965e5dc3d7873 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17f5ffb700 1 -- 172.21.15.86:0/894360720 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e0004160 con 0x7f17f81098c0 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17f5ffb700 1 -- 172.21.15.86:0/894360720 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e0004300 con 0x7f17f81098c0 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.940+0000 7f17f5ffb700 1 -- 172.21.15.86:0/894360720 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e0011a20 con 0x7f17f81098c0 2024-05-12T10:58:35.244 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.941+0000 7f17fd291700 1 -- 172.21.15.86:0/894360720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 msgr2=0x7f17f810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.941+0000 7f17fd291700 1 --2- 172.21.15.86:0/894360720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f810bcb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17e00098a0 tx=0x7f17e0009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.941+0000 7f17fd291700 1 -- 172.21.15.86:0/894360720 shutdown_connections 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.941+0000 7f17fd291700 1 --2- 172.21.15.86:0/894360720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f810bcb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.941+0000 7f17fd291700 1 -- 172.21.15.86:0/894360720 >> 172.21.15.86:0/894360720 conn(0x7f17f81032b0 msgr2=0x7f17f8105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.941+0000 7f17fd291700 1 -- 172.21.15.86:0/894360720 shutdown_connections 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.941+0000 7f17fd291700 1 -- 172.21.15.86:0/894360720 wait complete. 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17fd291700 1 Processor -- start 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17fd291700 1 -- start start 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17fd291700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17fd291700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f17f810d200 con 0x7f17f81098c0 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17f6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17f6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34414/0 (socket says 172.21.15.86:34414) 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17f6ffd700 1 -- 172.21.15.86:0/3184656526 learned_addr learned my addr 172.21.15.86:0/3184656526 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:35.245 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17f6ffd700 1 -- 172.21.15.86:0/3184656526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f819d340 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.942+0000 7f17f6ffd700 1 --2- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f819ce00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f17e00116e0 tx=0x7f17e0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.943+0000 7f17effff700 1 -- 172.21.15.86:0/3184656526 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e0003b20 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.943+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f819d5d0 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.943+0000 7f17effff700 1 -- 172.21.15.86:0/3184656526 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e001b8f0 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.943+0000 7f17effff700 1 -- 172.21.15.86:0/3184656526 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e00238c0 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.943+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f819e040 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.943+0000 7f17effff700 1 -- 172.21.15.86:0/3184656526 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f17e0023b70 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.944+0000 7f17effff700 1 --2- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f17e403e4e0 0x7f17e40409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.944+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f8064b00 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.944+0000 7f17effff700 1 -- 172.21.15.86:0/3184656526 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f17e0053f70 con 0x7f17f81098c0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.944+0000 7f17f67fc700 1 --2- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f17e403e4e0 0x7f17e40409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.944+0000 7f17f67fc700 1 --2- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f17e403e4e0 0x7f17e40409a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f17e8006fd0 tx=0x7f17e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:35.246 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:33.949+0000 7f17effff700 1 -- 172.21.15.86:0/3184656526 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f17e001f030 con 0x7f17f81098c0 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.173+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f17f819e560 con 0x7f17f81098c0 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.176+0000 7f17effff700 1 -- 172.21.15.86:0/3184656526 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f17e000b3e0 con 0x7f17f81098c0 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f17e403e4e0 msgr2=0x7f17e40409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 --2- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f17e403e4e0 0x7f17e40409a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f17e8006fd0 tx=0x7f17e8006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 msgr2=0x7f17f819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 --2- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f819ce00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f17e00116e0 tx=0x7f17e0011aa0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 shutdown_connections 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 --2- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f17e403e4e0 0x7f17e40409a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 --2- 172.21.15.86:0/3184656526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f81098c0 0x7f17f819ce00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 >> 172.21.15.86:0/3184656526 conn(0x7f17f81032b0 msgr2=0x7f17f8103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 shutdown_connections 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:34.179+0000 7f17fd291700 1 -- 172.21.15.86:0/3184656526 wait complete. 2024-05-12T10:58:35.247 INFO:teuthology.orchestra.run.smithi086.stdout:Enabling the dashboard module... 2024-05-12T10:58:37.034 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:36 smithi086 ceph-mon[30110]: from='mgr.14120 172.21.15.86:0/2732767210' entity='mgr.x' 2024-05-12T10:58:37.034 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:36 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/834314293' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-12T10:58:37.034 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:36 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: ignoring --setuser ceph since I am not root 2024-05-12T10:58:37.034 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:36 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: ignoring --setgroup ceph since I am not root 2024-05-12T10:58:37.034 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:36 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:36.945+0000 7f37fd8d0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T10:58:37.309 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:37 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:37.149+0000 7f37fd8d0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:58:37.310 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:37 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:37.252+0000 7f37fd8d0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.642+0000 7fc515f99700 1 Processor -- start 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.642+0000 7fc515f99700 1 -- start start 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc515f99700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51010bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc515f99700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc51007d6e0 con 0x7fc510109920 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc50f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51010bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc50f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51010bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34420/0 (socket says 172.21.15.86:34420) 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc50f7fe700 1 -- 172.21.15.86:0/3131465662 learned_addr learned my addr 172.21.15.86:0/3131465662 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc50f7fe700 1 -- 172.21.15.86:0/3131465662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51010c250 con 0x7fc510109920 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc50f7fe700 1 --2- 172.21.15.86:0/3131465662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51010bd10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80098a0 tx=0x7fc4f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f394233736f37b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:37.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc50e7fc700 1 -- 172.21.15.86:0/3131465662 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f8004160 con 0x7fc510109920 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc50e7fc700 1 -- 172.21.15.86:0/3131465662 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4f8004300 con 0x7fc510109920 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.643+0000 7fc50e7fc700 1 -- 172.21.15.86:0/3131465662 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f8011a20 con 0x7fc510109920 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.644+0000 7fc515f99700 1 -- 172.21.15.86:0/3131465662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 msgr2=0x7fc51010bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.644+0000 7fc515f99700 1 --2- 172.21.15.86:0/3131465662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51010bd10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80098a0 tx=0x7fc4f8009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.644+0000 7fc515f99700 1 -- 172.21.15.86:0/3131465662 shutdown_connections 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.644+0000 7fc515f99700 1 --2- 172.21.15.86:0/3131465662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51010bd10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.644+0000 7fc515f99700 1 -- 172.21.15.86:0/3131465662 >> 172.21.15.86:0/3131465662 conn(0x7fc510103350 msgr2=0x7fc510105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.644+0000 7fc515f99700 1 -- 172.21.15.86:0/3131465662 shutdown_connections 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.644+0000 7fc515f99700 1 -- 172.21.15.86:0/3131465662 wait complete. 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc515f99700 1 Processor -- start 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc515f99700 1 -- start start 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc515f99700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:37.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc515f99700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc51010d250 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc50f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc50f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34428/0 (socket says 172.21.15.86:34428) 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc50f7fe700 1 -- 172.21.15.86:0/834314293 learned_addr learned my addr 172.21.15.86:0/834314293 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc50f7fe700 1 -- 172.21.15.86:0/834314293 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51019d350 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.645+0000 7fc50f7fe700 1 --2- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51019ce10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80116e0 tx=0x7fc4f8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.646+0000 7fc50cff9700 1 -- 172.21.15.86:0/834314293 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f8003b20 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.646+0000 7fc50cff9700 1 -- 172.21.15.86:0/834314293 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4f801b8f0 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.646+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51019d5e0 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.646+0000 7fc50cff9700 1 -- 172.21.15.86:0/834314293 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f80238c0 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.646+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc51019e050 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.647+0000 7fc50cff9700 1 -- 172.21.15.86:0/834314293 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fc4f8023b70 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.647+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc510064b00 con 0x7fc510109920 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.647+0000 7fc50cff9700 1 --2- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fc4fc03e4e0 0x7fc4fc0409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:37.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.647+0000 7fc50cff9700 1 -- 172.21.15.86:0/834314293 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc4f8053f70 con 0x7fc510109920 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.647+0000 7fc50effd700 1 --2- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fc4fc03e4e0 0x7fc4fc0409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.647+0000 7fc50effd700 1 --2- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fc4fc03e4e0 0x7fc4fc0409a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc500006fd0 tx=0x7fc500006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.652+0000 7fc50cff9700 1 -- 172.21.15.86:0/834314293 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc4f801f030 con 0x7fc510109920 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:35.927+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fc51019e550 con 0x7fc510109920 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.752+0000 7fc50cff9700 1 -- 172.21.15.86:0/834314293 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fc4f80292a0 con 0x7fc510109920 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.754+0000 7fc50cff9700 1 -- 172.21.15.86:0/834314293 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fc4f802b530 con 0x7fc510109920 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fc4fc03e4e0 msgr2=0x7fc4fc0409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 --2- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fc4fc03e4e0 0x7fc4fc0409a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc500006fd0 tx=0x7fc500006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 msgr2=0x7fc51019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 --2- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51019ce10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80116e0 tx=0x7fc4f8011aa0 comp rx=0 tx=0).stop 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 shutdown_connections 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 --2- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7fc4fc03e4e0 0x7fc4fc0409a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 --2- 172.21.15.86:0/834314293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc510109920 0x7fc51019ce10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:37.320 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 >> 172.21.15.86:0/834314293 conn(0x7fc510103350 msgr2=0x7fc510103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:37.321 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 shutdown_connections 2024-05-12T10:58:37.321 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:36.756+0000 7fc515f99700 1 -- 172.21.15.86:0/834314293 wait complete. 2024-05-12T10:58:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:37 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/834314293' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-12T10:58:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:37 smithi086 ceph-mon[30110]: mgrmap e9: x(active, since 19s) 2024-05-12T10:58:37.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:37 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:37.577+0000 7f37fd8d0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T10:58:37.964 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:37 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:37.665+0000 7f37fd8d0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T10:58:38.711 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.798+0000 7f5ec996a700 1 Processor -- start 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.798+0000 7f5ec996a700 1 -- start start 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.798+0000 7f5ec996a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec4109720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.798+0000 7f5ec996a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec4109cf0 con 0x7f5ec4109300 2024-05-12T10:58:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.798+0000 7f5ec2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec4109720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.798+0000 7f5ec2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec4109720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34462/0 (socket says 172.21.15.86:34462) 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.799+0000 7f5ec2ffd700 1 -- 172.21.15.86:0/1848407241 learned_addr learned my addr 172.21.15.86:0/1848407241 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.799+0000 7f5ec2ffd700 1 -- 172.21.15.86:0/1848407241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec4107f60 con 0x7f5ec4109300 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.799+0000 7f5ec2ffd700 1 --2- 172.21.15.86:0/1848407241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec4109720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80098a0 tx=0x7f5eb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3aa1e2d9ca15ad8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.799+0000 7f5ec1ffb700 1 -- 172.21.15.86:0/1848407241 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb8004160 con 0x7f5ec4109300 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.799+0000 7f5ec1ffb700 1 -- 172.21.15.86:0/1848407241 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5eb8004300 con 0x7f5ec4109300 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.799+0000 7f5ec1ffb700 1 -- 172.21.15.86:0/1848407241 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb8011a20 con 0x7f5ec4109300 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.800+0000 7f5ec996a700 1 -- 172.21.15.86:0/1848407241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 msgr2=0x7f5ec4109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.800+0000 7f5ec996a700 1 --2- 172.21.15.86:0/1848407241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec4109720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80098a0 tx=0x7f5eb8009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.800+0000 7f5ec996a700 1 -- 172.21.15.86:0/1848407241 shutdown_connections 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.800+0000 7f5ec996a700 1 --2- 172.21.15.86:0/1848407241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec4109720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.800+0000 7f5ec996a700 1 -- 172.21.15.86:0/1848407241 >> 172.21.15.86:0/1848407241 conn(0x7f5ec4102a30 msgr2=0x7f5ec4104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.800+0000 7f5ec996a700 1 -- 172.21.15.86:0/1848407241 shutdown_connections 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.800+0000 7f5ec996a700 1 -- 172.21.15.86:0/1848407241 wait complete. 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.800+0000 7f5ec996a700 1 Processor -- start 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.801+0000 7f5ec996a700 1 -- start start 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.801+0000 7f5ec996a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.801+0000 7f5ec996a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec410c320 con 0x7f5ec4109300 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.801+0000 7f5ec2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.801+0000 7f5ec2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec419ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34476/0 (socket says 172.21.15.86:34476) 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.801+0000 7f5ec2ffd700 1 -- 172.21.15.86:0/718731037 learned_addr learned my addr 172.21.15.86:0/718731037 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.801+0000 7f5ec2ffd700 1 -- 172.21.15.86:0/718731037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec419d390 con 0x7f5ec4109300 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.801+0000 7f5ec2ffd700 1 --2- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec419ce50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80116e0 tx=0x7f5eb8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.802+0000 7f5ec8968700 1 -- 172.21.15.86:0/718731037 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb8003b20 con 0x7f5ec4109300 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.802+0000 7f5ec8968700 1 -- 172.21.15.86:0/718731037 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5eb801b8f0 con 0x7f5ec4109300 2024-05-12T10:58:38.720 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.802+0000 7f5ec8968700 1 -- 172.21.15.86:0/718731037 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb80238c0 con 0x7f5ec4109300 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.802+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec419d620 con 0x7f5ec4109300 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.802+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec419e090 con 0x7f5ec4109300 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.803+0000 7f5ec8968700 1 -- 172.21.15.86:0/718731037 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f5eb8023b70 con 0x7f5ec4109300 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.803+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec4064b00 con 0x7f5ec4109300 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.803+0000 7f5ec8968700 1 --2- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5eac03e530 0x7f5eac0409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.803+0000 7f5ec27fc700 1 -- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5eac03e530 msgr2=0x7f5eac0409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3515811906 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.803+0000 7f5ec8968700 1 -- 172.21.15.86:0/718731037 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5eb8054040 con 0x7f5ec4109300 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.803+0000 7f5ec27fc700 1 --2- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5eac03e530 0x7f5eac0409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:37.808+0000 7f5ec8968700 1 -- 172.21.15.86:0/718731037 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5eb801f030 con 0x7f5ec4109300 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.004+0000 7f5ec27fc700 1 -- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5eac03e530 msgr2=0x7f5eac0409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3515811906 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.004+0000 7f5ec27fc700 1 --2- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5eac03e530 0x7f5eac0409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.115+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f5ec419ed50 con 0x7f5ec4109300 2024-05-12T10:58:38.721 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.115+0000 7f5ec8968700 1 -- 172.21.15.86:0/718731037 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f5eb801baa0 con 0x7f5ec4109300 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5eac03e530 msgr2=0x7f5eac0409f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 --2- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5eac03e530 0x7f5eac0409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 msgr2=0x7f5ec419ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 --2- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec419ce50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80116e0 tx=0x7f5eb8011aa0 comp rx=0 tx=0).stop 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 shutdown_connections 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 --2- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f5eac03e530 0x7f5eac0409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 --2- 172.21.15.86:0/718731037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec4109300 0x7f5ec419ce50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 >> 172.21.15.86:0/718731037 conn(0x7f5ec4102a30 msgr2=0x7f5ec41938e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 shutdown_connections 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:38.120+0000 7f5ec996a700 1 -- 172.21.15.86:0/718731037 wait complete. 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for the mgr to restart... 2024-05-12T10:58:38.722 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mgr epoch 9... 2024-05-12T10:58:38.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:38 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/718731037' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-12T10:58:38.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:38 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:38.893+0000 7f37fd8d0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T10:58:39.362 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:39.072+0000 7f37fd8d0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T10:58:39.362 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:39.248+0000 7f37fd8d0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T10:58:39.631 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:39.544+0000 7f37fd8d0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T10:58:39.631 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:39.638+0000 7f37fd8d0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T10:58:39.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:39.845+0000 7f37fd8d0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T10:58:40.463 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:40 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:40.041+0000 7f37fd8d0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:58:40.866 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:40 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:40.649+0000 7f37fd8d0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-12T10:58:40.867 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:40 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:40.874+0000 7f37fd8d0200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-12T10:58:41.656 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:41 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:41.313+0000 7f37fd8d0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T10:58:41.656 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:41 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:41.410+0000 7f37fd8d0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T10:58:41.964 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:41 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:41.791+0000 7f37fd8d0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-12T10:58:42.463 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:42.151+0000 7f37fd8d0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T10:58:42.463 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:42.246+0000 7f37fd8d0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T10:58:42.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:42.494+0000 7f37fd8d0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T10:58:42.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:42.630+0000 7f37fd8d0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T10:58:42.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:42.727+0000 7f37fd8d0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T10:58:43.463 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:43 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:43.057+0000 7f37fd8d0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T10:58:43.463 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:43 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:43.151+0000 7f37fd8d0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T10:58:44.025 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:43 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:43.759+0000 7f37fd8d0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T10:58:44.026 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 10:58:43 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T10:58:43.979+0000 7f37fd8d0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T10:58:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: Active manager daemon x restarted 2024-05-12T10:58:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: Activating manager daemon x 2024-05-12T10:58:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: osdmap e3: 0 total, 0 up, 0 in 2024-05-12T10:58:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: mgrmap e10: x(active, starting, since 0.00418471s) 2024-05-12T10:58:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:58:44.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-12T10:58:44.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-12T10:58:44.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-12T10:58:44.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-12T10:58:44.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: Manager daemon x is now available 2024-05-12T10:58:44.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:58:45.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-12T10:58:45.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-12T10:58:45.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:45 smithi086 ceph-mon[30110]: mgrmap e11: x(active, since 1.00642s) 2024-05-12T10:58:45.610 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.164+0000 7f3cc413f700 1 Processor -- start 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.164+0000 7f3cc413f700 1 -- start start 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc413f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc10bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc413f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc07d6a0 con 0x7f3cbc109920 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc1edb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc10bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc1edb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc10bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34482/0 (socket says 172.21.15.86:34482) 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc1edb700 1 -- 172.21.15.86:0/3949432588 learned_addr learned my addr 172.21.15.86:0/3949432588 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc1edb700 1 -- 172.21.15.86:0/3949432588 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cbc10c250 con 0x7f3cbc109920 2024-05-12T10:58:45.611 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc1edb700 1 --2- 172.21.15.86:0/3949432588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc10bd10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80098a0 tx=0x7f3cb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464c4bd3dcdc7457 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc0ed9700 1 -- 172.21.15.86:0/3949432588 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb8004160 con 0x7f3cbc109920 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc0ed9700 1 -- 172.21.15.86:0/3949432588 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cb8004300 con 0x7f3cbc109920 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.165+0000 7f3cc0ed9700 1 -- 172.21.15.86:0/3949432588 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb8011a20 con 0x7f3cbc109920 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.166+0000 7f3cc413f700 1 -- 172.21.15.86:0/3949432588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 msgr2=0x7f3cbc10bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.166+0000 7f3cc413f700 1 --2- 172.21.15.86:0/3949432588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc10bd10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80098a0 tx=0x7f3cb8009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.166+0000 7f3cc413f700 1 -- 172.21.15.86:0/3949432588 shutdown_connections 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.166+0000 7f3cc413f700 1 --2- 172.21.15.86:0/3949432588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc10bd10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.166+0000 7f3cc413f700 1 -- 172.21.15.86:0/3949432588 >> 172.21.15.86:0/3949432588 conn(0x7f3cbc103310 msgr2=0x7f3cbc105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.166+0000 7f3cc413f700 1 -- 172.21.15.86:0/3949432588 shutdown_connections 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.166+0000 7f3cc413f700 1 -- 172.21.15.86:0/3949432588 wait complete. 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.167+0000 7f3cc413f700 1 Processor -- start 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.167+0000 7f3cc413f700 1 -- start start 2024-05-12T10:58:45.612 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.167+0000 7f3cc413f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.167+0000 7f3cc413f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc10d1f0 con 0x7f3cbc109920 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.167+0000 7f3cc1edb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.167+0000 7f3cc1edb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34484/0 (socket says 172.21.15.86:34484) 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.167+0000 7f3cc1edb700 1 -- 172.21.15.86:0/1737795494 learned_addr learned my addr 172.21.15.86:0/1737795494 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.167+0000 7f3cc1edb700 1 -- 172.21.15.86:0/1737795494 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cbc19d1a0 con 0x7f3cbc109920 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.168+0000 7f3cc1edb700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc19cc60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80116e0 tx=0x7f3cb8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.168+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb8003a60 con 0x7f3cbc109920 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.168+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cbc19d430 con 0x7f3cbc109920 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.168+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cb801b8f0 con 0x7f3cbc109920 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.168+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb8019860 con 0x7f3cbc109920 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.168+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cbc1a0120 con 0x7f3cbc109920 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.169+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f3cb8019b60 con 0x7f3cbc109920 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.169+0000 7f3cb2ffd700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 0x7f3ca80409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:45.613 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.169+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 --> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3ca8041100 con 0x7f3ca803e530 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.169+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3cb8053cd0 con 0x7f3cbc109920 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.169+0000 7f3cc16da700 1 -- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 msgr2=0x7f3ca80409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3515811906 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.169+0000 7f3cc16da700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 0x7f3ca80409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.370+0000 7f3cc16da700 1 -- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 msgr2=0x7f3ca80409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3515811906 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.370+0000 7f3cc16da700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 0x7f3ca80409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.771+0000 7f3cc16da700 1 -- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 msgr2=0x7f3ca80409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3515811906 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:39.771+0000 7f3cc16da700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 0x7f3ca80409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:40.572+0000 7f3cc16da700 1 -- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 msgr2=0x7f3ca80409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3515811906 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:40.572+0000 7f3cc16da700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 0x7f3ca80409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:42.173+0000 7f3cc16da700 1 -- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 msgr2=0x7f3ca80409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3515811906 2024-05-12T10:58:45.614 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:42.173+0000 7f3cc16da700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 0x7f3ca80409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:43.984+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f3cb8018530 con 0x7f3cbc109920 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:43.984+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 msgr2=0x7f3ca80409f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:43.984+0000 7f3cb2ffd700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 0x7f3ca80409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.985+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f3cb8055350 con 0x7f3cbc109920 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.985+0000 7f3cb2ffd700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3ca8041fb0 0x7f3ca80443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.986+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3cb8007e50 con 0x7f3ca8041fb0 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.986+0000 7f3cc16da700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3ca8041fb0 0x7f3ca80443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.986+0000 7f3cc16da700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3ca8041fb0 0x7f3ca80443a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3cac003a10 tx=0x7f3cac0092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.987+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f3cb8007e50 con 0x7f3ca8041fb0 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.995+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3cbc06a5d0 con 0x7f3ca8041fb0 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.995+0000 7f3cb2ffd700 1 -- 172.21.15.86:0/1737795494 <== mgr.14152 v2:172.21.15.86:6800/155657181 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f3cbc06a5d0 con 0x7f3ca8041fb0 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3ca8041fb0 msgr2=0x7f3ca80443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3ca8041fb0 0x7f3ca80443a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3cac003a10 tx=0x7f3cac0092b0 comp rx=0 tx=0).stop 2024-05-12T10:58:45.615 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 msgr2=0x7f3cbc19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc19cc60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80116e0 tx=0x7f3cb8011aa0 comp rx=0 tx=0).stop 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 shutdown_connections 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3ca8041fb0 0x7f3ca80443a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc109920 0x7f3cbc19cc60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 --2- 172.21.15.86:0/1737795494 >> [v2:172.21.15.86:6800/3515811906,v1:172.21.15.86:6801/3515811906] conn(0x7f3ca803e530 0x7f3ca80409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 >> 172.21.15.86:0/1737795494 conn(0x7f3cbc103310 msgr2=0x7f3cbc103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 shutdown_connections 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:44.996+0000 7f3cc413f700 1 -- 172.21.15.86:0/1737795494 wait complete. 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:mgr epoch 9 is available 2024-05-12T10:58:45.616 INFO:teuthology.orchestra.run.smithi086.stdout:Generating a dashboard self-signed certificate... 2024-05-12T10:58:46.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:46 smithi086 ceph-mon[30110]: [12/May/2024:10:58:44] ENGINE Bus STARTING 2024-05-12T10:58:46.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:46 smithi086 ceph-mon[30110]: [12/May/2024:10:58:44] ENGINE Serving on http://172.21.15.86:8765 2024-05-12T10:58:46.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:46 smithi086 ceph-mon[30110]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-12T10:58:46.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:46 smithi086 ceph-mon[30110]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-12T10:58:46.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:46 smithi086 ceph-mon[30110]: [12/May/2024:10:58:45] ENGINE Serving on https://172.21.15.86:7150 2024-05-12T10:58:46.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:46 smithi086 ceph-mon[30110]: [12/May/2024:10:58:45] ENGINE Bus STARTED 2024-05-12T10:58:46.998 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.048+0000 7f62a6ccc700 1 Processor -- start 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.048+0000 7f62a6ccc700 1 -- start start 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f62a6ccc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a0108170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f62a6ccc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62a0108740 con 0x7f62a0107d50 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f62a4a68700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a0108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f62a4a68700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a0108170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43648/0 (socket says 172.21.15.86:43648) 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f62a4a68700 1 -- 172.21.15.86:0/1118079501 learned_addr learned my addr 172.21.15.86:0/1118079501 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f62a4a68700 1 -- 172.21.15.86:0/1118079501 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a0108f50 con 0x7f62a0107d50 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f62a4a68700 1 --2- 172.21.15.86:0/1118079501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a0108170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f629000d180 tx=0x7f629000d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b03d7df46962fa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f629f7fe700 1 -- 172.21.15.86:0/1118079501 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6290019070 con 0x7f62a0107d50 2024-05-12T10:58:46.999 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f629f7fe700 1 -- 172.21.15.86:0/1118079501 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f629000de20 con 0x7f62a0107d50 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.049+0000 7f629f7fe700 1 -- 172.21.15.86:0/1118079501 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6290009a70 con 0x7f62a0107d50 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.050+0000 7f62a6ccc700 1 -- 172.21.15.86:0/1118079501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 msgr2=0x7f62a0108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.050+0000 7f62a6ccc700 1 --2- 172.21.15.86:0/1118079501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a0108170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f629000d180 tx=0x7f629000d490 comp rx=0 tx=0).stop 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.050+0000 7f62a6ccc700 1 -- 172.21.15.86:0/1118079501 shutdown_connections 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.050+0000 7f62a6ccc700 1 --2- 172.21.15.86:0/1118079501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a0108170 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.050+0000 7f62a6ccc700 1 -- 172.21.15.86:0/1118079501 >> 172.21.15.86:0/1118079501 conn(0x7f62a01032b0 msgr2=0x7f62a0105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.050+0000 7f62a6ccc700 1 -- 172.21.15.86:0/1118079501 shutdown_connections 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.050+0000 7f62a6ccc700 1 -- 172.21.15.86:0/1118079501 wait complete. 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a6ccc700 1 Processor -- start 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a6ccc700 1 -- start start 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a6ccc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a6ccc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62a007bfb0 con 0x7f62a0107d50 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a4a68700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:47.000 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a4a68700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43664/0 (socket says 172.21.15.86:43664) 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a4a68700 1 -- 172.21.15.86:0/2274475194 learned_addr learned my addr 172.21.15.86:0/2274475194 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a4a68700 1 -- 172.21.15.86:0/2274475194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a019b170 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a4a68700 1 --2- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a019ac30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62900096e0 tx=0x7f6290003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f629dffb700 1 -- 172.21.15.86:0/2274475194 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6290019050 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f629dffb700 1 -- 172.21.15.86:0/2274475194 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6290025070 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a019b400 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.051+0000 7f629dffb700 1 -- 172.21.15.86:0/2274475194 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6290020910 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.052+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a019bf20 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.052+0000 7f629dffb700 1 -- 172.21.15.86:0/2274475194 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f6290020b90 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.053+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a0064b00 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.053+0000 7f629dffb700 1 --2- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f628c03e530 0x7f628c0409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.053+0000 7f629dffb700 1 -- 172.21.15.86:0/2274475194 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6290011050 con 0x7f62a0107d50 2024-05-12T10:58:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.053+0000 7f629ffff700 1 --2- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f628c03e530 0x7f628c0409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.053+0000 7f629ffff700 1 --2- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f628c03e530 0x7f628c0409f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6288006fd0 tx=0x7f6288006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.058+0000 7f629dffb700 1 -- 172.21.15.86:0/2274475194 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6290026270 con 0x7f62a0107d50 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.266+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f62a019c400 con 0x7f628c03e530 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.395+0000 7f629dffb700 1 -- 172.21.15.86:0/2274475194 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f62a019c400 con 0x7f628c03e530 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f628c03e530 msgr2=0x7f628c0409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 --2- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f628c03e530 0x7f628c0409f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6288006fd0 tx=0x7f6288006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 msgr2=0x7f62a019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 --2- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a019ac30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62900096e0 tx=0x7f6290003d00 comp rx=0 tx=0).stop 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 shutdown_connections 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 --2- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f628c03e530 0x7f628c0409f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 --2- 172.21.15.86:0/2274475194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62a0107d50 0x7f62a019ac30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 >> 172.21.15.86:0/2274475194 conn(0x7f62a01032b0 msgr2=0x7f62a0191170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 shutdown_connections 2024-05-12T10:58:47.002 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:46.398+0000 7f62a6ccc700 1 -- 172.21.15.86:0/2274475194 wait complete. 2024-05-12T10:58:47.003 INFO:teuthology.orchestra.run.smithi086.stdout:Creating initial admin user... 2024-05-12T10:58:47.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:47 smithi086 ceph-mon[30110]: mgrmap e12: x(active, since 2s) 2024-05-12T10:58:47.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:47 smithi086 ceph-mon[30110]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:47.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:47.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:47.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:48.340 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:48 smithi086 ceph-mon[30110]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:58:48.340 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:48.581 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$YWyUBhUgmLwM50NgKnV89.ud.7Sw03PWSf5iAXthJI4ZyccKXYaxq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715511527, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.472+0000 7fec6d024700 1 Processor -- start 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.472+0000 7fec6d024700 1 -- start start 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.472+0000 7fec6d024700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6810bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.472+0000 7fec6d024700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fec6807d6e0 con 0x7fec681098e0 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.472+0000 7fec66d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6810bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.472+0000 7fec66d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6810bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43678/0 (socket says 172.21.15.86:43678) 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.472+0000 7fec66d9d700 1 -- 172.21.15.86:0/1915285662 learned_addr learned my addr 172.21.15.86:0/1915285662 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec66d9d700 1 -- 172.21.15.86:0/1915285662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6810c210 con 0x7fec681098e0 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec66d9d700 1 --2- 172.21.15.86:0/1915285662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6810bcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec580098a0 tx=0x7fec58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ca33a030e177a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec65d9b700 1 -- 172.21.15.86:0/1915285662 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec58004160 con 0x7fec681098e0 2024-05-12T10:58:48.582 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec65d9b700 1 -- 172.21.15.86:0/1915285662 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec58004300 con 0x7fec681098e0 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec65d9b700 1 -- 172.21.15.86:0/1915285662 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec58011a20 con 0x7fec681098e0 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec6d024700 1 -- 172.21.15.86:0/1915285662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 msgr2=0x7fec6810bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec6d024700 1 --2- 172.21.15.86:0/1915285662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6810bcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec580098a0 tx=0x7fec58009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec6d024700 1 -- 172.21.15.86:0/1915285662 shutdown_connections 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec6d024700 1 --2- 172.21.15.86:0/1915285662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6810bcd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec6d024700 1 -- 172.21.15.86:0/1915285662 >> 172.21.15.86:0/1915285662 conn(0x7fec68103310 msgr2=0x7fec68105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.473+0000 7fec6d024700 1 -- 172.21.15.86:0/1915285662 shutdown_connections 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.474+0000 7fec6d024700 1 -- 172.21.15.86:0/1915285662 wait complete. 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.474+0000 7fec6d024700 1 Processor -- start 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.474+0000 7fec6d024700 1 -- start start 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec6d024700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:48.583 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec6d024700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fec6810d210 con 0x7fec681098e0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec66d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec66d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43692/0 (socket says 172.21.15.86:43692) 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec66d9d700 1 -- 172.21.15.86:0/2571408897 learned_addr learned my addr 172.21.15.86:0/2571408897 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec66d9d700 1 -- 172.21.15.86:0/2571408897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6819d240 con 0x7fec681098e0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec66d9d700 1 --2- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6819cd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec580116e0 tx=0x7fec58011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec4ffff700 1 -- 172.21.15.86:0/2571408897 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec58003a60 con 0x7fec681098e0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec4ffff700 1 -- 172.21.15.86:0/2571408897 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec5801b8f0 con 0x7fec681098e0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec4ffff700 1 -- 172.21.15.86:0/2571408897 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec58019860 con 0x7fec681098e0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6819d4d0 con 0x7fec681098e0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.475+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6819dff0 con 0x7fec681098e0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.476+0000 7fec4ffff700 1 -- 172.21.15.86:0/2571408897 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fec58019b60 con 0x7fec681098e0 2024-05-12T10:58:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.476+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec68064b00 con 0x7fec681098e0 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.476+0000 7fec4ffff700 1 --2- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fec5003e530 0x7fec500409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.476+0000 7fec4ffff700 1 -- 172.21.15.86:0/2571408897 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fec58053dc0 con 0x7fec681098e0 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.476+0000 7fec6659c700 1 --2- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fec5003e530 0x7fec500409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.477+0000 7fec6659c700 1 --2- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fec5003e530 0x7fec500409f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec5c006fd0 tx=0x7fec5c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.481+0000 7fec4ffff700 1 -- 172.21.15.86:0/2571408897 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fec5801f030 con 0x7fec681098e0 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.757+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fec68104400 con 0x7fec5003e530 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.984+0000 7fec4ffff700 1 -- 172.21.15.86:0/2571408897 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fec68104400 con 0x7fec5003e530 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fec5003e530 msgr2=0x7fec500409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 --2- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fec5003e530 0x7fec500409f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec5c006fd0 tx=0x7fec5c006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 msgr2=0x7fec6819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 --2- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6819cd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec580116e0 tx=0x7fec58011aa0 comp rx=0 tx=0).stop 2024-05-12T10:58:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 shutdown_connections 2024-05-12T10:58:48.586 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 --2- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fec5003e530 0x7fec500409f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:48.586 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 --2- 172.21.15.86:0/2571408897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec681098e0 0x7fec6819cd00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:48.586 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 >> 172.21.15.86:0/2571408897 conn(0x7fec68103310 msgr2=0x7fec68103cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:48.586 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 shutdown_connections 2024-05-12T10:58:48.586 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:47.987+0000 7fec6d024700 1 -- 172.21.15.86:0/2571408897 wait complete. 2024-05-12T10:58:48.586 INFO:teuthology.orchestra.run.smithi086.stdout:Fetching dashboard port number... 2024-05-12T10:58:49.371 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:49 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:50.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:50 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/229838753' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-12T10:58:50.810 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 8443 2024-05-12T10:58:50.810 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.052+0000 7ff211e2b700 1 Processor -- start 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.052+0000 7ff211e2b700 1 -- start start 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff211e2b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c10bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff211e2b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c07d6e0 con 0x7ff20c109920 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff20b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c10bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff20b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c10bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43702/0 (socket says 172.21.15.86:43702) 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff20b7fe700 1 -- 172.21.15.86:0/3405049784 learned_addr learned my addr 172.21.15.86:0/3405049784 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff20b7fe700 1 -- 172.21.15.86:0/3405049784 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20c10c250 con 0x7ff20c109920 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff20b7fe700 1 --2- 172.21.15.86:0/3405049784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c10bd10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc0098a0 tx=0x7ff1fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64c40d9973dc9bc server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff20a7fc700 1 -- 172.21.15.86:0/3405049784 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1fc004160 con 0x7ff20c109920 2024-05-12T10:58:50.811 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff20a7fc700 1 -- 172.21.15.86:0/3405049784 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1fc004300 con 0x7ff20c109920 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.053+0000 7ff20a7fc700 1 -- 172.21.15.86:0/3405049784 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1fc011a20 con 0x7ff20c109920 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.054+0000 7ff211e2b700 1 -- 172.21.15.86:0/3405049784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 msgr2=0x7ff20c10bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.054+0000 7ff211e2b700 1 --2- 172.21.15.86:0/3405049784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c10bd10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc0098a0 tx=0x7ff1fc009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.054+0000 7ff211e2b700 1 -- 172.21.15.86:0/3405049784 shutdown_connections 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.054+0000 7ff211e2b700 1 --2- 172.21.15.86:0/3405049784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c10bd10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.054+0000 7ff211e2b700 1 -- 172.21.15.86:0/3405049784 >> 172.21.15.86:0/3405049784 conn(0x7ff20c103350 msgr2=0x7ff20c105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.054+0000 7ff211e2b700 1 -- 172.21.15.86:0/3405049784 shutdown_connections 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.054+0000 7ff211e2b700 1 -- 172.21.15.86:0/3405049784 wait complete. 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff211e2b700 1 Processor -- start 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff211e2b700 1 -- start start 2024-05-12T10:58:50.812 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff211e2b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff211e2b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c10d250 con 0x7ff20c109920 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff20b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff20b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43710/0 (socket says 172.21.15.86:43710) 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff20b7fe700 1 -- 172.21.15.86:0/229838753 learned_addr learned my addr 172.21.15.86:0/229838753 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff20b7fe700 1 -- 172.21.15.86:0/229838753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20c19d350 con 0x7ff20c109920 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.055+0000 7ff20b7fe700 1 --2- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c19ce10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc004660 tx=0x7ff1fc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.056+0000 7ff208ff9700 1 -- 172.21.15.86:0/229838753 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1fc003aa0 con 0x7ff20c109920 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.056+0000 7ff208ff9700 1 -- 172.21.15.86:0/229838753 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1fc01b8f0 con 0x7ff20c109920 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.056+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff20c19d5e0 con 0x7ff20c109920 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.056+0000 7ff208ff9700 1 -- 172.21.15.86:0/229838753 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1fc023900 con 0x7ff20c109920 2024-05-12T10:58:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.056+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff20c19e050 con 0x7ff20c109920 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.056+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff20c064b00 con 0x7ff20c109920 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.057+0000 7ff208ff9700 1 -- 172.21.15.86:0/229838753 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7ff1fc023b70 con 0x7ff20c109920 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.057+0000 7ff208ff9700 1 --2- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1f403e5e0 0x7ff1f4040aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.057+0000 7ff208ff9700 1 -- 172.21.15.86:0/229838753 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff1fc053e80 con 0x7ff20c109920 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.057+0000 7ff20affd700 1 --2- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1f403e5e0 0x7ff1f4040aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.057+0000 7ff20affd700 1 --2- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1f403e5e0 0x7ff1f4040aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff200006fd0 tx=0x7ff200006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.062+0000 7ff208ff9700 1 -- 172.21.15.86:0/229838753 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff1fc01f030 con 0x7ff20c109920 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.285+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7ff20c19e570 con 0x7ff20c109920 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.286+0000 7ff208ff9700 1 -- 172.21.15.86:0/229838753 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7ff1fc01bde0 con 0x7ff20c109920 2024-05-12T10:58:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1f403e5e0 msgr2=0x7ff1f4040aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 --2- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1f403e5e0 0x7ff1f4040aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff200006fd0 tx=0x7ff200006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 msgr2=0x7ff20c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 --2- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c19ce10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc004660 tx=0x7ff1fc011aa0 comp rx=0 tx=0).stop 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 shutdown_connections 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 --2- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1f403e5e0 0x7ff1f4040aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 --2- 172.21.15.86:0/229838753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c109920 0x7ff20c19ce10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 >> 172.21.15.86:0/229838753 conn(0x7ff20c103350 msgr2=0x7ff20c103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 shutdown_connections 2024-05-12T10:58:50.815 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:49.289+0000 7ff211e2b700 1 -- 172.21.15.86:0/229838753 wait complete. 2024-05-12T10:58:50.819 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-12T10:58:50.819 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout disabled 2024-05-12T10:58:50.827 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-12T10:58:50.827 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-05-12T10:58:50.827 INFO:teuthology.orchestra.run.smithi086.stdout:firewalld.service is not enabled 2024-05-12T10:58:50.828 INFO:teuthology.orchestra.run.smithi086.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-12T10:58:50.829 INFO:teuthology.orchestra.run.smithi086.stdout:Ceph Dashboard is now available at: 2024-05-12T10:58:50.829 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:50.829 INFO:teuthology.orchestra.run.smithi086.stdout: URL: https://smithi086.front.sepia.ceph.com:8443/ 2024-05-12T10:58:50.829 INFO:teuthology.orchestra.run.smithi086.stdout: User: admin 2024-05-12T10:58:50.829 INFO:teuthology.orchestra.run.smithi086.stdout: Password: zdufj7z7uy 2024-05-12T10:58:50.829 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:50.830 INFO:teuthology.orchestra.run.smithi086.stdout:Saving cluster configuration to /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config directory 2024-05-12T10:58:50.830 INFO:teuthology.orchestra.run.smithi086.stdout:Enabling autotune for osd_memory_target 2024-05-12T10:58:51.484 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:51 smithi086 ceph-mon[30110]: mgrmap e13: x(active, since 6s) 2024-05-12T10:58:52.082 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.266+0000 7fa13602c700 1 Processor -- start 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.266+0000 7fa13602c700 1 -- start start 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.266+0000 7fa13602c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa1301081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.266+0000 7fa13602c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa130108780 con 0x7fa130107d90 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.266+0000 7fa12f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa1301081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.266+0000 7fa12f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa1301081b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43718/0 (socket says 172.21.15.86:43718) 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.266+0000 7fa12f7fe700 1 -- 172.21.15.86:0/113771262 learned_addr learned my addr 172.21.15.86:0/113771262 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.266+0000 7fa12f7fe700 1 -- 172.21.15.86:0/113771262 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa130108f40 con 0x7fa130107d90 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa12f7fe700 1 --2- 172.21.15.86:0/113771262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa1301081b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1200098a0 tx=0x7fa120009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd73759f78b7a70 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa12e7fc700 1 -- 172.21.15.86:0/113771262 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120004160 con 0x7fa130107d90 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa12e7fc700 1 -- 172.21.15.86:0/113771262 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa120004300 con 0x7fa130107d90 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa12e7fc700 1 -- 172.21.15.86:0/113771262 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120011a20 con 0x7fa130107d90 2024-05-12T10:58:52.083 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa13602c700 1 -- 172.21.15.86:0/113771262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 msgr2=0x7fa1301081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa13602c700 1 --2- 172.21.15.86:0/113771262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa1301081b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1200098a0 tx=0x7fa120009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa13602c700 1 -- 172.21.15.86:0/113771262 shutdown_connections 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa13602c700 1 --2- 172.21.15.86:0/113771262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa1301081b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa13602c700 1 -- 172.21.15.86:0/113771262 >> 172.21.15.86:0/113771262 conn(0x7fa130103350 msgr2=0x7fa130105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa13602c700 1 -- 172.21.15.86:0/113771262 shutdown_connections 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.267+0000 7fa13602c700 1 -- 172.21.15.86:0/113771262 wait complete. 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.268+0000 7fa13602c700 1 Processor -- start 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.268+0000 7fa13602c700 1 -- start start 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.268+0000 7fa13602c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa130193090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.268+0000 7fa13602c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa13010c2f0 con 0x7fa130107d90 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.268+0000 7fa12f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa130193090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa12f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa130193090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43730/0 (socket says 172.21.15.86:43730) 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa12f7fe700 1 -- 172.21.15.86:0/2796064374 learned_addr learned my addr 172.21.15.86:0/2796064374 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa12f7fe700 1 -- 172.21.15.86:0/2796064374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1301915e0 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa12f7fe700 1 --2- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa130193090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1200119f0 tx=0x7fa120011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa12cff9700 1 -- 172.21.15.86:0/2796064374 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1200039e0 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa12cff9700 1 -- 172.21.15.86:0/2796064374 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa12001b8f0 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa130191870 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa12cff9700 1 -- 172.21.15.86:0/2796064374 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1200237a0 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.269+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa130191d50 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.270+0000 7fa12cff9700 1 -- 172.21.15.86:0/2796064374 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa12002c3f0 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.270+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa130064b00 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.270+0000 7fa12cff9700 1 --2- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa11803e5d0 0x7fa118040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.270+0000 7fa12cff9700 1 -- 172.21.15.86:0/2796064374 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa120054330 con 0x7fa130107d90 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.270+0000 7fa12effd700 1 --2- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa11803e5d0 0x7fa118040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.271+0000 7fa12effd700 1 --2- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa11803e5d0 0x7fa118040a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa124006fd0 tx=0x7fa124006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:52.085 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.276+0000 7fa12cff9700 1 -- 172.21.15.86:0/2796064374 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa12001f030 con 0x7fa130107d90 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.479+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fa13002e680 con 0x7fa130107d90 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.479+0000 7fa12cff9700 1 -- 172.21.15.86:0/2796064374 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fa12000b3e0 con 0x7fa130107d90 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa11803e5d0 msgr2=0x7fa118040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 --2- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa11803e5d0 0x7fa118040a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa124006fd0 tx=0x7fa124006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 msgr2=0x7fa130193090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 --2- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa130193090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1200119f0 tx=0x7fa120011ad0 comp rx=0 tx=0).stop 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 shutdown_connections 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 --2- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa11803e5d0 0x7fa118040a90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 --2- 172.21.15.86:0/2796064374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa130107d90 0x7fa130193090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 >> 172.21.15.86:0/2796064374 conn(0x7fa130103350 msgr2=0x7fa130104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 shutdown_connections 2024-05-12T10:58:52.086 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:51.481+0000 7fa13602c700 1 -- 172.21.15.86:0/2796064374 wait complete. 2024-05-12T10:58:53.439 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.554+0000 7fddda8f7700 1 Processor -- start 2024-05-12T10:58:53.439 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddda8f7700 1 -- start start 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddda8f7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd4108170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddda8f7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4108740 con 0x7fddd4107d50 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd4108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd4108170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56404/0 (socket says 172.21.15.86:56404) 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddd3fff700 1 -- 172.21.15.86:0/430621295 learned_addr learned my addr 172.21.15.86:0/430621295 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddd3fff700 1 -- 172.21.15.86:0/430621295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd4108f50 con 0x7fddd4107d50 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddd3fff700 1 --2- 172.21.15.86:0/430621295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd4108170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fddc40098a0 tx=0x7fddc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b4eb92bcd908ce server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.555+0000 7fddd37fe700 1 -- 172.21.15.86:0/430621295 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc4004160 con 0x7fddd4107d50 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddd37fe700 1 -- 172.21.15.86:0/430621295 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc4004300 con 0x7fddd4107d50 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddd37fe700 1 -- 172.21.15.86:0/430621295 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc4011a20 con 0x7fddd4107d50 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddda8f7700 1 -- 172.21.15.86:0/430621295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 msgr2=0x7fddd4108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddda8f7700 1 --2- 172.21.15.86:0/430621295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd4108170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fddc40098a0 tx=0x7fddc4009bb0 comp rx=0 tx=0).stop 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddda8f7700 1 -- 172.21.15.86:0/430621295 shutdown_connections 2024-05-12T10:58:53.440 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddda8f7700 1 --2- 172.21.15.86:0/430621295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd4108170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddda8f7700 1 -- 172.21.15.86:0/430621295 >> 172.21.15.86:0/430621295 conn(0x7fddd41032b0 msgr2=0x7fddd4105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddda8f7700 1 -- 172.21.15.86:0/430621295 shutdown_connections 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.556+0000 7fddda8f7700 1 -- 172.21.15.86:0/430621295 wait complete. 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddda8f7700 1 Processor -- start 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddda8f7700 1 -- start start 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddda8f7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddda8f7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fddd410c300 con 0x7fddd4107d50 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd419cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56406/0 (socket says 172.21.15.86:56406) 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddd3fff700 1 -- 172.21.15.86:0/184042542 learned_addr learned my addr 172.21.15.86:0/184042542 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddd3fff700 1 -- 172.21.15.86:0/184042542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd419d420 con 0x7fddd4107d50 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.557+0000 7fddd3fff700 1 --2- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd419cee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddc40119f0 tx=0x7fddc4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.558+0000 7fddd1ffb700 1 -- 172.21.15.86:0/184042542 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc40039e0 con 0x7fddd4107d50 2024-05-12T10:58:53.441 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.558+0000 7fddd1ffb700 1 -- 172.21.15.86:0/184042542 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc401b8f0 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.558+0000 7fddd1ffb700 1 -- 172.21.15.86:0/184042542 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc40237a0 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.558+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd419d6b0 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.558+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd419e090 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.559+0000 7fddd1ffb700 1 -- 172.21.15.86:0/184042542 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fddc401b440 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.559+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd4064b00 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.559+0000 7fddd1ffb700 1 --2- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddc003e630 0x7fddc0040af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.559+0000 7fddd1ffb700 1 -- 172.21.15.86:0/184042542 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fddc4054040 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.559+0000 7fddcbfff700 1 --2- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddc003e630 0x7fddc0040af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.559+0000 7fddcbfff700 1 --2- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddc003e630 0x7fddc0040af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006fd0 tx=0x7fddbc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.564+0000 7fddd1ffb700 1 -- 172.21.15.86:0/184042542 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fddc401f030 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.876+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fddd406bcb0 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.879+0000 7fddd1ffb700 1 -- 172.21.15.86:0/184042542 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7fddc4016260 con 0x7fddd4107d50 2024-05-12T10:58:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddc003e630 msgr2=0x7fddc0040af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 --2- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddc003e630 0x7fddc0040af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006fd0 tx=0x7fddbc006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 msgr2=0x7fddd419cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 --2- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd419cee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddc40119f0 tx=0x7fddc4011ad0 comp rx=0 tx=0).stop 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 shutdown_connections 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 --2- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddc003e630 0x7fddc0040af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 --2- 172.21.15.86:0/184042542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddd4107d50 0x7fddd419cee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 >> 172.21.15.86:0/184042542 conn(0x7fddd41032b0 msgr2=0x7fddd4104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 shutdown_connections 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-05-12T10:58:52.881+0000 7fddda8f7700 1 -- 172.21.15.86:0/184042542 wait complete. 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-12T10:58:53.443 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout:Or, if you are only running a single cluster on this host: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: ceph telemetry on 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout:For more information see: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout:Bootstrap complete. 2024-05-12T10:58:53.474 INFO:tasks.cephadm:Fetching config... 2024-05-12T10:58:53.474 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:58:53.475 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-12T10:58:53.490 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-12T10:58:53.490 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:58:53.490 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-12T10:58:53.547 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-12T10:58:53.547 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:58:53.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-12T10:58:53.612 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-12T10:58:53.613 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:58:53.613 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-12T10:58:53.668 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-12T10:58:53.668 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjEhvJIzG1hTRCccWH1PH0Hge7eaQrJ1nq+Qjw21BrPyIpR9CPpy2+F1yNauwQ1izX6jBVtKP4hHPizthGUv63qCo7YXEn0BDdqcjp7Ux2L21N/9FzJ+0n1nbo2AhSEQIvLT5pcWb3qT8L/GX6b7U+cW99bZ7vKmh/k+F+3ou86srwKdNNAHMsKm6jk6sn81w8CcAp/iCz91F6knLW4eCQLLkHV3Gs+Hf3CdcnOBb86g9e+IkYL6zGu3319OMrcS5A2e49jhzd9F2Jj/bnIsMWpBrNKvIneNbCtFlm6rBA7Ks8oPI4V+iVP0zGwYlWleEIGeDNs11JK7rpBLhD5F/DKgCPwzV3/Mo93Ym1d7sNZPhTqziGqLE/Z0TI1dIWeYYgdwRYj9Lf/vcaOAvYX1vXcILb6z1c3ovQ6XFbzy2lwWkX+CQhnm45k3HOFpNeG8ib4twRl3l7D9z1Wz5xRzNhf51PT3+PEPK7JdpuacaZqlzqbhAk6lycTwhHLurZtYE= ceph-513c80a2-104e-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-12T10:58:53.742 INFO:teuthology.orchestra.run.smithi086.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjEhvJIzG1hTRCccWH1PH0Hge7eaQrJ1nq+Qjw21BrPyIpR9CPpy2+F1yNauwQ1izX6jBVtKP4hHPizthGUv63qCo7YXEn0BDdqcjp7Ux2L21N/9FzJ+0n1nbo2AhSEQIvLT5pcWb3qT8L/GX6b7U+cW99bZ7vKmh/k+F+3ou86srwKdNNAHMsKm6jk6sn81w8CcAp/iCz91F6knLW4eCQLLkHV3Gs+Hf3CdcnOBb86g9e+IkYL6zGu3319OMrcS5A2e49jhzd9F2Jj/bnIsMWpBrNKvIneNbCtFlm6rBA7Ks8oPI4V+iVP0zGwYlWleEIGeDNs11JK7rpBLhD5F/DKgCPwzV3/Mo93Ym1d7sNZPhTqziGqLE/Z0TI1dIWeYYgdwRYj9Lf/vcaOAvYX1vXcILb6z1c3ovQ6XFbzy2lwWkX+CQhnm45k3HOFpNeG8ib4twRl3l7D9z1Wz5xRzNhf51PT3+PEPK7JdpuacaZqlzqbhAk6lycTwhHLurZtYE= ceph-513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:58:53.753 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjEhvJIzG1hTRCccWH1PH0Hge7eaQrJ1nq+Qjw21BrPyIpR9CPpy2+F1yNauwQ1izX6jBVtKP4hHPizthGUv63qCo7YXEn0BDdqcjp7Ux2L21N/9FzJ+0n1nbo2AhSEQIvLT5pcWb3qT8L/GX6b7U+cW99bZ7vKmh/k+F+3ou86srwKdNNAHMsKm6jk6sn81w8CcAp/iCz91F6knLW4eCQLLkHV3Gs+Hf3CdcnOBb86g9e+IkYL6zGu3319OMrcS5A2e49jhzd9F2Jj/bnIsMWpBrNKvIneNbCtFlm6rBA7Ks8oPI4V+iVP0zGwYlWleEIGeDNs11JK7rpBLhD5F/DKgCPwzV3/Mo93Ym1d7sNZPhTqziGqLE/Z0TI1dIWeYYgdwRYj9Lf/vcaOAvYX1vXcILb6z1c3ovQ6XFbzy2lwWkX+CQhnm45k3HOFpNeG8ib4twRl3l7D9z1Wz5xRzNhf51PT3+PEPK7JdpuacaZqlzqbhAk6lycTwhHLurZtYE= ceph-513c80a2-104e-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-12T10:58:53.793 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjEhvJIzG1hTRCccWH1PH0Hge7eaQrJ1nq+Qjw21BrPyIpR9CPpy2+F1yNauwQ1izX6jBVtKP4hHPizthGUv63qCo7YXEn0BDdqcjp7Ux2L21N/9FzJ+0n1nbo2AhSEQIvLT5pcWb3qT8L/GX6b7U+cW99bZ7vKmh/k+F+3ou86srwKdNNAHMsKm6jk6sn81w8CcAp/iCz91F6knLW4eCQLLkHV3Gs+Hf3CdcnOBb86g9e+IkYL6zGu3319OMrcS5A2e49jhzd9F2Jj/bnIsMWpBrNKvIneNbCtFlm6rBA7Ks8oPI4V+iVP0zGwYlWleEIGeDNs11JK7rpBLhD5F/DKgCPwzV3/Mo93Ym1d7sNZPhTqziGqLE/Z0TI1dIWeYYgdwRYj9Lf/vcaOAvYX1vXcILb6z1c3ovQ6XFbzy2lwWkX+CQhnm45k3HOFpNeG8ib4twRl3l7D9z1Wz5xRzNhf51PT3+PEPK7JdpuacaZqlzqbhAk6lycTwhHLurZtYE= ceph-513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:58:53.805 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjEhvJIzG1hTRCccWH1PH0Hge7eaQrJ1nq+Qjw21BrPyIpR9CPpy2+F1yNauwQ1izX6jBVtKP4hHPizthGUv63qCo7YXEn0BDdqcjp7Ux2L21N/9FzJ+0n1nbo2AhSEQIvLT5pcWb3qT8L/GX6b7U+cW99bZ7vKmh/k+F+3ou86srwKdNNAHMsKm6jk6sn81w8CcAp/iCz91F6knLW4eCQLLkHV3Gs+Hf3CdcnOBb86g9e+IkYL6zGu3319OMrcS5A2e49jhzd9F2Jj/bnIsMWpBrNKvIneNbCtFlm6rBA7Ks8oPI4V+iVP0zGwYlWleEIGeDNs11JK7rpBLhD5F/DKgCPwzV3/Mo93Ym1d7sNZPhTqziGqLE/Z0TI1dIWeYYgdwRYj9Lf/vcaOAvYX1vXcILb6z1c3ovQ6XFbzy2lwWkX+CQhnm45k3HOFpNeG8ib4twRl3l7D9z1Wz5xRzNhf51PT3+PEPK7JdpuacaZqlzqbhAk6lycTwhHLurZtYE= ceph-513c80a2-104e-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-12T10:58:53.844 INFO:teuthology.orchestra.run.smithi176.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjEhvJIzG1hTRCccWH1PH0Hge7eaQrJ1nq+Qjw21BrPyIpR9CPpy2+F1yNauwQ1izX6jBVtKP4hHPizthGUv63qCo7YXEn0BDdqcjp7Ux2L21N/9FzJ+0n1nbo2AhSEQIvLT5pcWb3qT8L/GX6b7U+cW99bZ7vKmh/k+F+3ou86srwKdNNAHMsKm6jk6sn81w8CcAp/iCz91F6knLW4eCQLLkHV3Gs+Hf3CdcnOBb86g9e+IkYL6zGu3319OMrcS5A2e49jhzd9F2Jj/bnIsMWpBrNKvIneNbCtFlm6rBA7Ks8oPI4V+iVP0zGwYlWleEIGeDNs11JK7rpBLhD5F/DKgCPwzV3/Mo93Ym1d7sNZPhTqziGqLE/Z0TI1dIWeYYgdwRYj9Lf/vcaOAvYX1vXcILb6z1c3ovQ6XFbzy2lwWkX+CQhnm45k3HOFpNeG8ib4twRl3l7D9z1Wz5xRzNhf51PT3+PEPK7JdpuacaZqlzqbhAk6lycTwhHLurZtYE= ceph-513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:58:53.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-12T10:58:54.060 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:53 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/184042542' entity='client.admin' 2024-05-12T10:58:54.136 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.338+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/3355406600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 msgr2=0x7fdc54105d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.338+0000 7fdc5bdd6700 1 --2- 172.21.15.86:0/3355406600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 0x7fdc54105d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009910 tx=0x7fdc50009c20 comp rx=0 tx=0).stop 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.338+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/3355406600 shutdown_connections 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.338+0000 7fdc5bdd6700 1 --2- 172.21.15.86:0/3355406600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 0x7fdc54105d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.338+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/3355406600 >> 172.21.15.86:0/3355406600 conn(0x7fdc540fd3a0 msgr2=0x7fdc540ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.338+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/3355406600 shutdown_connections 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.338+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/3355406600 wait complete. 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc5bdd6700 1 Processor -- start 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc5bdd6700 1 -- start start 2024-05-12T10:58:56.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc5bdd6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 0x7fdc541984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc5bdd6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54108de0 con 0x7fdc54103990 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc59b72700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 0x7fdc541984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc59b72700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 0x7fdc541984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56426/0 (socket says 172.21.15.86:56426) 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc59b72700 1 -- 172.21.15.86:0/2144597063 learned_addr learned my addr 172.21.15.86:0/2144597063 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc59b72700 1 -- 172.21.15.86:0/2144597063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc54198a30 con 0x7fdc54103990 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.339+0000 7fdc59b72700 1 --2- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 0x7fdc541984f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdc50005b40 tx=0x7fdc50004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.340+0000 7fdc4affd700 1 -- 172.21.15.86:0/2144597063 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc50027070 con 0x7fdc54103990 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.340+0000 7fdc4affd700 1 -- 172.21.15.86:0/2144597063 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc5000be10 con 0x7fdc54103990 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.340+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc54198d20 con 0x7fdc54103990 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.340+0000 7fdc4affd700 1 -- 172.21.15.86:0/2144597063 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc50022de0 con 0x7fdc54103990 2024-05-12T10:58:56.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.340+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5419b960 con 0x7fdc54103990 2024-05-12T10:58:56.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.340+0000 7fdc4affd700 1 -- 172.21.15.86:0/2144597063 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fdc5002a070 con 0x7fdc54103990 2024-05-12T10:58:56.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.341+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc54109560 con 0x7fdc54103990 2024-05-12T10:58:56.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.341+0000 7fdc4affd700 1 --2- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdc4003e510 0x7fdc400409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:56.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.341+0000 7fdc4affd700 1 -- 172.21.15.86:0/2144597063 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdc5001e030 con 0x7fdc54103990 2024-05-12T10:58:56.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.341+0000 7fdc59371700 1 --2- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdc4003e510 0x7fdc400409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:56.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.341+0000 7fdc59371700 1 --2- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdc4003e510 0x7fdc400409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdc44006fd0 tx=0x7fdc44006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:56.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.346+0000 7fdc4affd700 1 -- 172.21.15.86:0/2144597063 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdc50013070 con 0x7fdc54103990 2024-05-12T10:58:56.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.552+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fdc5402e700 con 0x7fdc54103990 2024-05-12T10:58:56.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.557+0000 7fdc4affd700 1 -- 172.21.15.86:0/2144597063 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fdc50020de0 con 0x7fdc54103990 2024-05-12T10:58:56.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdc4003e510 msgr2=0x7fdc400409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 --2- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdc4003e510 0x7fdc400409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdc44006fd0 tx=0x7fdc44006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:56.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 msgr2=0x7fdc541984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:56.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 --2- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 0x7fdc541984f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdc50005b40 tx=0x7fdc50004f80 comp rx=0 tx=0).stop 2024-05-12T10:58:56.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 shutdown_connections 2024-05-12T10:58:56.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 --2- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdc4003e510 0x7fdc400409d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 --2- 172.21.15.86:0/2144597063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc54103990 0x7fdc541984f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:56.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 >> 172.21.15.86:0/2144597063 conn(0x7fdc540fd3a0 msgr2=0x7fdc540fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:56.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 shutdown_connections 2024-05-12T10:58:56.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:56.560+0000 7fdc5bdd6700 1 -- 172.21.15.86:0/2144597063 wait complete. 2024-05-12T10:58:56.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:56 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:56.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:56 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:56.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:56 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-05-12T10:58:56.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:56 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:56.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:56 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:58:56.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:56 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:57.197 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-12T10:58:57.197 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-12T10:58:57.431 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:58:57.855 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:57 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2144597063' entity='client.admin' 2024-05-12T10:58:57.855 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:58:57.855 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:58:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:58:59.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.019+0000 7fe938b60700 1 -- 172.21.15.86:0/3067519245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 msgr2=0x7fe934102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:59.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.019+0000 7fe938b60700 1 --2- 172.21.15.86:0/3067519245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 0x7fe934102220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe924009910 tx=0x7fe924009c20 comp rx=0 tx=0).stop 2024-05-12T10:58:59.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.019+0000 7fe938b60700 1 -- 172.21.15.86:0/3067519245 shutdown_connections 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.019+0000 7fe938b60700 1 --2- 172.21.15.86:0/3067519245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 0x7fe934102220 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.020+0000 7fe938b60700 1 -- 172.21.15.86:0/3067519245 >> 172.21.15.86:0/3067519245 conn(0x7fe9340fd3a0 msgr2=0x7fe9340ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.020+0000 7fe938b60700 1 -- 172.21.15.86:0/3067519245 shutdown_connections 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.020+0000 7fe938b60700 1 -- 172.21.15.86:0/3067519245 wait complete. 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.020+0000 7fe938b60700 1 Processor -- start 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.020+0000 7fe938b60700 1 -- start start 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe938b60700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 0x7fe934198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe938b60700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe934107cc0 con 0x7fe934101e00 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe93259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 0x7fe934198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe93259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 0x7fe934198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56448/0 (socket says 172.21.15.86:56448) 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe93259c700 1 -- 172.21.15.86:0/265450960 learned_addr learned my addr 172.21.15.86:0/265450960 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:58:59.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe93259c700 1 -- 172.21.15.86:0/265450960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe934198a90 con 0x7fe934101e00 2024-05-12T10:58:59.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe93259c700 1 --2- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 0x7fe934198550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe924005190 tx=0x7fe924004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:59.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe9237fe700 1 -- 172.21.15.86:0/265450960 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe924027070 con 0x7fe934101e00 2024-05-12T10:58:59.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe934198d20 con 0x7fe934101e00 2024-05-12T10:58:59.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe9237fe700 1 -- 172.21.15.86:0/265450960 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe924022470 con 0x7fe934101e00 2024-05-12T10:58:59.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe9237fe700 1 -- 172.21.15.86:0/265450960 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe92400f5f0 con 0x7fe934101e00 2024-05-12T10:58:59.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.021+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe93419ba10 con 0x7fe934101e00 2024-05-12T10:58:59.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.022+0000 7fe9237fe700 1 -- 172.21.15.86:0/265450960 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fe92402a070 con 0x7fe934101e00 2024-05-12T10:58:59.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.022+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe934108440 con 0x7fe934101e00 2024-05-12T10:58:59.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.022+0000 7fe9237fe700 1 --2- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe91c03e510 0x7fe91c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:58:59.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.022+0000 7fe9237fe700 1 -- 172.21.15.86:0/265450960 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe92401e030 con 0x7fe934101e00 2024-05-12T10:58:59.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.023+0000 7fe931d9b700 1 --2- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe91c03e510 0x7fe91c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:58:59.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.023+0000 7fe931d9b700 1 --2- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe91c03e510 0x7fe91c0409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe928006fd0 tx=0x7fe928006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:58:59.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.027+0000 7fe9237fe700 1 -- 172.21.15.86:0/265450960 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe924013070 con 0x7fe934101e00 2024-05-12T10:58:59.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.236+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fe93402e620 con 0x7fe91c03e510 2024-05-12T10:58:59.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.240+0000 7fe9237fe700 1 -- 172.21.15.86:0/265450960 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe93402e620 con 0x7fe91c03e510 2024-05-12T10:58:59.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe91c03e510 msgr2=0x7fe91c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:59.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 --2- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe91c03e510 0x7fe91c0409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe928006fd0 tx=0x7fe928006e40 comp rx=0 tx=0).stop 2024-05-12T10:58:59.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 msgr2=0x7fe934198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:58:59.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 --2- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 0x7fe934198550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe924005190 tx=0x7fe924004f80 comp rx=0 tx=0).stop 2024-05-12T10:58:59.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 shutdown_connections 2024-05-12T10:58:59.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 --2- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe91c03e510 0x7fe91c0409d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:59.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 --2- 172.21.15.86:0/265450960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe934101e00 0x7fe934198550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:58:59.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 >> 172.21.15.86:0/265450960 conn(0x7fe9340fd3a0 msgr2=0x7fe93406b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:58:59.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 shutdown_connections 2024-05-12T10:58:59.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:58:59.242+0000 7fe938b60700 1 -- 172.21.15.86:0/265450960 wait complete. 2024-05-12T10:59:00.013 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-05-12T10:59:00.013 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:59:00.014 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-05-12T10:59:00.032 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:59:00.032 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:00.090 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-05-12T10:59:00.090 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch host add smithi172 2024-05-12T10:59:00.234 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:00.234 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: Updating smithi086:/etc/ceph/ceph.conf 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:00.235 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:00.338 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:59:01.374 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:01 smithi086 ceph-mon[30110]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T10:59:01.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.847+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/3864030904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 msgr2=0x7fcc781023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:01.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.847+0000 7fcc7ff2b700 1 --2- 172.21.15.86:0/3864030904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 0x7fcc781023d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400b0a0 tx=0x7fcc7400b3b0 comp rx=0 tx=0).stop 2024-05-12T10:59:01.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.847+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/3864030904 shutdown_connections 2024-05-12T10:59:01.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.847+0000 7fcc7ff2b700 1 --2- 172.21.15.86:0/3864030904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 0x7fcc781023d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:01.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.847+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/3864030904 >> 172.21.15.86:0/3864030904 conn(0x7fcc780fd8a0 msgr2=0x7fcc780ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:01.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.847+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/3864030904 shutdown_connections 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.847+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/3864030904 wait complete. 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7ff2b700 1 Processor -- start 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7ff2b700 1 -- start start 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7ff2b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 0x7fcc7819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7ff2b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7810c270 con 0x7fcc78101ff0 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7dcc7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 0x7fcc7819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7dcc7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 0x7fcc7819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46010/0 (socket says 172.21.15.86:46010) 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7dcc7700 1 -- 172.21.15.86:0/2407805148 learned_addr learned my addr 172.21.15.86:0/2407805148 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7dcc7700 1 -- 172.21.15.86:0/2407805148 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7819eb60 con 0x7fcc78101ff0 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.848+0000 7fcc7dcc7700 1 --2- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 0x7fcc7819e620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006130 tx=0x7fcc740097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.849+0000 7fcc6effd700 1 -- 172.21.15.86:0/2407805148 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc74021020 con 0x7fcc78101ff0 2024-05-12T10:59:01.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.849+0000 7fcc6effd700 1 -- 172.21.15.86:0/2407805148 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc740079b0 con 0x7fcc78101ff0 2024-05-12T10:59:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.849+0000 7fcc6effd700 1 -- 172.21.15.86:0/2407805148 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc74017040 con 0x7fcc78101ff0 2024-05-12T10:59:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.849+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7819edf0 con 0x7fcc78101ff0 2024-05-12T10:59:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.849+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc781987a0 con 0x7fcc78101ff0 2024-05-12T10:59:01.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.849+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc781034d0 con 0x7fcc78101ff0 2024-05-12T10:59:01.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.850+0000 7fcc6effd700 1 -- 172.21.15.86:0/2407805148 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fcc74024020 con 0x7fcc78101ff0 2024-05-12T10:59:01.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.850+0000 7fcc6effd700 1 --2- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcc6403e570 0x7fcc64040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:01.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.850+0000 7fcc6effd700 1 -- 172.21.15.86:0/2407805148 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcc7400f050 con 0x7fcc78101ff0 2024-05-12T10:59:01.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.850+0000 7fcc7d4c6700 1 --2- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcc6403e570 0x7fcc64040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:01.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.850+0000 7fcc7d4c6700 1 --2- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcc6403e570 0x7fcc64040a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcc68006fd0 tx=0x7fcc68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:01.855+0000 7fcc6effd700 1 -- 172.21.15.86:0/2407805148 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcc7402b020 con 0x7fcc78101ff0 2024-05-12T10:59:02.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:02.064+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) -- 0x7fcc78064b00 con 0x7fcc6403e570 2024-05-12T10:59:03.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:02 smithi086 ceph-mon[30110]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:03.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:02 smithi086 ceph-mon[30110]: Deploying cephadm binary to smithi172 2024-05-12T10:59:05.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:04 smithi086 ceph-mon[30110]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.305+0000 7fcc6effd700 1 -- 172.21.15.86:0/2407805148 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fcc78064b00 con 0x7fcc6403e570 2024-05-12T10:59:06.299 INFO:teuthology.orchestra.run.smithi086.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcc6403e570 msgr2=0x7fcc64040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 --2- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcc6403e570 0x7fcc64040a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcc68006fd0 tx=0x7fcc68006e40 comp rx=0 tx=0).stop 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 msgr2=0x7fcc7819e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 --2- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 0x7fcc7819e620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006130 tx=0x7fcc740097d0 comp rx=0 tx=0).stop 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 shutdown_connections 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 --2- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcc6403e570 0x7fcc64040a30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 --2- 172.21.15.86:0/2407805148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc78101ff0 0x7fcc7819e620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 >> 172.21.15.86:0/2407805148 conn(0x7fcc780fd8a0 msgr2=0x7fcc7806b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 shutdown_connections 2024-05-12T10:59:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:06.308+0000 7fcc7ff2b700 1 -- 172.21.15.86:0/2407805148 wait complete. 2024-05-12T10:59:06.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-12T10:59:07.141 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:59:07.592 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:07 smithi086 ceph-mon[30110]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:07.592 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:07.592 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:07 smithi086 ceph-mon[30110]: Added host smithi172 2024-05-12T10:59:07.592 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:07.592 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:08.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:08 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.708+0000 7f1b6b053700 1 -- 172.21.15.86:0/717133054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 msgr2=0x7f1b641023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.708+0000 7f1b6b053700 1 --2- 172.21.15.86:0/717133054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 0x7f1b641023d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009910 tx=0x7f1b58009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.708+0000 7f1b6b053700 1 -- 172.21.15.86:0/717133054 shutdown_connections 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.708+0000 7f1b6b053700 1 --2- 172.21.15.86:0/717133054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 0x7f1b641023d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.708+0000 7f1b6b053700 1 -- 172.21.15.86:0/717133054 >> 172.21.15.86:0/717133054 conn(0x7f1b640fd8a0 msgr2=0x7f1b640ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.708+0000 7f1b6b053700 1 -- 172.21.15.86:0/717133054 shutdown_connections 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.708+0000 7f1b6b053700 1 -- 172.21.15.86:0/717133054 wait complete. 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b6b053700 1 Processor -- start 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b6b053700 1 -- start start 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b6b053700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 0x7f1b64199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b6b053700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6410c270 con 0x7f1b64101ff0 2024-05-12T10:59:08.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b68def700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 0x7f1b64199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b68def700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 0x7f1b64199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46028/0 (socket says 172.21.15.86:46028) 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b68def700 1 -- 172.21.15.86:0/1221430383 learned_addr learned my addr 172.21.15.86:0/1221430383 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b68def700 1 -- 172.21.15.86:0/1221430383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b64199c90 con 0x7f1b64101ff0 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.709+0000 7f1b68def700 1 --2- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 0x7f1b64199750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b580056d0 tx=0x7f1b580057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.710+0000 7f1b61ffb700 1 -- 172.21.15.86:0/1221430383 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b58026070 con 0x7f1b64101ff0 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.710+0000 7f1b61ffb700 1 -- 172.21.15.86:0/1221430383 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b5800bba0 con 0x7f1b64101ff0 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.710+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b64199f80 con 0x7f1b64101ff0 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.710+0000 7f1b61ffb700 1 -- 172.21.15.86:0/1221430383 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b58003920 con 0x7f1b64101ff0 2024-05-12T10:59:08.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.710+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6419a440 con 0x7f1b64101ff0 2024-05-12T10:59:08.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.711+0000 7f1b61ffb700 1 -- 172.21.15.86:0/1221430383 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f1b58029070 con 0x7f1b64101ff0 2024-05-12T10:59:08.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.711+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b641034d0 con 0x7f1b64101ff0 2024-05-12T10:59:08.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.711+0000 7f1b61ffb700 1 --2- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1b5403e570 0x7f1b54040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:08.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.711+0000 7f1b61ffb700 1 -- 172.21.15.86:0/1221430383 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1b5801e070 con 0x7f1b64101ff0 2024-05-12T10:59:08.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.711+0000 7f1b63fff700 1 --2- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1b5403e570 0x7f1b54040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:08.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.712+0000 7f1b63fff700 1 --2- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1b5403e570 0x7f1b54040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1b50006fd0 tx=0x7f1b50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:08.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.716+0000 7f1b61ffb700 1 -- 172.21.15.86:0/1221430383 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1b58013070 con 0x7f1b64101ff0 2024-05-12T10:59:08.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.924+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b6406b740 con 0x7f1b5403e570 2024-05-12T10:59:08.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.925+0000 7f1b61ffb700 1 -- 172.21.15.86:0/1221430383 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f1b6406b740 con 0x7f1b5403e570 2024-05-12T10:59:08.918 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:59:08.918 INFO:teuthology.orchestra.run.smithi086.stdout:[{"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1b5403e570 msgr2=0x7f1b54040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 --2- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1b5403e570 0x7f1b54040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1b50006fd0 tx=0x7f1b50006e40 comp rx=0 tx=0).stop 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 msgr2=0x7f1b64199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 --2- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 0x7f1b64199750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b580056d0 tx=0x7f1b580057b0 comp rx=0 tx=0).stop 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 shutdown_connections 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 --2- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1b5403e570 0x7f1b54040a30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 --2- 172.21.15.86:0/1221430383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b64101ff0 0x7f1b64199750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 >> 172.21.15.86:0/1221430383 conn(0x7f1b640fd8a0 msgr2=0x7f1b641039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 shutdown_connections 2024-05-12T10:59:08.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:08.928+0000 7f1b6b053700 1 -- 172.21.15.86:0/1221430383 wait complete. 2024-05-12T10:59:09.468 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:09 smithi086 ceph-mon[30110]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:09.468 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:09.499 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi176 2024-05-12T10:59:09.500 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:59:09.500 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/etc/ceph/ceph.conf 2024-05-12T10:59:09.517 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:59:09.518 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:09.575 INFO:tasks.cephadm:Adding host smithi176 to orchestrator... 2024-05-12T10:59:09.575 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch host add smithi176 2024-05-12T10:59:09.816 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:59:10.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:10 smithi086 ceph-mon[30110]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T10:59:11.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.295+0000 7f2a2d888700 1 -- 172.21.15.86:0/3412229048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 msgr2=0x7f2a281023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:11.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.295+0000 7f2a2d888700 1 --2- 172.21.15.86:0/3412229048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 0x7f2a281023d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009910 tx=0x7f2a18009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:11.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.295+0000 7f2a2d888700 1 -- 172.21.15.86:0/3412229048 shutdown_connections 2024-05-12T10:59:11.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.295+0000 7f2a2d888700 1 --2- 172.21.15.86:0/3412229048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 0x7f2a281023d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:11.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.295+0000 7f2a2d888700 1 -- 172.21.15.86:0/3412229048 >> 172.21.15.86:0/3412229048 conn(0x7f2a280fd8a0 msgr2=0x7f2a280ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:11.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.295+0000 7f2a2d888700 1 -- 172.21.15.86:0/3412229048 shutdown_connections 2024-05-12T10:59:11.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.295+0000 7f2a2d888700 1 -- 172.21.15.86:0/3412229048 wait complete. 2024-05-12T10:59:11.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.296+0000 7f2a2d888700 1 Processor -- start 2024-05-12T10:59:11.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.296+0000 7f2a2d888700 1 -- start start 2024-05-12T10:59:11.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.296+0000 7f2a2d888700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 0x7f2a28199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:11.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.296+0000 7f2a2d888700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2810c270 con 0x7f2a28101ff0 2024-05-12T10:59:11.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.296+0000 7f2a26ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 0x7f2a28199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.296+0000 7f2a26ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 0x7f2a28199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46046/0 (socket says 172.21.15.86:46046) 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.296+0000 7f2a26ffd700 1 -- 172.21.15.86:0/1944831968 learned_addr learned my addr 172.21.15.86:0/1944831968 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.296+0000 7f2a26ffd700 1 -- 172.21.15.86:0/1944831968 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a28199c70 con 0x7f2a28101ff0 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.297+0000 7f2a26ffd700 1 --2- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 0x7f2a28199730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a180056d0 tx=0x7f2a180057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.297+0000 7f2a2c886700 1 -- 172.21.15.86:0/1944831968 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a18026070 con 0x7f2a28101ff0 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.297+0000 7f2a2c886700 1 -- 172.21.15.86:0/1944831968 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a1800bba0 con 0x7f2a28101ff0 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.297+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a28199f60 con 0x7f2a28101ff0 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.297+0000 7f2a2c886700 1 -- 172.21.15.86:0/1944831968 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a18003920 con 0x7f2a28101ff0 2024-05-12T10:59:11.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.297+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2819a420 con 0x7f2a28101ff0 2024-05-12T10:59:11.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.298+0000 7f2a2c886700 1 -- 172.21.15.86:0/1944831968 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f2a18029070 con 0x7f2a28101ff0 2024-05-12T10:59:11.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.298+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a281034d0 con 0x7f2a28101ff0 2024-05-12T10:59:11.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.298+0000 7f2a2c886700 1 --2- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a1003e510 0x7f2a100409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:11.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.298+0000 7f2a2c886700 1 -- 172.21.15.86:0/1944831968 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2a1801e070 con 0x7f2a28101ff0 2024-05-12T10:59:11.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.298+0000 7f2a267fc700 1 --2- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a1003e510 0x7f2a100409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:11.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.299+0000 7f2a267fc700 1 --2- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a1003e510 0x7f2a100409d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c006fd0 tx=0x7f2a1c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:11.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.303+0000 7f2a2c886700 1 -- 172.21.15.86:0/1944831968 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2a18013070 con 0x7f2a28101ff0 2024-05-12T10:59:11.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:11.510+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi176", "target": ["mon-mgr", ""]}) -- 0x7f2a2806b760 con 0x7f2a1003e510 2024-05-12T10:59:11.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:11 smithi086 ceph-mon[30110]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:12.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:12 smithi086 ceph-mon[30110]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi176", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:12.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:12.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:12.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:12.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:12.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-05-12T10:59:12.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:12.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:13.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:13 smithi086 ceph-mon[30110]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:13.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:13 smithi086 ceph-mon[30110]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T10:59:13.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:13 smithi086 ceph-mon[30110]: Deploying cephadm binary to smithi176 2024-05-12T10:59:13.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:13 smithi086 ceph-mon[30110]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:13.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:13 smithi086 ceph-mon[30110]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:15.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.538+0000 7f2a2c886700 1 -- 172.21.15.86:0/1944831968 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f2a2806b760 con 0x7f2a1003e510 2024-05-12T10:59:15.530 INFO:teuthology.orchestra.run.smithi086.stdout:Added host 'smithi176' with addr '172.21.15.176' 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a1003e510 msgr2=0x7f2a100409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 --2- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a1003e510 0x7f2a100409d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c006fd0 tx=0x7f2a1c006e40 comp rx=0 tx=0).stop 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 msgr2=0x7f2a28199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 --2- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 0x7f2a28199730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a180056d0 tx=0x7f2a180057b0 comp rx=0 tx=0).stop 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 shutdown_connections 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 --2- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a1003e510 0x7f2a100409d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 --2- 172.21.15.86:0/1944831968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28101ff0 0x7f2a28199730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 >> 172.21.15.86:0/1944831968 conn(0x7f2a280fd8a0 msgr2=0x7f2a281039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:15.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 shutdown_connections 2024-05-12T10:59:15.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:15.541+0000 7f2a2d888700 1 -- 172.21.15.86:0/1944831968 wait complete. 2024-05-12T10:59:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:15 smithi086 ceph-mon[30110]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:16.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-12T10:59:16.378 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:59:16.759 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:16 smithi086 ceph-mon[30110]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T10:59:16.759 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:16 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:16.759 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:16 smithi086 ceph-mon[30110]: Added host smithi176 2024-05-12T10:59:16.759 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:16 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:16.759 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:16 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:17.848 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:17 smithi086 ceph-mon[30110]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:17.848 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:17.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.883+0000 7f68ad01c700 1 -- 172.21.15.86:0/413443856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 msgr2=0x7f68a8102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.883+0000 7f68ad01c700 1 --2- 172.21.15.86:0/413443856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 0x7f68a8102430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6890009910 tx=0x7f6890009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.883+0000 7f68ad01c700 1 -- 172.21.15.86:0/413443856 shutdown_connections 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.883+0000 7f68ad01c700 1 --2- 172.21.15.86:0/413443856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 0x7f68a8102430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.883+0000 7f68ad01c700 1 -- 172.21.15.86:0/413443856 >> 172.21.15.86:0/413443856 conn(0x7f68a8077900 msgr2=0x7f68a8077d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.883+0000 7f68ad01c700 1 -- 172.21.15.86:0/413443856 shutdown_connections 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.883+0000 7f68ad01c700 1 -- 172.21.15.86:0/413443856 wait complete. 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.884+0000 7f68ad01c700 1 Processor -- start 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.884+0000 7f68ad01c700 1 -- start start 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.884+0000 7f68ad01c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 0x7f68a81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.884+0000 7f68ad01c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68a810c280 con 0x7f68a8102050 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f68a6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 0x7f68a81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f68a6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 0x7f68a81997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40588/0 (socket says 172.21.15.86:40588) 2024-05-12T10:59:17.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f68a6d9d700 1 -- 172.21.15.86:0/953402032 learned_addr learned my addr 172.21.15.86:0/953402032 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:59:17.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f68a6d9d700 1 -- 172.21.15.86:0/953402032 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a8199cf0 con 0x7f68a8102050 2024-05-12T10:59:17.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f68a6d9d700 1 --2- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 0x7f68a81997b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68900056d0 tx=0x7f68900057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:17.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f689ffff700 1 -- 172.21.15.86:0/953402032 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6890026070 con 0x7f68a8102050 2024-05-12T10:59:17.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f689ffff700 1 -- 172.21.15.86:0/953402032 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f689000bba0 con 0x7f68a8102050 2024-05-12T10:59:17.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a8199fe0 con 0x7f68a8102050 2024-05-12T10:59:17.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f689ffff700 1 -- 172.21.15.86:0/953402032 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6890003920 con 0x7f68a8102050 2024-05-12T10:59:17.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.885+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a819a4a0 con 0x7f68a8102050 2024-05-12T10:59:17.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.886+0000 7f689ffff700 1 -- 172.21.15.86:0/953402032 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f6890029070 con 0x7f68a8102050 2024-05-12T10:59:17.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.886+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a81034e0 con 0x7f68a8102050 2024-05-12T10:59:17.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.886+0000 7f689ffff700 1 --2- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f689403e510 0x7f68940409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:17.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.886+0000 7f689ffff700 1 -- 172.21.15.86:0/953402032 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f689001e070 con 0x7f68a8102050 2024-05-12T10:59:17.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.886+0000 7f68a659c700 1 --2- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f689403e510 0x7f68940409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:17.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.887+0000 7f68a659c700 1 --2- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f689403e510 0x7f68940409d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6898006fd0 tx=0x7f6898006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:17.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:17.892+0000 7f689ffff700 1 -- 172.21.15.86:0/953402032 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6890013070 con 0x7f68a8102050 2024-05-12T10:59:18.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.104+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68a806ae80 con 0x7f689403e510 2024-05-12T10:59:18.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.105+0000 7f689ffff700 1 -- 172.21.15.86:0/953402032 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f68a806ae80 con 0x7f689403e510 2024-05-12T10:59:18.097 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T10:59:18.097 INFO:teuthology.orchestra.run.smithi086.stdout:[{"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}, {"addr": "172.21.15.176", "hostname": "smithi176", "labels": [], "status": ""}] 2024-05-12T10:59:18.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f689403e510 msgr2=0x7f68940409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 --2- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f689403e510 0x7f68940409d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6898006fd0 tx=0x7f6898006e40 comp rx=0 tx=0).stop 2024-05-12T10:59:18.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 msgr2=0x7f68a81997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:18.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 --2- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 0x7f68a81997b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68900056d0 tx=0x7f68900057b0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 shutdown_connections 2024-05-12T10:59:18.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 --2- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f689403e510 0x7f68940409d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 --2- 172.21.15.86:0/953402032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8102050 0x7f68a81997b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:18.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 >> 172.21.15.86:0/953402032 conn(0x7f68a8077900 msgr2=0x7f68a81039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:18.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 shutdown_connections 2024-05-12T10:59:18.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:18.107+0000 7f68ad01c700 1 -- 172.21.15.86:0/953402032 wait complete. 2024-05-12T10:59:18.698 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-12T10:59:18.699 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd crush tunables default 2024-05-12T10:59:18.935 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:59:19.313 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:19 smithi086 ceph-mon[30110]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:19.313 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:19 smithi086 ceph-mon[30110]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T10:59:19.313 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:20.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.532+0000 7f90bb16d700 1 -- 172.21.15.86:0/2008538220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 msgr2=0x7f90b41034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:20.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.532+0000 7f90bb16d700 1 --2- 172.21.15.86:0/2008538220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 0x7f90b41034f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009910 tx=0x7f90a8009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.532+0000 7f90bb16d700 1 -- 172.21.15.86:0/2008538220 shutdown_connections 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.532+0000 7f90bb16d700 1 --2- 172.21.15.86:0/2008538220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 0x7f90b41034f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.532+0000 7f90bb16d700 1 -- 172.21.15.86:0/2008538220 >> 172.21.15.86:0/2008538220 conn(0x7f90b40fe9e0 msgr2=0x7f90b4100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.532+0000 7f90bb16d700 1 -- 172.21.15.86:0/2008538220 shutdown_connections 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.532+0000 7f90bb16d700 1 -- 172.21.15.86:0/2008538220 wait complete. 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.533+0000 7f90bb16d700 1 Processor -- start 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.533+0000 7f90bb16d700 1 -- start start 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.533+0000 7f90bb16d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 0x7f90b41a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.533+0000 7f90bb16d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90b410d390 con 0x7f90b4103110 2024-05-12T10:59:20.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.533+0000 7f90b8f09700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 0x7f90b41a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.533+0000 7f90b8f09700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 0x7f90b41a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40610/0 (socket says 172.21.15.86:40610) 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.533+0000 7f90b8f09700 1 -- 172.21.15.86:0/2905390523 learned_addr learned my addr 172.21.15.86:0/2905390523 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.534+0000 7f90b8f09700 1 -- 172.21.15.86:0/2905390523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b41a0cb0 con 0x7f90b4103110 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.534+0000 7f90b8f09700 1 --2- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 0x7f90b41a0770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f90a80056d0 tx=0x7f90a80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.534+0000 7f90b1ffb700 1 -- 172.21.15.86:0/2905390523 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90a8026070 con 0x7f90b4103110 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.534+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b41a0fa0 con 0x7f90b4103110 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.534+0000 7f90b1ffb700 1 -- 172.21.15.86:0/2905390523 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90a800bba0 con 0x7f90b4103110 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.534+0000 7f90b1ffb700 1 -- 172.21.15.86:0/2905390523 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90a8003920 con 0x7f90b4103110 2024-05-12T10:59:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.534+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b419a930 con 0x7f90b4103110 2024-05-12T10:59:20.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.535+0000 7f90b1ffb700 1 -- 172.21.15.86:0/2905390523 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f90a8029070 con 0x7f90b4103110 2024-05-12T10:59:20.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.535+0000 7f90b1ffb700 1 --2- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f90a403e510 0x7f90a40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:20.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.535+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b41045f0 con 0x7f90b4103110 2024-05-12T10:59:20.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.535+0000 7f90b1ffb700 1 -- 172.21.15.86:0/2905390523 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f90a801e070 con 0x7f90b4103110 2024-05-12T10:59:20.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.535+0000 7f90b3fff700 1 --2- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f90a403e510 0x7f90a40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:20.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.536+0000 7f90b3fff700 1 --2- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f90a403e510 0x7f90a40409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f90a0006fd0 tx=0x7f90a0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:20.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.540+0000 7f90b1ffb700 1 -- 172.21.15.86:0/2905390523 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f90a8013070 con 0x7f90b4103110 2024-05-12T10:59:20.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:20.748+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f90b419be60 con 0x7f90b4103110 2024-05-12T10:59:21.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.123+0000 7f90b1ffb700 1 -- 172.21.15.86:0/2905390523 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f90a8030020 con 0x7f90b4103110 2024-05-12T10:59:21.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f90a403e510 msgr2=0x7f90a40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:21.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 --2- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f90a403e510 0x7f90a40409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f90a0006fd0 tx=0x7f90a0006e40 comp rx=0 tx=0).stop 2024-05-12T10:59:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 msgr2=0x7f90b41a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 --2- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 0x7f90b41a0770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f90a80056d0 tx=0x7f90a80057b0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 shutdown_connections 2024-05-12T10:59:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 --2- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f90a403e510 0x7f90a40409d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 --2- 172.21.15.86:0/2905390523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b4103110 0x7f90b41a0770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 >> 172.21.15.86:0/2905390523 conn(0x7f90b40fe9e0 msgr2=0x7f90b40756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 shutdown_connections 2024-05-12T10:59:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:21.126+0000 7f90bb16d700 1 -- 172.21.15.86:0/2905390523 wait complete. 2024-05-12T10:59:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:adjusted tunables profile to default 2024-05-12T10:59:21.439 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:21.439 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2905390523' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-12T10:59:21.439 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:21.439 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:21.440 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:21.440 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:21.440 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi176", "name": "osd_memory_target"}]: dispatch 2024-05-12T10:59:21.440 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:21.440 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:21.751 INFO:tasks.cephadm:Adding mon.a on smithi086 2024-05-12T10:59:21.751 INFO:tasks.cephadm:Adding mon.b on smithi172 2024-05-12T10:59:21.751 INFO:tasks.cephadm:Adding mon.c on smithi176 2024-05-12T10:59:21.751 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch apply mon '3;smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c' 2024-05-12T10:59:21.981 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T10:59:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2905390523' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-12T10:59:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:22.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T10:59:22.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:22.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:22.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:23.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.293+0000 7f4cd8d75700 1 -- 172.21.15.176:0/2645086517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 msgr2=0x7f4cd41044b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:23.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.293+0000 7f4cd8d75700 1 --2- 172.21.15.176:0/2645086517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 0x7f4cd41044b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009910 tx=0x7f4cc8009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:23.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.293+0000 7f4cd8d75700 1 -- 172.21.15.176:0/2645086517 shutdown_connections 2024-05-12T10:59:23.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.293+0000 7f4cd8d75700 1 --2- 172.21.15.176:0/2645086517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 0x7f4cd41044b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:23.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.293+0000 7f4cd8d75700 1 -- 172.21.15.176:0/2645086517 >> 172.21.15.176:0/2645086517 conn(0x7f4cd40fd8c0 msgr2=0x7f4cd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:23.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.293+0000 7f4cd8d75700 1 -- 172.21.15.176:0/2645086517 shutdown_connections 2024-05-12T10:59:23.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.293+0000 7f4cd8d75700 1 -- 172.21.15.176:0/2645086517 wait complete. 2024-05-12T10:59:23.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.294+0000 7f4cd8d75700 1 Processor -- start 2024-05-12T10:59:23.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.294+0000 7f4cd8d75700 1 -- start start 2024-05-12T10:59:23.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.294+0000 7f4cd8d75700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 0x7f4cd419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:23.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.294+0000 7f4cd8d75700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd410d400 con 0x7f4cd41040d0 2024-05-12T10:59:23.288 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.294+0000 7f4cd259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 0x7f4cd419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.294+0000 7f4cd259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 0x7f4cd419e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.176:42650/0 (socket says 172.21.15.176:42650) 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.294+0000 7f4cd259c700 1 -- 172.21.15.176:0/3483832616 learned_addr learned my addr 172.21.15.176:0/3483832616 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.294+0000 7f4cd259c700 1 -- 172.21.15.176:0/3483832616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd419ebf0 con 0x7f4cd41040d0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.295+0000 7f4cd259c700 1 --2- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 0x7f4cd419e6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80056d0 tx=0x7f4cc80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.295+0000 7f4cc37fe700 1 -- 172.21.15.176:0/3483832616 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8026070 con 0x7f4cd41040d0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.295+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd419ee80 con 0x7f4cd41040d0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.295+0000 7f4cc37fe700 1 -- 172.21.15.176:0/3483832616 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cc8004370 con 0x7f4cd41040d0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.295+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd4198830 con 0x7f4cd41040d0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.295+0000 7f4cc37fe700 1 -- 172.21.15.176:0/3483832616 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8003990 con 0x7f4cd41040d0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.296+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd406bbd0 con 0x7f4cd41040d0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.296+0000 7f4cc37fe700 1 -- 172.21.15.176:0/3483832616 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f4cc8029070 con 0x7f4cd41040d0 2024-05-12T10:59:23.289 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.296+0000 7f4cc37fe700 1 --2- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4cbc03e510 0x7f4cbc0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:23.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.296+0000 7f4cc37fe700 1 -- 172.21.15.176:0/3483832616 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4cc801e070 con 0x7f4cd41040d0 2024-05-12T10:59:23.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.297+0000 7f4cd1d9b700 1 --2- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4cbc03e510 0x7f4cbc0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:23.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.297+0000 7f4cd1d9b700 1 --2- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4cbc03e510 0x7f4cbc0409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4006fd0 tx=0x7f4cc4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:23.294 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.302+0000 7f4cc37fe700 1 -- 172.21.15.176:0/3483832616 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4cc8013070 con 0x7f4cd41040d0 2024-05-12T10:59:23.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:23 smithi086 ceph-mon[30110]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:23.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.515+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c", "target": ["mon-mgr", ""]}) -- 0x7f4cd4199d60 con 0x7f4cbc03e510 2024-05-12T10:59:23.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.521+0000 7f4cc37fe700 1 -- 172.21.15.176:0/3483832616 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4cd4199d60 con 0x7f4cbc03e510 2024-05-12T10:59:23.514 INFO:teuthology.orchestra.run.smithi176.stdout:Scheduled mon update... 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4cbc03e510 msgr2=0x7f4cbc0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 --2- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4cbc03e510 0x7f4cbc0409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4006fd0 tx=0x7f4cc4006e40 comp rx=0 tx=0).stop 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 msgr2=0x7f4cd419e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 --2- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 0x7f4cd419e6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80056d0 tx=0x7f4cc80057b0 comp rx=0 tx=0).stop 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 shutdown_connections 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 --2- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4cbc03e510 0x7f4cbc0409d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 --2- 172.21.15.176:0/3483832616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd41040d0 0x7f4cd419e6b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 >> 172.21.15.176:0/3483832616 conn(0x7f4cd40fd8c0 msgr2=0x7f4cd4104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 shutdown_connections 2024-05-12T10:59:23.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:23.524+0000 7f4cd8d75700 1 -- 172.21.15.176:0/3483832616 wait complete. 2024-05-12T10:59:24.081 DEBUG:teuthology.orchestra.run.smithi172:mon.b> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.b.service 2024-05-12T10:59:24.083 DEBUG:teuthology.orchestra.run.smithi176:mon.c> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.c.service 2024-05-12T10:59:24.086 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-12T10:59:24.086 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-12T10:59:24.829 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:24.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:24.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: Saving service mon spec with placement smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c;count:3 2024-05-12T10:59:24.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:24.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:24.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:24.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:24.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:24.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:24.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:24.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:24 smithi086 ceph-mon[30110]: Deploying daemon mon.c on smithi176 2024-05-12T10:59:25.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:25 smithi086 ceph-mon[30110]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:27.753 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.760+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/165075047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 msgr2=0x7fbbe41023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:27.753 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.760+0000 7fbbe9f1a700 1 --2- 172.21.15.176:0/165075047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 0x7fbbe41023f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009910 tx=0x7fbbd4009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:27.753 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.760+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/165075047 shutdown_connections 2024-05-12T10:59:27.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.760+0000 7fbbe9f1a700 1 --2- 172.21.15.176:0/165075047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 0x7fbbe41023f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:27.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.760+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/165075047 >> 172.21.15.176:0/165075047 conn(0x7fbbe40fd8c0 msgr2=0x7fbbe40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:27.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.760+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/165075047 shutdown_connections 2024-05-12T10:59:27.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.760+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/165075047 wait complete. 2024-05-12T10:59:27.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.761+0000 7fbbe9f1a700 1 Processor -- start 2024-05-12T10:59:27.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.761+0000 7fbbe9f1a700 1 -- start start 2024-05-12T10:59:27.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.761+0000 7fbbe9f1a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 0x7fbbe419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:27.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.761+0000 7fbbe9f1a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe410c290 con 0x7fbbe4102010 2024-05-12T10:59:27.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 0x7fbbe419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:27.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 0x7fbbe419e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.176:52852/0 (socket says 172.21.15.176:52852) 2024-05-12T10:59:27.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe37fe700 1 -- 172.21.15.176:0/3261473687 learned_addr learned my addr 172.21.15.176:0/3261473687 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T10:59:27.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe37fe700 1 -- 172.21.15.176:0/3261473687 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe419eb70 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe37fe700 1 --2- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 0x7fbbe419e630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40056d0 tx=0x7fbbd40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe0ff9700 1 -- 172.21.15.176:0/3261473687 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd4026070 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe419ee60 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe0ff9700 1 -- 172.21.15.176:0/3261473687 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbd400bba0 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe0ff9700 1 -- 172.21.15.176:0/3261473687 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd4003920 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.762+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe41988d0 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.763+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe41034f0 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.763+0000 7fbbe0ff9700 1 -- 172.21.15.176:0/3261473687 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fbbd4029070 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.764+0000 7fbbe0ff9700 1 --2- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fbbcc03e510 0x7fbbcc0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.764+0000 7fbbe0ff9700 1 -- 172.21.15.176:0/3261473687 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbbd401e070 con 0x7fbbe4102010 2024-05-12T10:59:27.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.764+0000 7fbbe2ffd700 1 --2- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fbbcc03e510 0x7fbbcc0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:27.758 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.764+0000 7fbbe2ffd700 1 --2- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fbbcc03e510 0x7fbbcc0409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8006fd0 tx=0x7fbbd8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:27.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:27.769+0000 7fbbe0ff9700 1 -- 172.21.15.176:0/3261473687 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbbd4013070 con 0x7fbbe4102010 2024-05-12T10:59:27.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:27 smithi086 ceph-mon[30110]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:28.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.082+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbbe40008d0 con 0x7fbbe4102010 2024-05-12T10:59:28.075 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.083+0000 7fbbe0ff9700 1 -- 172.21.15.176:0/3261473687 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fbbd4030020 con 0x7fbbe4102010 2024-05-12T10:59:28.075 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:59:28.076 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","modified":"2024-05-12T10:57:46.072176Z","created":"2024-05-12T10:57:46.072176Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-12T10:59:28.077 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fbbcc03e510 msgr2=0x7fbbcc0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:28.077 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 --2- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fbbcc03e510 0x7fbbcc0409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8006fd0 tx=0x7fbbd8006e40 comp rx=0 tx=0).stop 2024-05-12T10:59:28.078 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 msgr2=0x7fbbe419e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:28.078 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 --2- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 0x7fbbe419e630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40056d0 tx=0x7fbbd40057b0 comp rx=0 tx=0).stop 2024-05-12T10:59:28.078 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 shutdown_connections 2024-05-12T10:59:28.078 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 --2- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fbbcc03e510 0x7fbbcc0409d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:28.078 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 --2- 172.21.15.176:0/3261473687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4102010 0x7fbbe419e630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:28.078 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 >> 172.21.15.176:0/3261473687 conn(0x7fbbe40fd8c0 msgr2=0x7fbbe406b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:28.078 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 shutdown_connections 2024-05-12T10:59:28.078 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:28.085+0000 7fbbe9f1a700 1 -- 172.21.15.176:0/3261473687 wait complete. 2024-05-12T10:59:28.079 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-05-12T10:59:28.404 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:28 smithi176 systemd[1]: Starting Ceph mon.c for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T10:59:28.918 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:28 smithi176 podman[34338]: 2024-05-12 10:59:28.846180111 +0000 UTC m=+0.096591428 container create f56d1b53be8d5ec8de4e2f38175721da9a6bb339ca3e588f8712cdcf55252e55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-12T10:59:28.918 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:28 smithi176 podman[34338]: 2024-05-12 10:59:28.769001702 +0000 UTC m=+0.019413000 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T10:59:28.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:28 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/3261473687' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 podman[34338]: 2024-05-12 10:59:29.015242757 +0000 UTC m=+0.265654028 container init f56d1b53be8d5ec8de4e2f38175721da9a6bb339ca3e588f8712cdcf55252e55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 podman[34338]: 2024-05-12 10:59:29.018335228 +0000 UTC m=+0.268746502 container start f56d1b53be8d5ec8de4e2f38175721da9a6bb339ca3e588f8712cdcf55252e55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: set uid:gid to 167:167 (ceph:ceph) 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: ceph version 19.0.0-3517-gf1ec8823 (f1ec882358465db8f363a3865fa83f099183688a) squid (dev), process ceph-mon, pid 2 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pidfile_write: ignore empty --pid-file 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: load: jerasure load: lrc 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: RocksDB version: 7.9.2 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Git sha 0 2024-05-12T10:59:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Compile date 2024-05-12 01:22:03 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: DB SUMMARY 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: DB Session ID: URBGSCGSNFE6DZZPW99W 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: CURRENT file: CURRENT 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: IDENTITY file: IDENTITY 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.error_if_exists: 0 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.create_if_missing: 0 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.paranoid_checks: 1 2024-05-12T10:59:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.env: 0x5611d78e7cc0 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.fs: PosixFileSystem 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.info_log: 0x5611d8b91da0 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_file_opening_threads: 16 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.statistics: (nil) 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.use_fsync: 0 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_log_file_size: 0 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-12T10:59:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.keep_log_file_num: 1000 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.recycle_log_file_num: 0 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.allow_fallocate: 1 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.allow_mmap_reads: 0 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.allow_mmap_writes: 0 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.use_direct_reads: 0 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.create_missing_column_families: 0 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.db_log_dir: 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.wal_dir: 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-12T10:59:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.advise_random_on_open: 1 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.db_write_buffer_size: 0 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.write_buffer_manager: 0x5611d8b630e0 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.rate_limiter: (nil) 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-12T10:59:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.wal_recovery_mode: 2 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.enable_thread_tracking: 0 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.enable_pipelined_write: 0 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.unordered_write: 0 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.row_cache: None 2024-05-12T10:59:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.wal_filter: None 2024-05-12T10:59:29.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-12T10:59:29.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.allow_ingest_behind: 0 2024-05-12T10:59:29.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.two_write_queues: 0 2024-05-12T10:59:29.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.manual_wal_flush: 0 2024-05-12T10:59:29.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.wal_compression: 0 2024-05-12T10:59:29.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.atomic_flush: 0 2024-05-12T10:59:29.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-12T10:59:29.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.log_readahead_size: 0 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.best_efforts_recovery: 0 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.allow_data_in_errors: 0 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.db_host_id: __hostname__ 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_background_jobs: 2 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_background_compactions: -1 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_subcompactions: 1 2024-05-12T10:59:29.276 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_total_wal_size: 0 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_open_files: -1 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bytes_per_sync: 0 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-12T10:59:29.277 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_readahead_size: 0 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_background_flushes: -1 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Compression algorithms supported: 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: kZSTD supported: 0 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: kXpressCompression supported: 0 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: kLZ4HCCompression supported: 1 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: kZlibCompression supported: 1 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: kSnappyCompression supported: 1 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: kLZ4Compression supported: 1 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: kBZip2Compression supported: 0 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-12T10:59:29.278 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.merge_operator: 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_filter: None 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_filter_factory: None 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.sst_partitioner_factory: None 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5611d8b91f60) 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout: cache_index_and_filter_blocks: 1 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-12T10:59:29.279 INFO:journalctl@ceph.mon.c.smithi176.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: pin_top_level_index_and_filter: 1 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: index_type: 0 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: data_block_index_type: 0 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: index_shortening: 1 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: checksum: 4 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: no_block_cache: 0 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: block_cache: 0x5611d8b951f0 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: block_cache_name: BinnedLRUCache 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: block_cache_options: 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: capacity : 536870912 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: num_shard_bits : 4 2024-05-12T10:59:29.280 INFO:journalctl@ceph.mon.c.smithi176.stdout: strict_capacity_limit : 0 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: high_pri_pool_ratio: 0.000 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: block_cache_compressed: (nil) 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: persistent_cache: (nil) 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: block_size: 4096 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: block_size_deviation: 10 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: block_restart_interval: 16 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: index_block_restart_interval: 1 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: metadata_block_size: 4096 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: partition_filters: 0 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: use_delta_encoding: 1 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: filter_policy: bloomfilter 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: whole_key_filtering: 1 2024-05-12T10:59:29.281 INFO:journalctl@ceph.mon.c.smithi176.stdout: verify_compression: 0 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout: read_amp_bytes_per_bit: 0 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout: format_version: 5 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout: enable_index_compression: 1 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout: block_align: 0 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout: max_auto_readahead_size: 262144 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout: prepopulate_block_cache: 0 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout: initial_auto_readahead_size: 8192 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout: num_file_reads_for_auto_readahead: 2 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.write_buffer_size: 33554432 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_write_buffer_number: 2 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression: NoCompression 2024-05-12T10:59:29.282 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression: Disabled 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.prefix_extractor: nullptr 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.num_levels: 7 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-12T10:59:29.283 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.level: 32767 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.strategy: 0 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.enabled: false 2024-05-12T10:59:29.284 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.target_file_size_base: 67108864 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-12T10:59:29.285 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.arena_block_size: 1048576 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.disable_auto_compactions: 0 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-12T10:59:29.286 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-12T10:59:29.287 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-12T10:59:29.287 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-12T10:59:29.287 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-12T10:59:29.287 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-12T10:59:29.287 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.inplace_update_support: 0 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.bloom_locality: 0 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.max_successive_merges: 0 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.paranoid_file_checks: 0 2024-05-12T10:59:29.288 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.force_consistency_checks: 1 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.report_bg_io_stats: 0 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.ttl: 2592000 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.enable_blob_files: false 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.min_blob_size: 0 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.blob_file_size: 268435456 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-12T10:59:29.289 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.blob_file_starting_level: 0 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4d73bfce-80a7-4734-9739-78313fc5d467 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715511569048311, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715511569048916, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715511569, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4d73bfce-80a7-4734-9739-78313fc5d467", "db_session_id": "URBGSCGSNFE6DZZPW99W", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715511569049020, "job": 1, "event": "recovery_finished"} 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-12T10:59:29.290 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5611d8cb2000 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: DB pointer 0x5611d8c9e000 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: ** DB Stats ** 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-12T10:59:29.291 INFO:journalctl@ceph.mon.c.smithi176.stdout: 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: ** Compaction Stats [default] ** 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: ** Compaction Stats [default] ** 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-12T10:59:29.292 INFO:journalctl@ceph.mon.c.smithi176.stdout: 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: Cumulative compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: Interval compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: Block cache BinnedLRUCache@0x5611d8b951f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-12T10:59:29.293 INFO:journalctl@ceph.mon.c.smithi176.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout: 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: using public_addr v2:172.21.15.176:0/0 -> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: starting mon.c rank -1 at public addrs [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] at bind addrs [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(???) e0 preinit fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).mds e1 new map 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout: e1 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-12T10:59:29.294 INFO:journalctl@ceph.mon.c.smithi176.stdout: legacy client fscid: -1 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout: 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout: No filesystems configured 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:59:29.295 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi176", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:29.296 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Deploying cephadm binary to smithi176 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Added host smithi176 2024-05-12T10:59:29.297 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2905390523' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.298 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi176", "name": "osd_memory_target"}]: dispatch 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2905390523' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.299 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Saving service mon spec with placement smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c;count:3 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: Deploying daemon mon.c on smithi176 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.300 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:29.301 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/3261473687' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:29.301 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 ceph-mon[34357]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-12T10:59:29.301 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 bash[34338]: f56d1b53be8d5ec8de4e2f38175721da9a6bb339ca3e588f8712cdcf55252e55 2024-05-12T10:59:29.301 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:29 smithi176 systemd[1]: Started Ceph mon.c for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T10:59:29.680 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-12T10:59:29.681 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-12T10:59:29.915 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T10:59:34.200 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.206+0000 7f67c92f3700 1 -- 172.21.15.176:0/3484308262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67b00035c0 msgr2=0x7f67b0005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:34.200 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.206+0000 7f67c92f3700 1 --2- 172.21.15.176:0/3484308262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67b00035c0 0x7f67b0005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f67c4101dc0 tx=0x7f67ac00feb0 comp rx=0 tx=0).stop 2024-05-12T10:59:34.201 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.206+0000 7f67c92f3700 1 -- 172.21.15.176:0/3484308262 shutdown_connections 2024-05-12T10:59:34.201 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.206+0000 7f67c92f3700 1 --2- 172.21.15.176:0/3484308262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67b00035c0 0x7f67b0005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:34.201 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.206+0000 7f67c92f3700 1 -- 172.21.15.176:0/3484308262 >> 172.21.15.176:0/3484308262 conn(0x7f67c40fd980 msgr2=0x7f67c40ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:34.201 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.206+0000 7f67c92f3700 1 -- 172.21.15.176:0/3484308262 shutdown_connections 2024-05-12T10:59:34.201 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.206+0000 7f67c92f3700 1 -- 172.21.15.176:0/3484308262 wait complete. 2024-05-12T10:59:34.201 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.207+0000 7f67c92f3700 1 Processor -- start 2024-05-12T10:59:34.203 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c92f3700 1 -- start start 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c92f3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 0x7f67c4199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c92f3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67c4199dc0 0x7f67c419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c92f3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4109de0 con 0x7f67c4199dc0 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c92f3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4109c60 con 0x7f67b00035c0 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c2ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 0x7f67c4199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c2ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 0x7f67c4199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:60680/0 (socket says 172.21.15.176:60680) 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c2ffd700 1 -- 172.21.15.176:0/1291166847 learned_addr learned my addr 172.21.15.176:0/1291166847 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c2ffd700 1 -- 172.21.15.176:0/1291166847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 msgr2=0x7f67c4199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c2ffd700 1 -- 172.21.15.176:0/1291166847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 msgr2=0x7f67c4199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c2ffd700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 0x7f67c4199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c2ffd700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 0x7f67c4199880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.208+0000 7f67c27fc700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67c4199dc0 0x7f67c419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:34.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67c27fc700 1 -- 172.21.15.176:0/1291166847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 msgr2=0x7f67c4199880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67c27fc700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 0x7f67c4199880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67c27fc700 1 -- 172.21.15.176:0/1291166847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c41a28f0 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67c27fc700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67c4199dc0 0x7f67c419a240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b4d0 tx=0x7f67b400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67bbfff700 1 -- 172.21.15.176:0/1291166847 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f67b4011630 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67bbfff700 1 -- 172.21.15.176:0/1291166847 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67b4011c80 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c41a2b20 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67bbfff700 1 -- 172.21.15.176:0/1291166847 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f67b4010da0 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.209+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c41a3060 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.210+0000 7f67bbfff700 1 -- 172.21.15.176:0/1291166847 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f67b4018020 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.210+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c41035d0 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.211+0000 7f67bbfff700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f67a403e300 0x7f67a40407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.211+0000 7f67bbfff700 1 -- 172.21.15.176:0/1291166847 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f67b40520c0 con 0x7f67c4199dc0 2024-05-12T10:59:34.205 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.211+0000 7f67c2ffd700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f67a403e300 0x7f67a40407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:34.206 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.211+0000 7f67c2ffd700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f67a403e300 0x7f67a40407c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00fa60 tx=0x7f67ac005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:34.209 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.216+0000 7f67bbfff700 1 -- 172.21.15.176:0/1291166847 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f67b401f020 con 0x7f67c4199dc0 2024-05-12T10:59:34.384 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:59:34.384 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: mon.a calling monitor election 2024-05-12T10:59:34.384 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.384 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:34.384 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.384 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: mon.c calling monitor election 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: monmap epoch 2 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: last_changed 2024-05-12T10:59:29.076332+0000 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: created 2024-05-12T10:57:46.072176+0000 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: min_mon_release 19 (squid) 2024-05-12T10:59:34.385 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: election_strategy: 1 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: 0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: fsmap 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: mgrmap e13: x(active, since 50s) 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: overall HEALTH_OK 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:34.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:34.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.508+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f67c41a33e0 con 0x7f67c4199dc0 2024-05-12T10:59:34.502 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:59:34.502 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: mon.a calling monitor election 2024-05-12T10:59:34.502 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.502 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:34.502 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.502 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: mon.c calling monitor election 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: monmap epoch 2 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: last_changed 2024-05-12T10:59:29.076332+0000 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: created 2024-05-12T10:57:46.072176+0000 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: min_mon_release 19 (squid) 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: election_strategy: 1 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: 0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-05-12T10:59:34.503 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: fsmap 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: mgrmap e13: x(active, since 50s) 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: overall HEALTH_OK 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:34.504 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:34.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.509+0000 7f67bbfff700 1 -- 172.21.15.176:0/1291166847 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f67b40187b0 con 0x7f67c4199dc0 2024-05-12T10:59:34.505 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:59:34.505 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":2,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","modified":"2024-05-12T10:59:29.076332Z","created":"2024-05-12T10:57:46.072176Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3300","nonce":0},{"type":"v1","addr":"172.21.15.176:6789","nonce":0}]},"addr":"172.21.15.176:6789/0","public_addr":"172.21.15.176:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-12T10:59:34.505 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f67a403e300 msgr2=0x7f67a40407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f67a403e300 0x7f67a40407c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00fa60 tx=0x7f67ac005a90 comp rx=0 tx=0).stop 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67c4199dc0 msgr2=0x7f67c419a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67c4199dc0 0x7f67c419a240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b4d0 tx=0x7f67b400b890 comp rx=0 tx=0).stop 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 shutdown_connections 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f67a403e300 0x7f67a40407c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b00035c0 0x7f67c4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 --2- 172.21.15.176:0/1291166847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67c4199dc0 0x7f67c419a240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 >> 172.21.15.176:0/1291166847 conn(0x7f67c40fd980 msgr2=0x7f67c40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 shutdown_connections 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:34.511+0000 7f67c92f3700 1 -- 172.21.15.176:0/1291166847 wait complete. 2024-05-12T10:59:34.506 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 2 2024-05-12T10:59:35.401 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:35 smithi176 ceph-mon[34357]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:35.401 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:35 smithi176 ceph-mon[34357]: Deploying daemon mon.b on smithi172 2024-05-12T10:59:35.401 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:35 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/1291166847' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:35.401 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:35 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:35.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:35 smithi086 ceph-mon[30110]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:35.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:35 smithi086 ceph-mon[30110]: Deploying daemon mon.b on smithi172 2024-05-12T10:59:35.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:35 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/1291166847' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:35.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:35 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:36.062 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-12T10:59:36.062 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-12T10:59:36.301 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T10:59:37.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:37 smithi086 ceph-mon[30110]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:37.499 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:37 smithi176 ceph-mon[34357]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:37.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.809+0000 7f09049b3700 1 -- 172.21.15.176:0/56633909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0900103220 msgr2=0x7f0900103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:37.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.809+0000 7f09049b3700 1 --2- 172.21.15.176:0/56633909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0900103220 0x7f0900103600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009910 tx=0x7f08f0009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:37.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.809+0000 7f09049b3700 1 -- 172.21.15.176:0/56633909 shutdown_connections 2024-05-12T10:59:37.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.809+0000 7f09049b3700 1 --2- 172.21.15.176:0/56633909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0900103220 0x7f0900103600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:37.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.809+0000 7f09049b3700 1 -- 172.21.15.176:0/56633909 >> 172.21.15.176:0/56633909 conn(0x7f09000feab0 msgr2=0x7f0900100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:37.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.809+0000 7f09049b3700 1 -- 172.21.15.176:0/56633909 shutdown_connections 2024-05-12T10:59:37.803 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.809+0000 7f09049b3700 1 -- 172.21.15.176:0/56633909 wait complete. 2024-05-12T10:59:37.804 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f09049b3700 1 Processor -- start 2024-05-12T10:59:37.804 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f09049b3700 1 -- start start 2024-05-12T10:59:37.804 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f09049b3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 0x7f090019e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:37.804 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f09049b3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f090019ed20 0x7f09001989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f09049b3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f090010d4a0 con 0x7f090019ed20 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f09049b3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f090010d320 con 0x7f0900103220 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f08fe59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 0x7f090019e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f08fe59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 0x7f090019e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:44650/0 (socket says 172.21.15.176:44650) 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f08fe59c700 1 -- 172.21.15.176:0/3271642503 learned_addr learned my addr 172.21.15.176:0/3271642503 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f08fdd9b700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f090019ed20 0x7f09001989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f08fe59c700 1 -- 172.21.15.176:0/3271642503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 msgr2=0x7f090019e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f08fe59c700 1 -- 172.21.15.176:0/3271642503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 msgr2=0x7f090019e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f08fe59c700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 0x7f090019e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.810+0000 7f08fe59c700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 0x7f090019e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T10:59:37.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f08fdd9b700 1 -- 172.21.15.176:0/3271642503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 msgr2=0x7f090019e7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T10:59:37.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f08fdd9b700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 0x7f090019e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:37.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f08fdd9b700 1 -- 172.21.15.176:0/3271642503 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090019f360 con 0x7f090019ed20 2024-05-12T10:59:37.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f08fdd9b700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f090019ed20 0x7f09001989a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08f400b4d0 tx=0x7f08f400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:37.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f08ef7fe700 1 -- 172.21.15.176:0/3271642503 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f08f4011630 con 0x7f090019ed20 2024-05-12T10:59:37.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0900198ee0 con 0x7f090019ed20 2024-05-12T10:59:37.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f08ef7fe700 1 -- 172.21.15.176:0/3271642503 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08f4011c80 con 0x7f090019ed20 2024-05-12T10:59:37.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f08ef7fe700 1 -- 172.21.15.176:0/3271642503 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f08f4010da0 con 0x7f090019ed20 2024-05-12T10:59:37.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.811+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0900199470 con 0x7f090019ed20 2024-05-12T10:59:37.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.812+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0900104700 con 0x7f090019ed20 2024-05-12T10:59:37.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.812+0000 7f08ef7fe700 1 -- 172.21.15.176:0/3271642503 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f08f4018020 con 0x7f090019ed20 2024-05-12T10:59:37.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.812+0000 7f08ef7fe700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f08e803e2b0 0x7f08e8040770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:37.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.812+0000 7f08ef7fe700 1 -- 172.21.15.176:0/3271642503 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f08f40521a0 con 0x7f090019ed20 2024-05-12T10:59:37.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.813+0000 7f08fe59c700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f08e803e2b0 0x7f08e8040770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:37.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.813+0000 7f08fe59c700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f08e803e2b0 0x7f08e8040770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009750 tx=0x7f08f001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:37.811 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:37.818+0000 7f08ef7fe700 1 -- 172.21.15.176:0/3271642503 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f08f401f020 con 0x7f090019ed20 2024-05-12T10:59:38.097 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.104+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0900199f70 con 0x7f090019ed20 2024-05-12T10:59:38.097 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.104+0000 7f08ef7fe700 1 -- 172.21.15.176:0/3271642503 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f08f4019e00 con 0x7f090019ed20 2024-05-12T10:59:38.098 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:59:38.098 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":2,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","modified":"2024-05-12T10:59:29.076332Z","created":"2024-05-12T10:57:46.072176Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3300","nonce":0},{"type":"v1","addr":"172.21.15.176:6789","nonce":0}]},"addr":"172.21.15.176:6789/0","public_addr":"172.21.15.176:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-12T10:59:38.100 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.106+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f08e803e2b0 msgr2=0x7f08e8040770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:38.100 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.106+0000 7f09049b3700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f08e803e2b0 0x7f08e8040770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009750 tx=0x7f08f001a040 comp rx=0 tx=0).stop 2024-05-12T10:59:38.100 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.106+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f090019ed20 msgr2=0x7f09001989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:38.100 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.106+0000 7f09049b3700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f090019ed20 0x7f09001989a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08f400b4d0 tx=0x7f08f400b890 comp rx=0 tx=0).stop 2024-05-12T10:59:38.100 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.106+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 shutdown_connections 2024-05-12T10:59:38.100 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.106+0000 7f09049b3700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f08e803e2b0 0x7f08e8040770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:38.101 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.106+0000 7f09049b3700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0900103220 0x7f090019e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:38.101 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.106+0000 7f09049b3700 1 --2- 172.21.15.176:0/3271642503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f090019ed20 0x7f09001989a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:38.101 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.107+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 >> 172.21.15.176:0/3271642503 conn(0x7f09000feab0 msgr2=0x7f0900104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:38.101 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.107+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 shutdown_connections 2024-05-12T10:59:38.101 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:38.107+0000 7f09049b3700 1 -- 172.21.15.176:0/3271642503 wait complete. 2024-05-12T10:59:38.101 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 2 2024-05-12T10:59:38.203 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-12T10:59:38.203 INFO:journalctl@ceph.mon.b.smithi172.stdout: e1 2024-05-12T10:59:38.203 INFO:journalctl@ceph.mon.b.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-12T10:59:38.203 INFO:journalctl@ceph.mon.b.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-12T10:59:38.203 INFO:journalctl@ceph.mon.b.smithi172.stdout: legacy client fscid: -1 2024-05-12T10:59:38.204 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-05-12T10:59:38.204 INFO:journalctl@ceph.mon.b.smithi172.stdout: No filesystems configured 2024-05-12T10:59:38.204 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-12T10:59:38.204 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-12T10:59:38.204 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-12T10:59:38.204 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-12T10:59:38.204 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-12T10:59:38.204 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-12T10:59:38.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:38 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/3271642503' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:38.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-12T10:59:38.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:59:38.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:59:38.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi176", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T10:59:38.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Deploying cephadm binary to smithi176 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Added host smithi176 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2905390523' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi176", "name": "osd_memory_target"}]: dispatch 2024-05-12T10:59:38.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2905390523' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:38.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Saving service mon spec with placement smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c;count:3 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Deploying daemon mon.c on smithi176 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/3261473687' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.a calling monitor election 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:38.479 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.c calling monitor election 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: monmap epoch 2 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: last_changed 2024-05-12T10:59:29.076332+0000 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: created 2024-05-12T10:57:46.072176+0000 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: min_mon_release 19 (squid) 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: election_strategy: 1 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: 0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-05-12T10:59:38.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: fsmap 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mgrmap e13: x(active, since 50s) 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: overall HEALTH_OK 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: Deploying daemon mon.b on smithi172 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/1291166847' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/3271642503' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 ceph-mon[34517]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-12T10:59:38.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 bash[34497]: caaa4d03105831dd02daf4f02546996d36e817f22f87bcdb00b53bdc53f141be 2024-05-12T10:59:38.482 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:38 smithi172 systemd[1]: Started Ceph mon.b for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T10:59:38.501 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:38 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/3271642503' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:39.664 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-12T10:59:39.664 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-12T10:59:39.907 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T10:59:43.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:59:43.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: mon.a calling monitor election 2024-05-12T10:59:43.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:43.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: mon.c calling monitor election 2024-05-12T10:59:43.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: mon.b calling monitor election 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: monmap epoch 3 2024-05-12T10:59:43.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: last_changed 2024-05-12T10:59:38.217369+0000 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: created 2024-05-12T10:57:46.072176+0000 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: min_mon_release 19 (squid) 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: election_strategy: 1 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: 0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: fsmap 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:43.716 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: mgrmap e13: x(active, since 59s) 2024-05-12T10:59:43.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: overall HEALTH_OK 2024-05-12T10:59:43.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:43.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: mon.a calling monitor election 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: mon.c calling monitor election 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: mon.b calling monitor election 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: monmap epoch 3 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: last_changed 2024-05-12T10:59:38.217369+0000 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: created 2024-05-12T10:57:46.072176+0000 2024-05-12T10:59:43.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: min_mon_release 19 (squid) 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: election_strategy: 1 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: 0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: fsmap 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: mgrmap e13: x(active, since 59s) 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: overall HEALTH_OK 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:43.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T10:59:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: mon.a calling monitor election 2024-05-12T10:59:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T10:59:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: mon.c calling monitor election 2024-05-12T10:59:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: mon.b calling monitor election 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: monmap epoch 3 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: last_changed 2024-05-12T10:59:38.217369+0000 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: created 2024-05-12T10:57:46.072176+0000 2024-05-12T10:59:43.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: min_mon_release 19 (squid) 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: election_strategy: 1 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: 0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: fsmap 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: osdmap e4: 0 total, 0 up, 0 in 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: mgrmap e13: x(active, since 59s) 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: overall HEALTH_OK 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:43.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.271 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.277+0000 7f0277d84700 1 -- 172.21.15.176:0/1701370587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701020f0 msgr2=0x7f025c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:44.271 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.278+0000 7f0277d84700 1 --2- 172.21.15.176:0/1701370587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701020f0 0x7f025c005610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0268009bf0 tx=0x7f0268009f00 comp rx=0 tx=0).stop 2024-05-12T10:59:44.271 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.278+0000 7f0277d84700 1 -- 172.21.15.176:0/1701370587 shutdown_connections 2024-05-12T10:59:44.271 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.278+0000 7f0277d84700 1 --2- 172.21.15.176:0/1701370587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701020f0 0x7f025c005610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:44.271 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.278+0000 7f0277d84700 1 -- 172.21.15.176:0/1701370587 >> 172.21.15.176:0/1701370587 conn(0x7f02700fd980 msgr2=0x7f02700ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:44.271 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.278+0000 7f0277d84700 1 -- 172.21.15.176:0/1701370587 shutdown_connections 2024-05-12T10:59:44.271 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.278+0000 7f0277d84700 1 -- 172.21.15.176:0/1701370587 wait complete. 2024-05-12T10:59:44.273 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0277d84700 1 Processor -- start 2024-05-12T10:59:44.273 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0277d84700 1 -- start start 2024-05-12T10:59:44.273 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0277d84700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701020f0 0x7f027018f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:44.273 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0277d84700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f027018fa90 0x7f027018ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0277d84700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02701a4cc0 0x7f02701a70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0277d84700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0270109de0 con 0x7f02701020f0 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0277d84700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0270109c60 con 0x7f02701a4cc0 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0277d84700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0270109f60 con 0x7f027018fa90 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f027531f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f027018fa90 0x7f027018ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f027531f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f027018fa90 0x7f027018ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:44664/0 (socket says 172.21.15.176:44664) 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f027531f700 1 -- 172.21.15.176:0/540369740 learned_addr learned my addr 172.21.15.176:0/540369740 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0275b20700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701020f0 0x7f027018f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f0276321700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02701a4cc0 0x7f02701a70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f027531f700 1 -- 172.21.15.176:0/540369740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02701a4cc0 msgr2=0x7f02701a70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f027531f700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02701a4cc0 0x7f02701a70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f027531f700 1 -- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701020f0 msgr2=0x7f027018f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:44.274 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f027531f700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701020f0 0x7f027018f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:44.275 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.279+0000 7f027531f700 1 -- 172.21.15.176:0/540369740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02701a77e0 con 0x7f027018fa90 2024-05-12T10:59:44.275 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.280+0000 7f027531f700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f027018fa90 0x7f027018ff10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f026000b780 tx=0x7f026000ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:44.275 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.280+0000 7f0266ffd700 1 -- 172.21.15.176:0/540369740 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260004230 con 0x7f027018fa90 2024-05-12T10:59:44.275 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.280+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02701a7ad0 con 0x7f027018fa90 2024-05-12T10:59:44.275 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.280+0000 7f0266ffd700 1 -- 172.21.15.176:0/540369740 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02600043d0 con 0x7f027018fa90 2024-05-12T10:59:44.275 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.280+0000 7f0266ffd700 1 -- 172.21.15.176:0/540369740 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260011ad0 con 0x7f027018fa90 2024-05-12T10:59:44.275 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.280+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02701a8060 con 0x7f027018fa90 2024-05-12T10:59:44.276 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.281+0000 7f0266ffd700 1 -- 172.21.15.176:0/540369740 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f0260011c70 con 0x7f027018fa90 2024-05-12T10:59:44.276 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.281+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0270064b00 con 0x7f027018fa90 2024-05-12T10:59:44.276 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.281+0000 7f0266ffd700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f025403e9a0 0x7f0254040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:44.276 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.281+0000 7f0266ffd700 1 -- 172.21.15.176:0/540369740 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f02600522b0 con 0x7f027018fa90 2024-05-12T10:59:44.276 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.281+0000 7f0275b20700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f025403e9a0 0x7f0254040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:44.276 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.282+0000 7f0275b20700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f025403e9a0 0x7f0254040e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0268009720 tx=0x7f0268009990 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:44.279 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.286+0000 7f0266ffd700 1 -- 172.21.15.176:0/540369740 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0260017d70 con 0x7f027018fa90 2024-05-12T10:59:44.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:44.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:44.606 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.612+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f02701a8390 con 0x7f027018fa90 2024-05-12T10:59:44.606 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.613+0000 7f0266ffd700 1 -- 172.21.15.176:0/540369740 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f02600212f0 con 0x7f027018fa90 2024-05-12T10:59:44.606 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-12T10:59:44.606 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":3,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","modified":"2024-05-12T10:59:38.217369Z","created":"2024-05-12T10:57:46.072176Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3300","nonce":0},{"type":"v1","addr":"172.21.15.176:6789","nonce":0}]},"addr":"172.21.15.176:6789/0","public_addr":"172.21.15.176:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-12T10:59:44.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f025403e9a0 msgr2=0x7f0254040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:44.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f025403e9a0 0x7f0254040e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0268009720 tx=0x7f0268009990 comp rx=0 tx=0).stop 2024-05-12T10:59:44.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f027018fa90 msgr2=0x7f027018ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f027018fa90 0x7f027018ff10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f026000b780 tx=0x7f026000ba90 comp rx=0 tx=0).stop 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 shutdown_connections 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f025403e9a0 0x7f0254040e60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02701a4cc0 0x7f02701a70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701020f0 0x7f027018f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 --2- 172.21.15.176:0/540369740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f027018fa90 0x7f027018ff10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 >> 172.21.15.176:0/540369740 conn(0x7f02700fd980 msgr2=0x7f02700fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 shutdown_connections 2024-05-12T10:59:44.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:44.615+0000 7f0277d84700 1 -- 172.21.15.176:0/540369740 wait complete. 2024-05-12T10:59:44.610 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 3 2024-05-12T10:59:44.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:44.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T10:59:45.315 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-12T10:59:45.315 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph config generate-minimal-conf 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/540369740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: Updating smithi086:/etc/ceph/ceph.conf 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T10:59:45.338 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.339 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.339 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.339 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.339 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.339 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.339 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.560 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:59:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/540369740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: Updating smithi086:/etc/ceph/ceph.conf 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/540369740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: Updating smithi086:/etc/ceph/ceph.conf 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:45.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.669 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.669 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.669 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.669 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.670 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.670 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.670 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.670 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: Reconfiguring mon.a (unknown last config time)... 2024-05-12T10:59:46.670 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:46.670 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:46.670 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:46.670 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:46 smithi086 ceph-mon[30110]: Reconfiguring daemon mon.a on smithi086 2024-05-12T10:59:46.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: Reconfiguring mon.a (unknown last config time)... 2024-05-12T10:59:46.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:46.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:46.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:46.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:46 smithi172 ceph-mon[34517]: Reconfiguring daemon mon.a on smithi086 2024-05-12T10:59:46.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T10:59:46.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:46.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: Reconfiguring mon.a (unknown last config time)... 2024-05-12T10:59:46.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:46.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:46.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:46.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:46 smithi176 ceph-mon[34357]: Reconfiguring daemon mon.a on smithi086 2024-05-12T10:59:47.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:47 smithi086 ceph-mon[30110]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:47.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.646+0000 7f10746b6700 1 -- 172.21.15.86:0/3364661460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c102050 msgr2=0x7f106c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:47.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.646+0000 7f10746b6700 1 --2- 172.21.15.86:0/3364661460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c102050 0x7f106c102430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f105c009910 tx=0x7f105c009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:47.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.646+0000 7f10746b6700 1 -- 172.21.15.86:0/3364661460 shutdown_connections 2024-05-12T10:59:47.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.646+0000 7f10746b6700 1 --2- 172.21.15.86:0/3364661460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c102050 0x7f106c102430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:47.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.646+0000 7f10746b6700 1 -- 172.21.15.86:0/3364661460 >> 172.21.15.86:0/3364661460 conn(0x7f106c077900 msgr2=0x7f106c077d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:47.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.646+0000 7f10746b6700 1 -- 172.21.15.86:0/3364661460 shutdown_connections 2024-05-12T10:59:47.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.646+0000 7f10746b6700 1 -- 172.21.15.86:0/3364661460 wait complete. 2024-05-12T10:59:47.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f10746b6700 1 Processor -- start 2024-05-12T10:59:47.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f10746b6700 1 -- start start 2024-05-12T10:59:47.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f10746b6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106c102050 0x7f106c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:47.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f10746b6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f106c19a030 0x7f106c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:47.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f10746b6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c1a2b60 0x7f106c1a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:47.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f10746b6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f106c10c280 con 0x7f106c1a2b60 2024-05-12T10:59:47.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f10746b6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f106c10c100 con 0x7f106c19a030 2024-05-12T10:59:47.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f10746b6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f106c10c400 con 0x7f106c102050 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f1072c53700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c1a2b60 0x7f106c1a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f1072c53700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c1a2b60 0x7f106c1a4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41488/0 (socket says 172.21.15.86:41488) 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.647+0000 7f1072c53700 1 -- 172.21.15.86:0/2778188731 learned_addr learned my addr 172.21.15.86:0/2778188731 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1072452700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106c102050 0x7f106c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1071c51700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f106c19a030 0x7f106c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1072c53700 1 -- 172.21.15.86:0/2778188731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106c102050 msgr2=0x7f106c199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1072c53700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106c102050 0x7f106c199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1072c53700 1 -- 172.21.15.86:0/2778188731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f106c19a030 msgr2=0x7f106c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1072c53700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f106c19a030 0x7f106c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1072c53700 1 -- 172.21.15.86:0/2778188731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106c1a5680 con 0x7f106c1a2b60 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1072452700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106c102050 0x7f106c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T10:59:47.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f1072c53700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c1a2b60 0x7f106c1a4f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f106400ba50 tx=0x7f106400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f10637fe700 1 -- 172.21.15.86:0/2778188731 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1064019070 con 0x7f106c1a2b60 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f10637fe700 1 -- 172.21.15.86:0/2778188731 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1064014440 con 0x7f106c1a2b60 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f106c1a5910 con 0x7f106c1a2b60 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f10637fe700 1 -- 172.21.15.86:0/2778188731 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1064007590 con 0x7f106c1a2b60 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.648+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f106c1a5ea0 con 0x7f106c1a2b60 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.649+0000 7f10637fe700 1 -- 172.21.15.86:0/2778188731 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f106401c070 con 0x7f106c1a2b60 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.649+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f106c064b00 con 0x7f106c1a2b60 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.649+0000 7f10637fe700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f105803e9a0 0x7f1058040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.649+0000 7f10637fe700 1 -- 172.21.15.86:0/2778188731 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1064051e20 con 0x7f106c1a2b60 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.649+0000 7f1072452700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f105803e9a0 0x7f1058040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.650+0000 7f1072452700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f105803e9a0 0x7f1058040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f105c006010 tx=0x7f105c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:47.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.655+0000 7f10637fe700 1 -- 172.21.15.86:0/2778188731 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f106401c360 con 0x7f106c1a2b60 2024-05-12T10:59:47.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:47 smithi172 ceph-mon[34517]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:47.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:47 smithi176 ceph-mon[34357]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:47.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.859+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f106c1a6130 con 0x7f106c1a2b60 2024-05-12T10:59:47.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.860+0000 7f10637fe700 1 -- 172.21.15.86:0/2778188731 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f1064014910 con 0x7f106c1a2b60 2024-05-12T10:59:47.852 INFO:teuthology.orchestra.run.smithi086.stdout:# minimal ceph.conf for 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:47.852 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-05-12T10:59:47.852 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T10:59:47.852 INFO:teuthology.orchestra.run.smithi086.stdout: mon_host = [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f105803e9a0 msgr2=0x7f1058040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f105803e9a0 0x7f1058040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f105c006010 tx=0x7f105c01a040 comp rx=0 tx=0).stop 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c1a2b60 msgr2=0x7f106c1a4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c1a2b60 0x7f106c1a4f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f106400ba50 tx=0x7f106400be10 comp rx=0 tx=0).stop 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 shutdown_connections 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f105803e9a0 0x7f1058040e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f106c1a2b60 0x7f106c1a4f50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106c102050 0x7f106c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 --2- 172.21.15.86:0/2778188731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f106c19a030 0x7f106c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 >> 172.21.15.86:0/2778188731 conn(0x7f106c077900 msgr2=0x7f106c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 shutdown_connections 2024-05-12T10:59:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:47.862+0000 7f10746b6700 1 -- 172.21.15.86:0/2778188731 wait complete. 2024-05-12T10:59:48.572 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:48 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2778188731' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:48.572 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:48.572 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:48.573 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:48.573 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:48.573 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:48.599 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-12T10:59:48.599 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:59:48.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.conf 2024-05-12T10:59:48.668 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:59:48.668 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:48.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:48 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2778188731' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:48.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:48.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:48.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:48.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:48.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:48.733 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:59:48.733 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-05-12T10:59:48.760 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:59:48.760 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:48 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2778188731' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:48.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:48.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:48.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:48.824 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:59:48.824 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.conf 2024-05-12T10:59:48.856 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:59:48.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-12T10:59:48.923 INFO:tasks.cephadm:Adding mgr.x on smithi086 2024-05-12T10:59:48.923 INFO:tasks.cephadm:Adding mgr.y on smithi172 2024-05-12T10:59:48.923 INFO:tasks.cephadm:Adding mgr.z on smithi176 2024-05-12T10:59:48.924 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch apply mgr '3;smithi086=x;smithi172=y;smithi176=z' 2024-05-12T10:59:49.198 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T10:59:49.598 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:49 smithi176 ceph-mon[34357]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:49.599 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:49 smithi176 ceph-mon[34357]: Reconfiguring mon.b (monmap changed)... 2024-05-12T10:59:49.599 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:49 smithi176 ceph-mon[34357]: Reconfiguring daemon mon.b on smithi172 2024-05-12T10:59:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:49 smithi086 ceph-mon[30110]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:49 smithi086 ceph-mon[30110]: Reconfiguring mon.b (monmap changed)... 2024-05-12T10:59:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:49 smithi086 ceph-mon[30110]: Reconfiguring daemon mon.b on smithi172 2024-05-12T10:59:49.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:49 smithi172 ceph-mon[34517]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:49.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:49 smithi172 ceph-mon[34517]: Reconfiguring mon.b (monmap changed)... 2024-05-12T10:59:49.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:49 smithi172 ceph-mon[34517]: Reconfiguring daemon mon.b on smithi172 2024-05-12T10:59:50.682 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:50.682 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:50.682 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:50 smithi176 ceph-mon[34357]: Reconfiguring mon.c (monmap changed)... 2024-05-12T10:59:50.682 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:50.682 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:50.682 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:50.682 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:50 smithi176 ceph-mon[34357]: Reconfiguring daemon mon.c on smithi176 2024-05-12T10:59:50.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:50.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:50.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:50 smithi172 ceph-mon[34517]: Reconfiguring mon.c (monmap changed)... 2024-05-12T10:59:50.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:50.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:50.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:50.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:50 smithi172 ceph-mon[34517]: Reconfiguring daemon mon.c on smithi176 2024-05-12T10:59:50.783 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.791+0000 7f6ff2756700 1 -- 172.21.15.176:0/3565736885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec101ef0 msgr2=0x7f6fec102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:50.783 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.791+0000 7f6ff2756700 1 --2- 172.21.15.176:0/3565736885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec101ef0 0x7f6fec102330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009910 tx=0x7f6fdc009c20 comp rx=0 tx=0).stop 2024-05-12T10:59:50.784 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.791+0000 7f6ff2756700 1 -- 172.21.15.176:0/3565736885 shutdown_connections 2024-05-12T10:59:50.784 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.791+0000 7f6ff2756700 1 --2- 172.21.15.176:0/3565736885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec101ef0 0x7f6fec102330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:50.784 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.791+0000 7f6ff2756700 1 -- 172.21.15.176:0/3565736885 >> 172.21.15.176:0/3565736885 conn(0x7f6fec0fd4e0 msgr2=0x7f6fec0ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:50.784 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.791+0000 7f6ff2756700 1 -- 172.21.15.176:0/3565736885 shutdown_connections 2024-05-12T10:59:50.784 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.791+0000 7f6ff2756700 1 -- 172.21.15.176:0/3565736885 wait complete. 2024-05-12T10:59:50.784 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.791+0000 7f6ff2756700 1 Processor -- start 2024-05-12T10:59:50.784 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff2756700 1 -- start start 2024-05-12T10:59:50.786 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff2756700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fec101ef0 0x7f6fec1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:50.786 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff2756700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec198d30 0x7f6fec19dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff2756700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec1991b0 0x7f6fec1a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff2756700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec107de0 con 0x7f6fec1991b0 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff2756700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec107c60 con 0x7f6fec198d30 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff2756700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec107f60 con 0x7f6fec101ef0 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fec101ef0 0x7f6fec1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fec101ef0 0x7f6fec1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:40458/0 (socket says 172.21.15.176:40458) 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 -- 172.21.15.176:0/3310304382 learned_addr learned my addr 172.21.15.176:0/3310304382 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff0cf3700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec1991b0 0x7f6fec1a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 -- 172.21.15.176:0/3310304382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec198d30 msgr2=0x7f6fec19dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6feb7fe700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec198d30 0x7f6fec19dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec198d30 0x7f6fec19dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 -- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec1991b0 msgr2=0x7f6fec1a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:50.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec1991b0 0x7f6fec1a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 -- 172.21.15.176:0/3310304382 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec1a0c00 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6ff0cf3700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec1991b0 0x7f6fec1a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.792+0000 7f6febfff700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fec101ef0 0x7f6fec1987f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0059d0 tx=0x7f6fdc0050d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.793+0000 7f6fe97fa700 1 -- 172.21.15.176:0/3310304382 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc027070 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.793+0000 7f6fe97fa700 1 -- 172.21.15.176:0/3310304382 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fdc00be10 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.793+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec1a0e90 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.793+0000 7f6fe97fa700 1 -- 172.21.15.176:0/3310304382 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc022e20 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.793+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec1a1360 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.794+0000 7f6fe97fa700 1 -- 172.21.15.176:0/3310304382 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f6fdc02a070 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.794+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fec02e510 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.794+0000 7f6fe97fa700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6fd403e9a0 0x7f6fd4040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.794+0000 7f6fe97fa700 1 -- 172.21.15.176:0/3310304382 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6fdc053ad0 con 0x7f6fec101ef0 2024-05-12T10:59:50.788 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.794+0000 7f6feb7fe700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6fd403e9a0 0x7f6fd4040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:50.789 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.795+0000 7f6feb7fe700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6fd403e9a0 0x7f6fd4040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00078e0 tx=0x7f6fe0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:50.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:50.799+0000 7f6fe97fa700 1 -- 172.21.15.176:0/3310304382 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6fdc013070 con 0x7f6fec101ef0 2024-05-12T10:59:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:50 smithi086 ceph-mon[30110]: Reconfiguring mon.c (monmap changed)... 2024-05-12T10:59:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-12T10:59:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-12T10:59:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:50 smithi086 ceph-mon[30110]: Reconfiguring daemon mon.c on smithi176 2024-05-12T10:59:51.012 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.020+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi086=x;smithi172=y;smithi176=z", "target": ["mon-mgr", ""]}) -- 0x7f6fec0638e0 con 0x7f6fd403e9a0 2024-05-12T10:59:51.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.027+0000 7f6fe97fa700 1 -- 172.21.15.176:0/3310304382 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6fec0638e0 con 0x7f6fd403e9a0 2024-05-12T10:59:51.019 INFO:teuthology.orchestra.run.smithi176.stdout:Scheduled mgr update... 2024-05-12T10:59:51.021 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6fd403e9a0 msgr2=0x7f6fd4040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:51.021 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6fd403e9a0 0x7f6fd4040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00078e0 tx=0x7f6fe0008040 comp rx=0 tx=0).stop 2024-05-12T10:59:51.021 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fec101ef0 msgr2=0x7f6fec1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fec101ef0 0x7f6fec1987f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0059d0 tx=0x7f6fdc0050d0 comp rx=0 tx=0).stop 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 shutdown_connections 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6fd403e9a0 0x7f6fd4040e60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fec1991b0 0x7f6fec1a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fec101ef0 0x7f6fec1987f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 --2- 172.21.15.176:0/3310304382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec198d30 0x7f6fec19dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 >> 172.21.15.176:0/3310304382 conn(0x7f6fec0fd4e0 msgr2=0x7f6fec18f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 shutdown_connections 2024-05-12T10:59:51.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T10:59:51.029+0000 7f6ff2756700 1 -- 172.21.15.176:0/3310304382 wait complete. 2024-05-12T10:59:51.712 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:51 smithi176 ceph-mon[34357]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:51.712 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:51 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:51.745 DEBUG:teuthology.orchestra.run.smithi172:mgr.y> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.y.service 2024-05-12T10:59:51.748 DEBUG:teuthology.orchestra.run.smithi176:mgr.z> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.z.service 2024-05-12T10:59:51.750 INFO:tasks.cephadm:Deploying OSDs... 2024-05-12T10:59:51.750 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T10:59:51.751 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-05-12T10:59:51.771 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-12T10:59:51.771 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-05-12T10:59:51.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:51 smithi172 ceph-mon[34517]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:51.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:51 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-12T10:59:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:51.830 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-12T10:59:51.830 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:51.830 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:51.830 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-05-12 10:58:54.577244556 +0000 2024-05-12T10:59:51.830 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-05-12 10:54:12.239106798 +0000 2024-05-12T10:59:51.830 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-05-12 10:54:12.239106798 +0000 2024-05-12T10:59:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-05-12 10:54:12.239106798 +0000 2024-05-12T10:59:51.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-12T10:59:51.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:51 smithi086 ceph-mon[30110]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:51.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:51 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:51.897 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-05-12T10:59:51.898 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-05-12T10:59:51.898 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000234503 s, 2.2 MB/s 2024-05-12T10:59:51.899 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-12T10:59:51.958 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-05-12T10:59:52.016 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-12T10:59:52.016 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:52.016 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-12T10:59:52.016 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:52.016 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:52.016 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-05-12 10:58:54.604243970 +0000 2024-05-12T10:59:52.016 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-05-12 10:54:12.591099250 +0000 2024-05-12T10:59:52.017 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-05-12 10:54:12.591099250 +0000 2024-05-12T10:59:52.017 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-05-12 10:54:12.591099250 +0000 2024-05-12T10:59:52.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-12T10:59:52.082 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-05-12T10:59:52.083 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-05-12T10:59:52.083 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000184761 s, 2.8 MB/s 2024-05-12T10:59:52.084 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-12T10:59:52.142 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-05-12T10:59:52.198 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-12T10:59:52.199 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:52.199 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-12T10:59:52.199 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:52.199 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:52.199 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-05-12 10:58:54.629243427 +0000 2024-05-12T10:59:52.199 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-05-12 10:54:12.952091509 +0000 2024-05-12T10:59:52.199 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-05-12 10:54:12.952091509 +0000 2024-05-12T10:59:52.199 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-05-12 10:54:12.952091509 +0000 2024-05-12T10:59:52.199 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-12T10:59:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-05-12T10:59:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-05-12T10:59:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000230466 s, 2.2 MB/s 2024-05-12T10:59:52.265 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-12T10:59:52.322 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-05-12T10:59:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-12T10:59:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:52.378 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-12T10:59:52.378 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:52.379 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:52.379 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-05-12 10:58:54.653242906 +0000 2024-05-12T10:59:52.379 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-05-12 10:54:13.300084046 +0000 2024-05-12T10:59:52.379 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-05-12 10:54:13.300084046 +0000 2024-05-12T10:59:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-05-12 10:54:13.300084046 +0000 2024-05-12T10:59:52.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-12T10:59:52.442 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-05-12T10:59:52.442 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-05-12T10:59:52.442 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000246704 s, 2.1 MB/s 2024-05-12T10:59:52.443 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-12T10:59:52.500 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-12T10:59:52.500 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-05-12T10:59:52.519 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-12T10:59:52.519 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-05-12T10:59:52.577 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-12T10:59:52.577 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:52.577 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-12T10:59:52.577 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:52.578 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:52.578 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-12 10:59:37.641026901 +0000 2024-05-12T10:59:52.578 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-12 10:54:25.383826924 +0000 2024-05-12T10:59:52.578 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-12 10:54:25.383826924 +0000 2024-05-12T10:59:52.578 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-12 10:54:25.383826924 +0000 2024-05-12T10:59:52.578 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-12T10:59:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-12T10:59:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-12T10:59:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000288552 s, 1.8 MB/s 2024-05-12T10:59:52.645 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-12T10:59:52.705 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-05-12T10:59:52.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:52 smithi086 ceph-mon[30110]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi086=x;smithi172=y;smithi176=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:52.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:52 smithi086 ceph-mon[30110]: Saving service mgr spec with placement smithi086=x;smithi172=y;smithi176=z;count:3 2024-05-12T10:59:52.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:52.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:52.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-12T10:59:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:52.761 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-12T10:59:52.761 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:52.761 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:52.761 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-12 10:59:37.642026876 +0000 2024-05-12T10:59:52.761 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-12 10:54:25.725818200 +0000 2024-05-12T10:59:52.761 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-12 10:54:25.725818200 +0000 2024-05-12T10:59:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-12 10:54:25.725818200 +0000 2024-05-12T10:59:52.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-12T10:59:52.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:52 smithi176 ceph-mon[34357]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi086=x;smithi172=y;smithi176=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:52.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:52 smithi176 ceph-mon[34357]: Saving service mgr spec with placement smithi086=x;smithi172=y;smithi176=z;count:3 2024-05-12T10:59:52.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:52.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:52.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:52.824 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:52 smithi172 ceph-mon[34517]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi086=x;smithi172=y;smithi176=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T10:59:52.824 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:52 smithi172 ceph-mon[34517]: Saving service mgr spec with placement smithi086=x;smithi172=y;smithi176=z;count:3 2024-05-12T10:59:52.824 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:52.824 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:52.824 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:52.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-12T10:59:52.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-12T10:59:52.827 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000206181 s, 2.5 MB/s 2024-05-12T10:59:52.828 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-12T10:59:52.885 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-12 10:59:37.642026876 +0000 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-12 10:54:26.060809654 +0000 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-12 10:54:26.060809654 +0000 2024-05-12T10:59:52.941 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-12 10:54:26.060809654 +0000 2024-05-12T10:59:52.942 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-12T10:59:53.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-12T10:59:53.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-12T10:59:53.004 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000195714 s, 2.6 MB/s 2024-05-12T10:59:53.005 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-12T10:59:53.062 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-05-12T10:59:53.118 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-12T10:59:53.118 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:53.118 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-12T10:59:53.118 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:53.118 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:53.118 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-12 10:59:37.642026876 +0000 2024-05-12T10:59:53.118 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-12 10:54:26.381801465 +0000 2024-05-12T10:59:53.119 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-12 10:54:26.381801465 +0000 2024-05-12T10:59:53.119 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-12 10:54:26.381801465 +0000 2024-05-12T10:59:53.119 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-12T10:59:53.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-12T10:59:53.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-12T10:59:53.180 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000235448 s, 2.2 MB/s 2024-05-12T10:59:53.181 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-12T10:59:53.238 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-12T10:59:53.238 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-05-12T10:59:53.253 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-12T10:59:53.253 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-05-12T10:59:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-12T10:59:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:53.308 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-05-12T10:59:53.308 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:53.308 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:53.308 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-05-12 10:59:28.136049112 +0000 2024-05-12T10:59:53.308 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-05-12 10:54:32.451387623 +0000 2024-05-12T10:59:53.309 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-05-12 10:54:32.451387623 +0000 2024-05-12T10:59:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-05-12 10:54:32.451387623 +0000 2024-05-12T10:59:53.309 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-12T10:59:53.372 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-05-12T10:59:53.372 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-05-12T10:59:53.372 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000270317 s, 1.9 MB/s 2024-05-12T10:59:53.373 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-12T10:59:53.429 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-05-12T10:59:53.484 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-12T10:59:53.485 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:53.485 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-12T10:59:53.485 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:53.485 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:53.485 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-05-12 10:59:28.136049112 +0000 2024-05-12T10:59:53.485 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-05-12 10:54:32.807383854 +0000 2024-05-12T10:59:53.485 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-05-12 10:54:32.807383854 +0000 2024-05-12T10:59:53.485 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-05-12 10:54:32.807383854 +0000 2024-05-12T10:59:53.485 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-12T10:59:53.548 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-05-12T10:59:53.548 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-05-12T10:59:53.548 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000216503 s, 2.4 MB/s 2024-05-12T10:59:53.549 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-12T10:59:53.605 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-05-12 10:59:28.137049102 +0000 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-05-12 10:54:33.148380244 +0000 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-05-12 10:54:33.148380244 +0000 2024-05-12T10:59:53.660 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-05-12 10:54:33.148380244 +0000 2024-05-12T10:59:53.660 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-12T10:59:53.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:53.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:53.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:53.710 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:53.711 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T10:59:53.711 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-12T10:59:53.711 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T10:59:53.711 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:53.711 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:53 smithi176 ceph-mon[34357]: Deploying daemon mgr.z on smithi176 2024-05-12T10:59:53.722 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-05-12T10:59:53.722 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-05-12T10:59:53.722 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000274227 s, 1.9 MB/s 2024-05-12T10:59:53.723 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-12T10:59:53.779 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-05-12T10:59:53.834 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-12T10:59:53.834 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T10:59:53.834 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-12T10:59:53.834 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T10:59:53.834 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-05-12T10:59:53.835 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-05-12 10:59:28.137049102 +0000 2024-05-12T10:59:53.835 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-05-12 10:54:33.486376666 +0000 2024-05-12T10:59:53.835 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-05-12 10:54:33.486376666 +0000 2024-05-12T10:59:53.835 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-05-12 10:54:33.486376666 +0000 2024-05-12T10:59:53.835 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-12T10:59:53.897 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-05-12T10:59:53.897 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-05-12T10:59:53.897 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000189982 s, 2.7 MB/s 2024-05-12T10:59:53.898 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-12T10:59:53.954 INFO:tasks.cephadm:Deploying osd.0 on smithi086 with /dev/vg_nvme/lv_4... 2024-05-12T10:59:53.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:53 smithi086 ceph-mon[30110]: Deploying daemon mgr.z on smithi176 2024-05-12T10:59:53.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:53.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:53.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T10:59:53.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:53.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T10:59:53.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-12T10:59:53.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T10:59:53.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:53.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:53 smithi172 ceph-mon[34517]: Deploying daemon mgr.z on smithi176 2024-05-12T10:59:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:59:54.980 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:54 smithi176 systemd[1]: Starting Ceph mgr.z for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T10:59:55.267 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:54 smithi176 podman[36360]: 2024-05-12 10:59:54.892145545 +0000 UTC m=+0.017975874 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T10:59:55.267 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:54 smithi176 podman[36360]: 2024-05-12 10:59:54.990034981 +0000 UTC m=+0.115865297 container create 9e11416f5d2b58738eee8105ce6450fe541dfbfb9bc1ce091aff769e33dd8062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T10:59:55.267 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 podman[36360]: 2024-05-12 10:59:55.175683116 +0000 UTC m=+0.301513437 container init 9e11416f5d2b58738eee8105ce6450fe541dfbfb9bc1ce091aff769e33dd8062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T10:59:55.268 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 podman[36360]: 2024-05-12 10:59:55.179187946 +0000 UTC m=+0.305018259 container start 9e11416f5d2b58738eee8105ce6450fe541dfbfb9bc1ce091aff769e33dd8062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T10:59:55.268 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mgr[36380]: -- 172.21.15.176:0/3068177572 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a388ee25a0 con 0x55a388eb6c00 2024-05-12T10:59:55.268 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 bash[36360]: 9e11416f5d2b58738eee8105ce6450fe541dfbfb9bc1ce091aff769e33dd8062 2024-05-12T10:59:55.268 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 systemd[1]: Started Ceph mgr.z for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T10:59:55.520 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:55.336+0000 7fd0f719c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T10:59:55.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mon[34357]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:55.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T10:59:55.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-12T10:59:55.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T10:59:55.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:55.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:55 smithi086 ceph-mon[30110]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:55.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.567 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.567 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T10:59:55.567 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-12T10:59:55.567 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T10:59:55.567 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:55.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:55 smithi172 ceph-mon[34517]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:55.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:55.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T10:59:55.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-12T10:59:55.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T10:59:55.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:55.952 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:55.531+0000 7fd0f719c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:59:55.952 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:55.639+0000 7fd0f719c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T10:59:55.952 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:55.960+0000 7fd0f719c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T10:59:56.150 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-12T10:59:56.150 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-12T10:59:56.151 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-05-12T10:59:56.151 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-05-12T10:59:56.151 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125996 s, 832 MB/s 2024-05-12T10:59:56.151 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-05-12T10:59:56.267 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:56 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:56.045+0000 7fd0f719c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T10:59:56.706 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:56 smithi086 ceph-mon[30110]: Deploying daemon mgr.y on smithi172 2024-05-12T10:59:56.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:56 smithi172 ceph-mon[34517]: Deploying daemon mgr.y on smithi172 2024-05-12T10:59:56.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_4 2024-05-12T10:59:56.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:56 smithi176 ceph-mon[34357]: Deploying daemon mgr.y on smithi172 2024-05-12T10:59:57.027 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T10:59:57.474 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 systemd[1]: Starting Ceph mgr.y for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T10:59:57.494 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:57.241+0000 7fd0f719c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T10:59:57.494 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:57.409+0000 7fd0f719c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T10:59:57.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:57 smithi086 ceph-mon[30110]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:57.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:57 smithi176 ceph-mon[34357]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:57.767 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:57.580+0000 7fd0f719c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T10:59:57.828 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:57 smithi172 ceph-mon[34517]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:57.828 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 podman[35889]: 2024-05-12 10:59:57.609789457 +0000 UTC m=+0.116298109 container create 24d1c8192c9ad9550516dcc92b3096cccab4eb3fb154963c5c05dcdef5a44254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, CEPH_POINT_RELEASE=) 2024-05-12T10:59:57.828 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 podman[35889]: 2024-05-12 10:59:57.515352903 +0000 UTC m=+0.021861509 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T10:59:57.828 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 podman[35889]: 2024-05-12 10:59:57.837092713 +0000 UTC m=+0.343601320 container init 24d1c8192c9ad9550516dcc92b3096cccab4eb3fb154963c5c05dcdef5a44254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS) 2024-05-12T10:59:58.156 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:57.865+0000 7fd0f719c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T10:59:58.156 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:57.957+0000 7fd0f719c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T10:59:58.156 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:58 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:58.164+0000 7fd0f719c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T10:59:58.173 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 podman[35889]: 2024-05-12 10:59:57.83980244 +0000 UTC m=+0.346311055 container start 24d1c8192c9ad9550516dcc92b3096cccab4eb3fb154963c5c05dcdef5a44254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-12T10:59:58.174 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 ceph-mgr[35909]: -- 172.21.15.172:0/3362848003 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581fdc7a5a0 con 0x5581fdc4f000 2024-05-12T10:59:58.174 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 bash[35889]: 24d1c8192c9ad9550516dcc92b3096cccab4eb3fb154963c5c05dcdef5a44254 2024-05-12T10:59:58.174 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 systemd[1]: Started Ceph mgr.y for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T10:59:58.174 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:57 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T10:59:57.992+0000 7f805fe92200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T10:59:58.174 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T10:59:58.181+0000 7f805fe92200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:59:58.474 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T10:59:58.291+0000 7f805fe92200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T10:59:58.517 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:58 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:58.364+0000 7fd0f719c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T10:59:58.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 -- 172.21.15.86:0/1327786641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0101e10 msgr2=0x7f30f0102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:58.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 --2- 172.21.15.86:0/1327786641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0101e10 0x7f30f0102230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f30e400b0a0 tx=0x7f30e400b3b0 comp rx=0 tx=0).stop 2024-05-12T10:59:58.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 -- 172.21.15.86:0/1327786641 shutdown_connections 2024-05-12T10:59:58.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 --2- 172.21.15.86:0/1327786641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f0103130 0x7f30f01035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:58.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 --2- 172.21.15.86:0/1327786641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0101e10 0x7f30f0102230 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:58.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 --2- 172.21.15.86:0/1327786641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f0102770 0x7f30f0102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:58.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 -- 172.21.15.86:0/1327786641 >> 172.21.15.86:0/1327786641 conn(0x7f30f00fd9d0 msgr2=0x7f30f00ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 -- 172.21.15.86:0/1327786641 shutdown_connections 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 -- 172.21.15.86:0/1327786641 wait complete. 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.635+0000 7f30f6f06700 1 Processor -- start 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f6f06700 1 -- start start 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f6f06700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f0101e10 0x7f30f019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f6f06700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f0102770 0x7f30f019be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f6f06700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0103130 0x7f30f01a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f6f06700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f30f0111180 con 0x7f30f0103130 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f6f06700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30f0111000 con 0x7f30f0101e10 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f6f06700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f30f0111300 con 0x7f30f0102770 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0103130 0x7f30f01a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0103130 0x7f30f01a2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45848/0 (socket says 172.21.15.86:45848) 2024-05-12T10:59:58.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 -- 172.21.15.86:0/4130600182 learned_addr learned my addr 172.21.15.86:0/4130600182 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f4ca2700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f0101e10 0x7f30f019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30effff700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f0102770 0x7f30f019be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 -- 172.21.15.86:0/4130600182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f0102770 msgr2=0x7f30f019be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f0102770 0x7f30f019be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 -- 172.21.15.86:0/4130600182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f0101e10 msgr2=0x7f30f019b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f0101e10 0x7f30f019b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 -- 172.21.15.86:0/4130600182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f01a3500 con 0x7f30f0103130 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f4ca2700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f0101e10 0x7f30f019b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.636+0000 7f30f54a3700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0103130 0x7f30f01a2e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e970 tx=0x7f30e800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.637+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8004a30 con 0x7f30f0103130 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.637+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30e80054d0 con 0x7f30f0103130 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.637+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e800cd80 con 0x7f30f0103130 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.637+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f01a37f0 con 0x7f30f0103130 2024-05-12T10:59:58.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.637+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f01a3d80 con 0x7f30f0103130 2024-05-12T10:59:58.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.638+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f30e8004fa0 con 0x7f30f0103130 2024-05-12T10:59:58.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.638+0000 7f30edffb700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f30e003e750 0x7f30e0040c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T10:59:58.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.638+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f006a190 con 0x7f30f0103130 2024-05-12T10:59:58.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.638+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f30e80529c0 con 0x7f30f0103130 2024-05-12T10:59:58.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.638+0000 7f30f4ca2700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f30e003e750 0x7f30e0040c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T10:59:58.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.638+0000 7f30f4ca2700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f30e003e750 0x7f30e0040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009fd0 tx=0x7f30e4006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T10:59:58.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.643+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f30e8016590 con 0x7f30f0103130 2024-05-12T10:59:58.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T10:59:58.862+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f30f00639a0 con 0x7f30e003e750 2024-05-12T10:59:58.909 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T10:59:58.621+0000 7f805fe92200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T10:59:58.909 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T10:59:58.720+0000 7f805fe92200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T10:59:59.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 10:59:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:59.222 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:59.004+0000 7fd0f719c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-12T10:59:59.222 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:59.230+0000 7fd0f719c200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-12T10:59:59.222 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.222 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.223 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:59.223 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.223 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.223 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:59.223 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T10:59:59.223 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T10:59:59.223 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 10:59:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T10:59:59.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 10:59:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:00.017 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:59.660+0000 7fd0f719c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T11:00:00.017 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 10:59:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T10:59:59.759+0000 7fd0f719c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T11:00:00.224 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 10:59:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T10:59:59.977+0000 7f805fe92200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T11:00:00.224 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:00.147+0000 7f805fe92200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T11:00:00.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: Reconfiguring mgr.x (unknown last config time)... 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T11:00:00.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:00.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: Reconfiguring daemon mgr.x on smithi086 2024-05-12T11:00:00.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:00 smithi172 ceph-mon[34517]: overall HEALTH_OK 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:00.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: Reconfiguring mgr.x (unknown last config time)... 2024-05-12T11:00:00.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T11:00:00.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T11:00:00.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:00.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: Reconfiguring daemon mgr.x on smithi086 2024-05-12T11:00:00.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:00 smithi086 ceph-mon[30110]: overall HEALTH_OK 2024-05-12T11:00:00.466 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:00.127+0000 7fd0f719c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-12T11:00:00.466 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:00.474+0000 7fd0f719c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T11:00:00.466 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:00.466 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: Reconfiguring mgr.x (unknown last config time)... 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: Reconfiguring daemon mgr.x on smithi086 2024-05-12T11:00:00.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:00 smithi176 ceph-mon[34357]: overall HEALTH_OK 2024-05-12T11:00:00.596 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:00.317+0000 7f805fe92200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T11:00:00.596 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:00.603+0000 7f805fe92200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T11:00:00.767 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:00.564+0000 7fd0f719c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T11:00:00.889 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:00.695+0000 7f805fe92200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T11:00:00.889 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:00.897+0000 7f805fe92200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T11:00:01.224 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:01.087+0000 7f805fe92200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T11:00:01.267 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:00.801+0000 7fd0f719c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T11:00:01.267 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:00.931+0000 7fd0f719c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T11:00:01.267 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:01.022+0000 7fd0f719c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T11:00:01.767 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:01.349+0000 7fd0f719c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T11:00:01.767 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:01.439+0000 7fd0f719c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T11:00:01.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:01 smithi176 ceph-mon[34357]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:01.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:01 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3277022297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d3771cb-dd57-494b-ba95-1cf9a0d5d840"}]: dispatch 2024-05-12T11:00:01.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:01 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3277022297' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d3771cb-dd57-494b-ba95-1cf9a0d5d840"}]': finished 2024-05-12T11:00:01.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:01 smithi176 ceph-mon[34357]: osdmap e5: 1 total, 0 up, 1 in 2024-05-12T11:00:01.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:01.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:01 smithi086 ceph-mon[30110]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:01.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:01 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3277022297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d3771cb-dd57-494b-ba95-1cf9a0d5d840"}]: dispatch 2024-05-12T11:00:01.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:01 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3277022297' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d3771cb-dd57-494b-ba95-1cf9a0d5d840"}]': finished 2024-05-12T11:00:01.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:01 smithi086 ceph-mon[30110]: osdmap e5: 1 total, 0 up, 1 in 2024-05-12T11:00:01.891 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:01.898 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:01 smithi172 ceph-mon[34517]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:01.898 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:01 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3277022297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d3771cb-dd57-494b-ba95-1cf9a0d5d840"}]: dispatch 2024-05-12T11:00:01.898 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:01 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3277022297' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d3771cb-dd57-494b-ba95-1cf9a0d5d840"}]': finished 2024-05-12T11:00:01.898 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:01 smithi172 ceph-mon[34517]: osdmap e5: 1 total, 0 up, 1 in 2024-05-12T11:00:01.898 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:01.899 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:01.689+0000 7f805fe92200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-12T11:00:01.899 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:01.906+0000 7f805fe92200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-12T11:00:02.517 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:02 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:02.032+0000 7fd0f719c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T11:00:02.517 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:00:02 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:00:02.243+0000 7fd0f719c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T11:00:02.580 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:02.328+0000 7f805fe92200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T11:00:02.580 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:02.423+0000 7f805fe92200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T11:00:02.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:02.593+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7f30e801dcd0 con 0x7f30f0103130 2024-05-12T11:00:02.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:02 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/47055930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:02.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:02 smithi086 ceph-mon[30110]: Standby manager daemon z started 2024-05-12T11:00:02.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:02 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-12T11:00:02.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:02 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:00:02.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:02 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-12T11:00:02.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:02 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:00:02.974 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:02.795+0000 7f805fe92200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-12T11:00:02.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:02 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/47055930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:02.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:02 smithi172 ceph-mon[34517]: Standby manager daemon z started 2024-05-12T11:00:02.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:02 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-12T11:00:02.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:02 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:00:02.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:02 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-12T11:00:02.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:02 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:00:03.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:02 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/47055930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:03.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:02 smithi176 ceph-mon[34357]: Standby manager daemon z started 2024-05-12T11:00:03.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:02 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-12T11:00:03.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:02 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:00:03.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:02 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-12T11:00:03.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:02 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.176:0/3764430608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:00:03.469 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:03.145+0000 7f805fe92200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T11:00:03.469 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:03.236+0000 7f805fe92200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T11:00:03.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:03 smithi172 ceph-mon[34517]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:03.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:03 smithi172 ceph-mon[34517]: mgrmap e14: x(active, since 78s), standbys: z 2024-05-12T11:00:03.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-12T11:00:03.724 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:03.477+0000 7f805fe92200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T11:00:03.724 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:03.612+0000 7f805fe92200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T11:00:03.725 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:03.706+0000 7f805fe92200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T11:00:03.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:03 smithi086 ceph-mon[30110]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:03.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:03 smithi086 ceph-mon[30110]: mgrmap e14: x(active, since 78s), standbys: z 2024-05-12T11:00:03.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-12T11:00:04.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:03 smithi176 ceph-mon[34357]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:04.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:03 smithi176 ceph-mon[34357]: mgrmap e14: x(active, since 78s), standbys: z 2024-05-12T11:00:04.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-12T11:00:04.474 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:04 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:04.034+0000 7f805fe92200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T11:00:04.474 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:04 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:04.124+0000 7f805fe92200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T11:00:04.974 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:04 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:04.724+0000 7f805fe92200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T11:00:04.974 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:00:04 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:00:04.939+0000 7f805fe92200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T11:00:05.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:05.602+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f30e801f520 con 0x7f30f0103130 2024-05-12T11:00:05.783 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:05 smithi086 ceph-mon[30110]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:05.783 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:05 smithi086 ceph-mon[30110]: Standby manager daemon y started 2024-05-12T11:00:05.783 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:05 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-12T11:00:05.783 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:05 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:00:05.783 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:05 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-12T11:00:05.783 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:05 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:00:05.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:05 smithi172 ceph-mon[34517]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:05.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:05 smithi172 ceph-mon[34517]: Standby manager daemon y started 2024-05-12T11:00:05.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:05 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-12T11:00:05.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:05 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:00:05.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:05 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-12T11:00:05.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:05 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:00:06.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:05 smithi176 ceph-mon[34357]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:06.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:05 smithi176 ceph-mon[34357]: Standby manager daemon y started 2024-05-12T11:00:06.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:05 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-12T11:00:06.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:05 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:00:06.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:05 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-12T11:00:06.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:05 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.172:0/619610065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:00:06.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:06 smithi086 ceph-mon[30110]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-05-12T11:00:06.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:06 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-12T11:00:06.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:06 smithi172 ceph-mon[34517]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-05-12T11:00:06.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:06 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-12T11:00:07.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:06 smithi176 ceph-mon[34357]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-05-12T11:00:07.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:06 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-12T11:00:07.790 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:07 smithi086 ceph-mon[30110]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:07.790 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:07.790 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:07.790 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:07.790 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:07.790 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:07.790 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:07 smithi172 ceph-mon[34517]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:07.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:08.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:07 smithi176 ceph-mon[34357]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:08.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:08.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:08.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:08.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:08.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:08.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:09.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:09 smithi086 ceph-mon[30110]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:09.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:09 smithi172 ceph-mon[34517]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:10.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:09 smithi176 ceph-mon[34357]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:10.698 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-12T11:00:10.698 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:10.698 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:10 smithi086 ceph-mon[30110]: Deploying daemon osd.0 on smithi086 2024-05-12T11:00:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-12T11:00:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:10 smithi172 ceph-mon[34517]: Deploying daemon osd.0 on smithi086 2024-05-12T11:00:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-12T11:00:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:10 smithi176 ceph-mon[34357]: Deploying daemon osd.0 on smithi086 2024-05-12T11:00:11.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:11 smithi086 ceph-mon[30110]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:11.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:11 smithi172 ceph-mon[34517]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:12.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:11 smithi176 ceph-mon[34357]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:13.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:13 smithi086 ceph-mon[30110]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:13.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:13 smithi172 ceph-mon[34517]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:14.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:13 smithi176 ceph-mon[34357]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:15.924 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:15 smithi086 ceph-mon[30110]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:15.924 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:15.924 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:15.924 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:15 smithi172 ceph-mon[34517]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:15 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:15 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:15 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:15 smithi176 ceph-mon[34357]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:15 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:15 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:15 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:17.878 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:17 smithi086 ceph-mon[30110]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:17.878 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:17.878 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:17.878 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:17.878 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:17 smithi172 ceph-mon[34517]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:17 smithi176 ceph-mon[34357]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:18.882 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:18 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:18.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.973+0000 7f30edffb700 1 -- 172.21.15.86:0/4130600182 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f30f00639a0 con 0x7f30e003e750 2024-05-12T11:00:18.965 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 0 on host 'smithi086' 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f30e003e750 msgr2=0x7f30e0040c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f30e003e750 0x7f30e0040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009fd0 tx=0x7f30e4006210 comp rx=0 tx=0).stop 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0103130 msgr2=0x7f30f01a2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0103130 0x7f30f01a2e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e970 tx=0x7f30e800ec80 comp rx=0 tx=0).stop 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 shutdown_connections 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f30e003e750 0x7f30e0040c10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f0103130 0x7f30f01a2e60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f0101e10 0x7f30f019b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 --2- 172.21.15.86:0/4130600182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f0102770 0x7f30f019be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:18.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 >> 172.21.15.86:0/4130600182 conn(0x7f30f00fd9d0 msgr2=0x7f30f00ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:00:18.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 shutdown_connections 2024-05-12T11:00:18.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:00:18.976+0000 7f30f6f06700 1 -- 172.21.15.86:0/4130600182 wait complete. 2024-05-12T11:00:18.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:18 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:19.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:18 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:19.661 DEBUG:teuthology.orchestra.run.smithi086:osd.0> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.0.service 2024-05-12T11:00:19.664 INFO:tasks.cephadm:Deploying osd.1 on smithi172 with /dev/vg_nvme/lv_4... 2024-05-12T11:00:19.664 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-12T11:00:19.907 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:00:19.941 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:19 smithi086 ceph-mon[30110]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:19.941 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:19.941 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:19.941 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:19.941 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:19 smithi086 ceph-mon[30110]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-12T11:00:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:19 smithi172 ceph-mon[34517]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:19 smithi172 ceph-mon[34517]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-12T11:00:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:19 smithi176 ceph-mon[34357]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:19 smithi176 ceph-mon[34357]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-12T11:00:21.039 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:20 smithi086 ceph-mon[30110]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-12T11:00:21.039 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:20 smithi086 ceph-mon[30110]: osdmap e6: 1 total, 0 up, 1 in 2024-05-12T11:00:21.039 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:20 smithi086 ceph-mon[30110]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:00:21.039 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:20 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:21.039 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:20 smithi086 ceph-mon[30110]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:21.040 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:00:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0[42257]: 2024-05-12T11:00:20.941+0000 7f1b2cd37700 -1 osd.0 0 waiting for initial osdmap 2024-05-12T11:00:21.040 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:00:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0[42257]: 2024-05-12T11:00:20.947+0000 7f1b28b2a700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:00:21.146 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:20 smithi172 ceph-mon[34517]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-12T11:00:21.146 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:20 smithi172 ceph-mon[34517]: osdmap e6: 1 total, 0 up, 1 in 2024-05-12T11:00:21.146 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:20 smithi172 ceph-mon[34517]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:00:21.146 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:20 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:21.146 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:20 smithi172 ceph-mon[34517]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:21.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:20 smithi176 ceph-mon[34357]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-12T11:00:21.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:20 smithi176 ceph-mon[34357]: osdmap e6: 1 total, 0 up, 1 in 2024-05-12T11:00:21.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:20 smithi176 ceph-mon[34357]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:00:21.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:20 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:21.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:20 smithi176 ceph-mon[34357]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:21.712 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-12T11:00:21.712 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-12T11:00:21.712 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-12T11:00:21.712 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-12T11:00:21.713 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114133 s, 919 MB/s 2024-05-12T11:00:21.713 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-12T11:00:22.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:21 smithi172 ceph-mon[34517]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:00:22.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:21 smithi172 ceph-mon[34517]: osdmap e7: 1 total, 0 up, 1 in 2024-05-12T11:00:22.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:22.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:22.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:21 smithi086 ceph-mon[30110]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:00:22.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:21 smithi086 ceph-mon[30110]: osdmap e7: 1 total, 0 up, 1 in 2024-05-12T11:00:22.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:22.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:22.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:21 smithi176 ceph-mon[34357]: from='osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:00:22.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:21 smithi176 ceph-mon[34357]: osdmap e7: 1 total, 0 up, 1 in 2024-05-12T11:00:22.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:22.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:22.286 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-05-12T11:00:22.534 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:00:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:00:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:00:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] boot 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: osdmap e8: 1 total, 1 up, 1 in 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi086 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi086 to 17088M 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:23.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:00:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:00:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] boot 2024-05-12T11:00:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: osdmap e8: 1 total, 1 up, 1 in 2024-05-12T11:00:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi086 2024-05-12T11:00:23.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:00:23.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi086 to 17088M 2024-05-12T11:00:23.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:23.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:23.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:00:23.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:00:23.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:23.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: osd.0 [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] boot 2024-05-12T11:00:23.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: osdmap e8: 1 total, 1 up, 1 in 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi086 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi086 to 17088M 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:23.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:23.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- 172.21.15.172:0/1765407652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103fa0 msgr2=0x7f298810a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:23.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 --2- 172.21.15.172:0/1765407652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103fa0 0x7f298810a850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f298000b0d0 tx=0x7f298000b3e0 comp rx=0 tx=0).stop 2024-05-12T11:00:23.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- 172.21.15.172:0/1765407652 shutdown_connections 2024-05-12T11:00:23.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 --2- 172.21.15.172:0/1765407652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103fa0 0x7f298810a850 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:23.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 --2- 172.21.15.172:0/1765407652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2988102400 0x7f2988102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 --2- 172.21.15.172:0/1765407652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2988103600 0x7f2988103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- 172.21.15.172:0/1765407652 >> 172.21.15.172:0/1765407652 conn(0x7f29880fd9a0 msgr2=0x7f29880ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- 172.21.15.172:0/1765407652 shutdown_connections 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- 172.21.15.172:0/1765407652 wait complete. 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 Processor -- start 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- start start 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2988102400 0x7f298806bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103600 0x7f298819e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2988103fa0 0x7f29881a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f298810def0 con 0x7f2988102400 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f298810dd70 con 0x7f2988103600 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298e472700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f298810e070 con 0x7f2988103fa0 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f29877fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103600 0x7f298819e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f29877fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103600 0x7f298819e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33248/0 (socket says 172.21.15.172:33248) 2024-05-12T11:00:23.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f29877fe700 1 -- 172.21.15.172:0/718702329 learned_addr learned my addr 172.21.15.172:0/718702329 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f298ca0f700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2988103fa0 0x7f29881a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f2987fff700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2988102400 0x7f298806bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f29877fe700 1 -- 172.21.15.172:0/718702329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2988103fa0 msgr2=0x7f29881a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f29877fe700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2988103fa0 0x7f29881a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f29877fe700 1 -- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2988102400 msgr2=0x7f298806bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f29877fe700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2988102400 0x7f298806bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.988+0000 7f29877fe700 1 -- 172.21.15.172:0/718702329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29881a1260 con 0x7f2988103600 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.989+0000 7f29877fe700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103600 0x7f298819e340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b530 tx=0x7f297c00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.989+0000 7f29857fa700 1 -- 172.21.15.172:0/718702329 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c015020 con 0x7f2988103600 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.989+0000 7f29857fa700 1 -- 172.21.15.172:0/718702329 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f297c011ce0 con 0x7f2988103600 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.989+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29881a1550 con 0x7f2988103600 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.989+0000 7f29857fa700 1 -- 172.21.15.172:0/718702329 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c010e40 con 0x7f2988103600 2024-05-12T11:00:23.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.989+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29881a1b60 con 0x7f2988103600 2024-05-12T11:00:23.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.991+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f298806a190 con 0x7f2988103600 2024-05-12T11:00:23.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.992+0000 7f29857fa700 1 -- 172.21.15.172:0/718702329 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f297c018020 con 0x7f2988103600 2024-05-12T11:00:23.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.992+0000 7f29857fa700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f29700b2870 0x7f29700b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:00:23.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.993+0000 7f29857fa700 1 -- 172.21.15.172:0/718702329 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f297c0e04d0 con 0x7f2988103600 2024-05-12T11:00:23.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.993+0000 7f2987fff700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f29700b2870 0x7f29700b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:00:23.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.993+0000 7f2987fff700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f29700b2870 0x7f29700b4d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2988103460 tx=0x7f2978005d70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:00:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:23.997+0000 7f29857fa700 1 -- 172.21.15.172:0/718702329 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f297c01f020 con 0x7f2988103600 2024-05-12T11:00:24.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:24.212+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f29880638e0 con 0x7f29700b2870 2024-05-12T11:00:24.204 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:23 smithi172 ceph-mon[34517]: osdmap e9: 1 total, 1 up, 1 in 2024-05-12T11:00:24.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:23 smithi086 ceph-mon[30110]: osdmap e9: 1 total, 1 up, 1 in 2024-05-12T11:00:24.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:23 smithi176 ceph-mon[34357]: osdmap e9: 1 total, 1 up, 1 in 2024-05-12T11:00:25.094 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:24 smithi172 ceph-mon[34517]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:25.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:24 smithi172 ceph-mon[34517]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:25.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:24 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:00:25.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:24 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:00:25.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:24 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:25.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:24 smithi086 ceph-mon[30110]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:25.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:24 smithi086 ceph-mon[30110]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:25.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:00:25.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:00:25.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:25.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:24 smithi176 ceph-mon[34357]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:25.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:24 smithi176 ceph-mon[34357]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:25.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:24 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:00:25.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:24 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:00:25.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:24 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:27.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:27 smithi086 ceph-mon[30110]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:27.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:27 smithi086 ceph-mon[30110]: from='client.? 172.21.15.172:0/3191262066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]: dispatch 2024-05-12T11:00:27.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:27 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]: dispatch 2024-05-12T11:00:27.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:27 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]': finished 2024-05-12T11:00:27.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:27 smithi086 ceph-mon[30110]: osdmap e10: 2 total, 1 up, 2 in 2024-05-12T11:00:27.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:27 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:27.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:27 smithi172 ceph-mon[34517]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:27.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:27 smithi172 ceph-mon[34517]: from='client.? 172.21.15.172:0/3191262066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]: dispatch 2024-05-12T11:00:27.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:27 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]: dispatch 2024-05-12T11:00:27.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:27 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]': finished 2024-05-12T11:00:27.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:27 smithi172 ceph-mon[34517]: osdmap e10: 2 total, 1 up, 2 in 2024-05-12T11:00:27.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:27 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:27.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:27 smithi176 ceph-mon[34357]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:27.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:27 smithi176 ceph-mon[34357]: from='client.? 172.21.15.172:0/3191262066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]: dispatch 2024-05-12T11:00:27.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:27 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]: dispatch 2024-05-12T11:00:27.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:27 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34298bec-64f8-4ede-a3de-f974d74e2cc5"}]': finished 2024-05-12T11:00:27.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:27 smithi176 ceph-mon[34357]: osdmap e10: 2 total, 1 up, 2 in 2024-05-12T11:00:27.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:27 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:28 smithi172 ceph-mon[34517]: from='client.? 172.21.15.172:0/3723326944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:28.384 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:28 smithi086 ceph-mon[30110]: from='client.? 172.21.15.172:0/3723326944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:28.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:28 smithi176 ceph-mon[34357]: from='client.? 172.21.15.172:0/3723326944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:29.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:29 smithi086 ceph-mon[30110]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:29.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:29 smithi172 ceph-mon[34517]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:29 smithi176 ceph-mon[34357]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:31.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:31 smithi086 ceph-mon[30110]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:31.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:31 smithi172 ceph-mon[34517]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:31 smithi176 ceph-mon[34357]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:33.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:33 smithi086 ceph-mon[30110]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:33.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:33 smithi172 ceph-mon[34517]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:33.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:33 smithi176 ceph-mon[34357]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:34.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-12T11:00:34.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:34.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-12T11:00:34.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:34.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-12T11:00:34.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:35 smithi172 ceph-mon[34517]: Deploying daemon osd.1 on smithi172 2024-05-12T11:00:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:35 smithi172 ceph-mon[34517]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:35.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:35 smithi176 ceph-mon[34357]: Deploying daemon osd.1 on smithi172 2024-05-12T11:00:35.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:35 smithi176 ceph-mon[34357]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:35.364 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:35 smithi086 ceph-mon[30110]: Deploying daemon osd.1 on smithi172 2024-05-12T11:00:35.364 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:35 smithi086 ceph-mon[30110]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:37.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:37 smithi172 ceph-mon[34517]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:37.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:37 smithi086 ceph-mon[30110]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:37.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:37 smithi176 ceph-mon[34357]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:39.206 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:39 smithi172 ceph-mon[34517]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:39.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:39 smithi086 ceph-mon[30110]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:39 smithi176 ceph-mon[34357]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:40.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:40 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:40.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:40 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:40.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:40 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:40.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:40 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:40.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:40 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:40.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:40 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:40.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:40 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:40.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:40 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:40.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:40 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:41.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:41 smithi176 ceph-mon[34357]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:41.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:41 smithi172 ceph-mon[34517]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:41.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:41 smithi086 ceph-mon[30110]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:42.164 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 1 on host 'smithi172' 2024-05-12T11:00:42.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.172+0000 7f29857fa700 1 -- 172.21.15.172:0/718702329 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f29880638e0 con 0x7f29700b2870 2024-05-12T11:00:42.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f29700b2870 msgr2=0x7f29700b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f29700b2870 0x7f29700b4d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2988103460 tx=0x7f2978005d70 comp rx=0 tx=0).stop 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103600 msgr2=0x7f298819e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103600 0x7f298819e340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b530 tx=0x7f297c00b840 comp rx=0 tx=0).stop 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 shutdown_connections 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f29700b2870 0x7f29700b4d30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2988103fa0 0x7f29881a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2988102400 0x7f298806bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 --2- 172.21.15.172:0/718702329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103600 0x7f298819e340 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 >> 172.21.15.172:0/718702329 conn(0x7f29880fd9a0 msgr2=0x7f2988106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 shutdown_connections 2024-05-12T11:00:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:00:42.175+0000 7f298e472700 1 -- 172.21.15.172:0/718702329 wait complete. 2024-05-12T11:00:43.060 DEBUG:teuthology.orchestra.run.smithi172:osd.1> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.1.service 2024-05-12T11:00:43.062 INFO:tasks.cephadm:Deploying osd.2 on smithi176 with /dev/vg_nvme/lv_4... 2024-05-12T11:00:43.062 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-12T11:00:43.309 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:00:43.435 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:43 smithi176 ceph-mon[34357]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:43.435 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:43.435 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:43 smithi086 ceph-mon[30110]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:43.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:43 smithi172 ceph-mon[34517]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:43.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:43.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:43.474 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:00:43 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1[39100]: 2024-05-12T11:00:43.161+0000 7fd83a1867c0 -1 osd.1 0 log_to_monitors true 2024-05-12T11:00:44.453 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:44.453 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:44.453 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:44 smithi176 ceph-mon[34357]: from='osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-12T11:00:44.453 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:44 smithi176 ceph-mon[34357]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-12T11:00:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:44 smithi086 ceph-mon[30110]: from='osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-12T11:00:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:44 smithi086 ceph-mon[30110]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-12T11:00:44.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:44.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:44.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:44 smithi172 ceph-mon[34517]: from='osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-12T11:00:44.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:44 smithi172 ceph-mon[34517]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-12T11:00:45.154 INFO:teuthology.orchestra.run.smithi176.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-12T11:00:45.155 INFO:teuthology.orchestra.run.smithi176.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-12T11:00:45.155 INFO:teuthology.orchestra.run.smithi176.stderr: stderr: 10+0 records in 2024-05-12T11:00:45.155 INFO:teuthology.orchestra.run.smithi176.stderr:10+0 records out 2024-05-12T11:00:45.155 INFO:teuthology.orchestra.run.smithi176.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113523 s, 924 MB/s 2024-05-12T11:00:45.155 INFO:teuthology.orchestra.run.smithi176.stderr:--> Zapping successful for: 2024-05-12T11:00:45.457 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:45 smithi176 ceph-mon[34357]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:45.457 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:45 smithi176 ceph-mon[34357]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-12T11:00:45.457 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:45 smithi176 ceph-mon[34357]: osdmap e11: 2 total, 1 up, 2 in 2024-05-12T11:00:45.457 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:45.457 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:45 smithi176 ceph-mon[34357]: from='osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:00:45.457 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:45 smithi176 ceph-mon[34357]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:00:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:45 smithi086 ceph-mon[30110]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:45 smithi086 ceph-mon[30110]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-12T11:00:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:45 smithi086 ceph-mon[30110]: osdmap e11: 2 total, 1 up, 2 in 2024-05-12T11:00:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:45 smithi086 ceph-mon[30110]: from='osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:00:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:45 smithi086 ceph-mon[30110]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:00:45.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:45 smithi172 ceph-mon[34517]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:45.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:45 smithi172 ceph-mon[34517]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-12T11:00:45.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:45 smithi172 ceph-mon[34517]: osdmap e11: 2 total, 1 up, 2 in 2024-05-12T11:00:45.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:45.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:45 smithi172 ceph-mon[34517]: from='osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:00:45.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:45 smithi172 ceph-mon[34517]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:00:45.790 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi176:vg_nvme/lv_4 2024-05-12T11:00:45.974 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:00:45 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1[39100]: 2024-05-12T11:00:45.692+0000 7fd82f7ea700 -1 osd.1 0 waiting for initial osdmap 2024-05-12T11:00:45.974 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:00:45 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1[39100]: 2024-05-12T11:00:45.696+0000 7fd8275d5700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:00:46.029 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:00:46.418 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:46 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:00:46.418 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:46 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:00:46.418 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:46 smithi176 ceph-mon[34357]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:00:46.419 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:46 smithi176 ceph-mon[34357]: osdmap e12: 2 total, 1 up, 2 in 2024-05-12T11:00:46.419 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:46.419 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:46 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:46.419 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:46 smithi176 ceph-mon[34357]: from='osd.1 ' entity='osd.1' 2024-05-12T11:00:46.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:46 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:00:46.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:46 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:00:46.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:46 smithi086 ceph-mon[30110]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:00:46.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:46 smithi086 ceph-mon[30110]: osdmap e12: 2 total, 1 up, 2 in 2024-05-12T11:00:46.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:46.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:46 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:46.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:46 smithi086 ceph-mon[30110]: from='osd.1 ' entity='osd.1' 2024-05-12T11:00:46.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:46 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:00:46.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:46 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:00:46.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:46 smithi172 ceph-mon[34517]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:00:46.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:46 smithi172 ceph-mon[34517]: osdmap e12: 2 total, 1 up, 2 in 2024-05-12T11:00:46.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:46.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:46 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:46.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:46 smithi172 ceph-mon[34517]: from='osd.1 ' entity='osd.1' 2024-05-12T11:00:47.353 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:47.353 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi172 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi172 to 17088M 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] boot 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: osdmap e13: 2 total, 2 up, 2 in 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:47.354 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:47.355 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:47.355 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:47.355 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:47.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:47.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi172 2024-05-12T11:00:47.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi172 to 17088M 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] boot 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: osdmap e13: 2 total, 2 up, 2 in 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:47.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi172 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi172 to 17088M 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: osd.1 [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] boot 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: osdmap e13: 2 total, 2 up, 2 in 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:00:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.565+0000 7feb03fb1700 1 -- 172.21.15.176:0/2335607993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 msgr2=0x7feafc101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.565+0000 7feb03fb1700 1 --2- 172.21.15.176:0/2335607993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 0x7feafc101a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009990 tx=0x7feaf8009ca0 comp rx=0 tx=0).stop 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.565+0000 7feb03fb1700 1 -- 172.21.15.176:0/2335607993 shutdown_connections 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.565+0000 7feb03fb1700 1 --2- 172.21.15.176:0/2335607993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feafc101f90 0x7feafc10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.565+0000 7feb03fb1700 1 --2- 172.21.15.176:0/2335607993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feafc104b50 0x7feafc104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.565+0000 7feb03fb1700 1 --2- 172.21.15.176:0/2335607993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 0x7feafc101a50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.565+0000 7feb03fb1700 1 -- 172.21.15.176:0/2335607993 >> 172.21.15.176:0/2335607993 conn(0x7feafc0fd170 msgr2=0x7feafc0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 -- 172.21.15.176:0/2335607993 shutdown_connections 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 -- 172.21.15.176:0/2335607993 wait complete. 2024-05-12T11:00:47.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 Processor -- start 2024-05-12T11:00:47.559 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 -- start start 2024-05-12T11:00:47.560 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 0x7feafc199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feafc101f90 0x7feafc199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feafc104b50 0x7feafc1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feafc10f010 con 0x7feafc104b50 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feafc10ee90 con 0x7feafc101f90 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.566+0000 7feb03fb1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feafc10f190 con 0x7feafc1015d0 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 0x7feafc199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 0x7feafc199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:33404/0 (socket says 172.21.15.176:33404) 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 -- 172.21.15.176:0/1729248208 learned_addr learned my addr 172.21.15.176:0/1729248208 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb0254e700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feafc104b50 0x7feafc1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb0154c700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feafc101f90 0x7feafc199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 -- 172.21.15.176:0/1729248208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feafc101f90 msgr2=0x7feafc199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feafc101f90 0x7feafc199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:47.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 -- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feafc104b50 msgr2=0x7feafc1a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feafc104b50 0x7feafc1a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 -- 172.21.15.176:0/1729248208 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc1a1290 con 0x7feafc1015d0 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb01d4d700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 0x7feafc199630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feaf000d9b0 tx=0x7feaf000dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feaeeffd700 1 -- 172.21.15.176:0/1729248208 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0017030 con 0x7feafc1015d0 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feaeeffd700 1 -- 172.21.15.176:0/1729248208 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feaf00044d0 con 0x7feafc1015d0 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feafc1a1580 con 0x7feafc1015d0 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feaeeffd700 1 -- 172.21.15.176:0/1729248208 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf00038e0 con 0x7feafc1015d0 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.567+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feafc1a1b10 con 0x7feafc1015d0 2024-05-12T11:00:47.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.568+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feafc06a190 con 0x7feafc1015d0 2024-05-12T11:00:47.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.570+0000 7feaeeffd700 1 -- 172.21.15.176:0/1729248208 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7feaf001a070 con 0x7feafc1015d0 2024-05-12T11:00:47.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.571+0000 7feaeeffd700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7feae80b2870 0x7feae80b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:00:47.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.571+0000 7feaeeffd700 1 -- 172.21.15.176:0/1729248208 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7feaf00e0550 con 0x7feafc1015d0 2024-05-12T11:00:47.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.571+0000 7feb0154c700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7feae80b2870 0x7feae80b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:00:47.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.572+0000 7feb0154c700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7feae80b2870 0x7feae80b4d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feaf80038a0 tx=0x7feaf8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:00:47.566 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.575+0000 7feaeeffd700 1 -- 172.21.15.176:0/1729248208 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feaf00a9b40 con 0x7feafc1015d0 2024-05-12T11:00:47.783 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:00:47.791+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7feafc0638e0 con 0x7feae80b2870 2024-05-12T11:00:48.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:48 smithi086 ceph-mon[30110]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:48.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:00:48.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:00:48.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:48.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:48 smithi172 ceph-mon[34517]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:48.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:00:48.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:00:48.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:48.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:48 smithi176 ceph-mon[34357]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:00:48.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:00:48.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:00:48.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:49.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:49 smithi086 ceph-mon[30110]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:49.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:49 smithi086 ceph-mon[30110]: osdmap e14: 2 total, 2 up, 2 in 2024-05-12T11:00:49.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:49 smithi172 ceph-mon[34517]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:49.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:49 smithi172 ceph-mon[34517]: osdmap e14: 2 total, 2 up, 2 in 2024-05-12T11:00:49.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:49 smithi176 ceph-mon[34357]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:49.482 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:49 smithi176 ceph-mon[34357]: osdmap e14: 2 total, 2 up, 2 in 2024-05-12T11:00:51.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:51 smithi086 ceph-mon[30110]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:51.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:51 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/3088909501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]: dispatch 2024-05-12T11:00:51.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:51 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]: dispatch 2024-05-12T11:00:51.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:51 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]': finished 2024-05-12T11:00:51.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:51 smithi086 ceph-mon[30110]: osdmap e15: 3 total, 2 up, 3 in 2024-05-12T11:00:51.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:51 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:00:51.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:51 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/2702804705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:51.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:51 smithi172 ceph-mon[34517]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:51.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:51 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/3088909501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]: dispatch 2024-05-12T11:00:51.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:51 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]: dispatch 2024-05-12T11:00:51.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:51 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]': finished 2024-05-12T11:00:51.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:51 smithi172 ceph-mon[34517]: osdmap e15: 3 total, 2 up, 3 in 2024-05-12T11:00:51.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:51 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:00:51.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:51 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/2702804705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:51.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:51 smithi176 ceph-mon[34357]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:51.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:51 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/3088909501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]: dispatch 2024-05-12T11:00:51.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:51 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]: dispatch 2024-05-12T11:00:51.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:51 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de1f858a-97d7-471d-8b4b-cc315316c20b"}]': finished 2024-05-12T11:00:51.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:51 smithi176 ceph-mon[34357]: osdmap e15: 3 total, 2 up, 3 in 2024-05-12T11:00:51.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:51 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:00:51.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:51 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/2702804705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:00:53.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:53 smithi086 ceph-mon[30110]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:53.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:53 smithi172 ceph-mon[34517]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:53.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:53 smithi176 ceph-mon[34357]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:55.438 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:55 smithi176 ceph-mon[34357]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:55 smithi086 ceph-mon[30110]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:55 smithi172 ceph-mon[34517]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:57.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:57 smithi086 ceph-mon[30110]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:57.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:57 smithi172 ceph-mon[34517]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:57.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:57 smithi176 ceph-mon[34357]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:58.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-12T11:00:58.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:58.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:58 smithi176 ceph-mon[34357]: Deploying daemon osd.2 on smithi176 2024-05-12T11:00:58.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-12T11:00:58.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:58.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:58 smithi086 ceph-mon[30110]: Deploying daemon osd.2 on smithi176 2024-05-12T11:00:58.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-12T11:00:58.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:00:58.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:58 smithi172 ceph-mon[34517]: Deploying daemon osd.2 on smithi176 2024-05-12T11:00:59.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:00:59 smithi086 ceph-mon[30110]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:59.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:00:59 smithi172 ceph-mon[34517]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:00:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:00:59 smithi176 ceph-mon[34357]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:01.439 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:01 smithi176 ceph-mon[34357]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:01.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:01 smithi086 ceph-mon[30110]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:01.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:01 smithi172 ceph-mon[34517]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:04.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:03 smithi176 ceph-mon[34357]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:04.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:04.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:04.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:04.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:03 smithi086 ceph-mon[30110]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:04.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:04.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:04.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:04.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:03 smithi172 ceph-mon[34517]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:04.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:04.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:04.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:05.910 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:05 smithi176 ceph-mon[34357]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:05.910 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:05.910 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:05.910 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:05.911 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:05.911 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:06.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:05 smithi086 ceph-mon[30110]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:06.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:06.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:06.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:06.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:06.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:05 smithi172 ceph-mon[34517]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:06.647 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 2 on host 'smithi176' 2024-05-12T11:01:06.648 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.655+0000 7feaeeffd700 1 -- 172.21.15.176:0/1729248208 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feafc0638e0 con 0x7feae80b2870 2024-05-12T11:01:06.650 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7feae80b2870 msgr2=0x7feae80b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:06.650 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7feae80b2870 0x7feae80b4d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feaf80038a0 tx=0x7feaf8005fb0 comp rx=0 tx=0).stop 2024-05-12T11:01:06.650 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 msgr2=0x7feafc199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:06.650 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 0x7feafc199630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feaf000d9b0 tx=0x7feaf000dcc0 comp rx=0 tx=0).stop 2024-05-12T11:01:06.650 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 shutdown_connections 2024-05-12T11:01:06.651 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7feae80b2870 0x7feae80b4d30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:06.651 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feafc104b50 0x7feafc1a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:06.651 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feafc1015d0 0x7feafc199630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:06.651 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 --2- 172.21.15.176:0/1729248208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feafc101f90 0x7feafc199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:06.651 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 >> 172.21.15.176:0/1729248208 conn(0x7feafc0fd170 msgr2=0x7feafc107bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:01:06.651 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 shutdown_connections 2024-05-12T11:01:06.651 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:01:06.658+0000 7feb03fb1700 1 -- 172.21.15.176:0/1729248208 wait complete. 2024-05-12T11:01:07.273 DEBUG:teuthology.orchestra.run.smithi176:osd.2> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.2.service 2024-05-12T11:01:07.276 INFO:tasks.cephadm:Deploying osd.3 on smithi086 with /dev/vg_nvme/lv_3... 2024-05-12T11:01:07.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-12T11:01:07.521 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:01:07.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:07 smithi176 ceph-mon[34357]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:07.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:07.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:07.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:07.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:07 smithi176 ceph-mon[34357]: from='osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-12T11:01:07.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:07 smithi176 ceph-mon[34357]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-12T11:01:07.847 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:07 smithi086 ceph-mon[30110]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:07.847 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:07.847 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:07.847 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:07.847 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:07 smithi086 ceph-mon[30110]: from='osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-12T11:01:07.847 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:07 smithi086 ceph-mon[30110]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-12T11:01:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:07 smithi172 ceph-mon[34517]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:07 smithi172 ceph-mon[34517]: from='osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-12T11:01:07.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:07 smithi172 ceph-mon[34517]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-12T11:01:08.874 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:08 smithi086 ceph-mon[30110]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-12T11:01:08.874 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:08 smithi086 ceph-mon[30110]: osdmap e16: 3 total, 2 up, 3 in 2024-05-12T11:01:08.874 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:08 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:08.874 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:08 smithi086 ceph-mon[30110]: from='osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:01:08.874 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:08 smithi086 ceph-mon[30110]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:01:08.875 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:08 smithi176 ceph-mon[34357]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-12T11:01:08.875 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:08 smithi176 ceph-mon[34357]: osdmap e16: 3 total, 2 up, 3 in 2024-05-12T11:01:08.875 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:08 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:08.875 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:08 smithi176 ceph-mon[34357]: from='osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:01:08.875 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:08 smithi176 ceph-mon[34357]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:01:08.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:08 smithi172 ceph-mon[34517]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-12T11:01:08.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:08 smithi172 ceph-mon[34517]: osdmap e16: 3 total, 2 up, 3 in 2024-05-12T11:01:08.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:08 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:08.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:08 smithi172 ceph-mon[34517]: from='osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:01:08.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:08 smithi172 ceph-mon[34517]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:01:09.267 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2[39691]: 2024-05-12T11:01:09.067+0000 7fa75929a700 -1 osd.2 0 waiting for initial osdmap 2024-05-12T11:01:09.267 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2[39691]: 2024-05-12T11:01:09.071+0000 7fa751085700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:01:09.466 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-12T11:01:09.466 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-12T11:01:09.466 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-05-12T11:01:09.466 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-05-12T11:01:09.466 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119075 s, 881 MB/s 2024-05-12T11:01:09.467 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-05-12T11:01:09.803 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:09 smithi086 ceph-mon[30110]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:09.803 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:09 smithi086 ceph-mon[30110]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:01:09.803 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:09 smithi086 ceph-mon[30110]: osdmap e17: 3 total, 2 up, 3 in 2024-05-12T11:01:09.803 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:09.803 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:09.803 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:09 smithi086 ceph-mon[30110]: from='osd.2 ' entity='osd.2' 2024-05-12T11:01:09.869 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:09 smithi176 ceph-mon[34357]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:09.869 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:09 smithi176 ceph-mon[34357]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:01:09.869 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:09 smithi176 ceph-mon[34357]: osdmap e17: 3 total, 2 up, 3 in 2024-05-12T11:01:09.869 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:09.869 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:09.869 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:09 smithi176 ceph-mon[34357]: from='osd.2 ' entity='osd.2' 2024-05-12T11:01:09.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:09 smithi172 ceph-mon[34517]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:09.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:09 smithi172 ceph-mon[34517]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:01:09.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:09 smithi172 ceph-mon[34517]: osdmap e17: 3 total, 2 up, 3 in 2024-05-12T11:01:09.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:09.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:09.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:09 smithi172 ceph-mon[34517]: from='osd.2 ' entity='osd.2' 2024-05-12T11:01:10.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_3 2024-05-12T11:01:10.375 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:01:10.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:01:10.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:01:10.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:10.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] boot 2024-05-12T11:01:10.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: osdmap e18: 3 total, 3 up, 3 in 2024-05-12T11:01:10.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:10.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:10.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:10.816 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:10.816 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:10.816 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:10.816 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:10.816 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:01:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:01:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] boot 2024-05-12T11:01:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: osdmap e18: 3 total, 3 up, 3 in 2024-05-12T11:01:10.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:10.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:10.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:10.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:10.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:10.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:10.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:10.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:01:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:01:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: osd.2 [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] boot 2024-05-12T11:01:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: osdmap e18: 3 total, 3 up, 3 in 2024-05-12T11:01:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:01:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:11.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:11.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:11.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:11.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:11.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:11.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:11.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:11 smithi086 ceph-mon[30110]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:11.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:11 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi176 2024-05-12T11:01:11.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:11 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi176 to 17088M 2024-05-12T11:01:11.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:11 smithi172 ceph-mon[34517]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:11.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:11 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi176 2024-05-12T11:01:11.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:11 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi176 to 17088M 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.020+0000 7fced09df700 1 -- 172.21.15.86:0/3424010866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103610 msgr2=0x7fcecc103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.020+0000 7fced09df700 1 --2- 172.21.15.86:0/3424010866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103610 0x7fcecc103a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcec00099c0 tx=0x7fcec0009cd0 comp rx=0 tx=0).stop 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 -- 172.21.15.86:0/3424010866 shutdown_connections 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 --2- 172.21.15.86:0/3424010866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcecc103fb0 0x7fcecc10a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 --2- 172.21.15.86:0/3424010866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcecc102410 0x7fcecc102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 --2- 172.21.15.86:0/3424010866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103610 0x7fcecc103a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 -- 172.21.15.86:0/3424010866 >> 172.21.15.86:0/3424010866 conn(0x7fcecc0fd9d0 msgr2=0x7fcecc0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 -- 172.21.15.86:0/3424010866 shutdown_connections 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 -- 172.21.15.86:0/3424010866 wait complete. 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 Processor -- start 2024-05-12T11:01:12.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.021+0000 7fced09df700 1 -- start start 2024-05-12T11:01:12.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fced09df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcecc102410 0x7fcecc199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:01:12.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fced09df700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcecc103610 0x7fcecc199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:01:12.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fced09df700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103fb0 0x7fcecc1a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:01:12.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fced09df700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc10df00 con 0x7fcecc103fb0 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fced09df700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc10dd80 con 0x7fcecc102410 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fced09df700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc10e080 con 0x7fcecc103610 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103fb0 0x7fcecc1a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103fb0 0x7fcecc1a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35810/0 (socket says 172.21.15.86:35810) 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fceca59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcecc102410 0x7fcecc199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 -- 172.21.15.86:0/2821766650 learned_addr learned my addr 172.21.15.86:0/2821766650 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcec9d9b700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcecc103610 0x7fcecc199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 -- 172.21.15.86:0/2821766650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcecc103610 msgr2=0x7fcecc199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcecc103610 0x7fcecc199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 -- 172.21.15.86:0/2821766650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcecc102410 msgr2=0x7fcecc199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcecc102410 0x7fcecc199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 -- 172.21.15.86:0/2821766650 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc1a1330 con 0x7fcecc103fb0 2024-05-12T11:01:12.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcecad9d700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103fb0 0x7fcecc1a0c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcec400b9a0 tx=0x7fcec400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:01:12.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcebb7fe700 1 -- 172.21.15.86:0/2821766650 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4019070 con 0x7fcecc103fb0 2024-05-12T11:01:12.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc1a1620 con 0x7fcecc103fb0 2024-05-12T11:01:12.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcebb7fe700 1 -- 172.21.15.86:0/2821766650 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec400cde0 con 0x7fcecc103fb0 2024-05-12T11:01:12.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fcebb7fe700 1 -- 172.21.15.86:0/2821766650 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4007370 con 0x7fcecc103fb0 2024-05-12T11:01:12.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.022+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc1a1b60 con 0x7fcecc103fb0 2024-05-12T11:01:12.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.023+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcecc06a190 con 0x7fcecc103fb0 2024-05-12T11:01:12.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:11 smithi176 ceph-mon[34357]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-12T11:01:12.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:11 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi176 2024-05-12T11:01:12.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:11 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi176 to 17088M 2024-05-12T11:01:12.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.025+0000 7fcebb7fe700 1 -- 172.21.15.86:0/2821766650 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fcec401c070 con 0x7fcecc103fb0 2024-05-12T11:01:12.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.025+0000 7fcebb7fe700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fceb40b27f0 0x7fceb40b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:01:12.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.025+0000 7fceca59c700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fceb40b27f0 0x7fceb40b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:01:12.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.025+0000 7fcebb7fe700 1 -- 172.21.15.86:0/2821766650 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2851+0+0 (secure 0 0 0) 0x7fcec40e0150 con 0x7fcecc103fb0 2024-05-12T11:01:12.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.026+0000 7fceca59c700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fceb40b27f0 0x7fceb40b4cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcecc103470 tx=0x7fcebc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:01:12.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.030+0000 7fcebb7fe700 1 -- 172.21.15.86:0/2821766650 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcec4051df0 con 0x7fcecc103fb0 2024-05-12T11:01:12.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:12.252+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fcecc06c300 con 0x7fceb40b27f0 2024-05-12T11:01:12.881 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:12 smithi086 ceph-mon[30110]: osdmap e19: 3 total, 3 up, 3 in 2024-05-12T11:01:12.881 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:01:12.881 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:01:12.881 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:01:12.881 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:12 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:12.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:12 smithi172 ceph-mon[34517]: osdmap e19: 3 total, 3 up, 3 in 2024-05-12T11:01:12.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:12 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:01:12.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:12 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:01:12.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:12 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:01:12.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:12 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:13.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:12 smithi176 ceph-mon[34357]: osdmap e19: 3 total, 3 up, 3 in 2024-05-12T11:01:13.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:12 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:01:13.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:12 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:01:13.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:12 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:01:13.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:12 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:13.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 ceph-mon[30110]: pgmap v83: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:13.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 ceph-mon[30110]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:01:13.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-12T11:01:13.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 ceph-mon[30110]: osdmap e20: 3 total, 3 up, 3 in 2024-05-12T11:01:13.887 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:01:13.888 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46641]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-12T11:01:13.888 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46641]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:13.888 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46641]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:13.888 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46641]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:13.888 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46644]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-12T11:01:13.888 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46644]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:13.888 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46644]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:13.888 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46644]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:13.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 ceph-mon[34357]: pgmap v83: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:13.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 ceph-mon[34357]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:01:13.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-12T11:01:13.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 ceph-mon[34357]: osdmap e20: 3 total, 3 up, 3 in 2024-05-12T11:01:13.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:01:13.933 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43298]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-12T11:01:13.933 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43298]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:13.933 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43298]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:13.933 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43298]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:13.933 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43301]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-12T11:01:13.933 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43301]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:13.933 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43301]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:13.933 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43301]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:13.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 ceph-mon[34517]: pgmap v83: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:13.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 ceph-mon[34517]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:01:13.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-12T11:01:13.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 ceph-mon[34517]: osdmap e20: 3 total, 3 up, 3 in 2024-05-12T11:01:13.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:01:13.971 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42972]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-12T11:01:13.971 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42972]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:13.971 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42972]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:13.971 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42972]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:13.971 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42975]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-12T11:01:13.971 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42975]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:13.971 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42975]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:13.971 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42975]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:14.206 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46647]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-12T11:01:14.206 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46647]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:14.206 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46647]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:14.206 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46647]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:14.207 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46652]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-12T11:01:14.207 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46652]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:14.207 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46652]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:14.207 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:13 smithi086 sudo[46652]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42978]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-12T11:01:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42978]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42978]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:13 smithi172 sudo[42978]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 sudo[42981]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-12T11:01:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 sudo[42981]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 sudo[42981]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 sudo[42981]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:14.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43304]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-12T11:01:14.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43304]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:14.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43304]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:14.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43304]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:14.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43307]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-12T11:01:14.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43307]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-12T11:01:14.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43307]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-12T11:01:14.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:13 smithi176 sudo[43307]: pam_unix(sudo:session): session closed for user root 2024-05-12T11:01:14.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:14.901+0000 7fcebb7fe700 1 -- 172.21.15.86:0/2821766650 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fcec40a5030 con 0x7fcecc103fb0 2024-05-12T11:01:14.894 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-12T11:01:14.894 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: osdmap e21: 3 total, 3 up, 3 in 2024-05-12T11:01:14.894 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:14.894 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:14.895 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:14.896 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:14 smithi086 ceph-mon[30110]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:14.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: osdmap e21: 3 total, 3 up, 3 in 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:14.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:14.976 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:14.976 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:14.976 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:14.976 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:14 smithi172 ceph-mon[34517]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:15.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: osdmap e21: 3 total, 3 up, 3 in 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:15.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:15.019 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:15.019 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:15.019 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:15.019 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-12T11:01:15.019 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:01:15.019 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:01:15.019 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:01:15.019 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:14 smithi176 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-12T11:01:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:15 smithi086 ceph-mon[30110]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:15 smithi086 ceph-mon[30110]: osdmap e22: 3 total, 3 up, 3 in 2024-05-12T11:01:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:15 smithi086 ceph-mon[30110]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-12T11:01:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:15 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/199989662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6"}]: dispatch 2024-05-12T11:01:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:15 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/199989662' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6"}]': finished 2024-05-12T11:01:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:15 smithi086 ceph-mon[30110]: osdmap e23: 4 total, 3 up, 4 in 2024-05-12T11:01:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:15 smithi172 ceph-mon[34517]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:15 smithi172 ceph-mon[34517]: osdmap e22: 3 total, 3 up, 3 in 2024-05-12T11:01:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:15 smithi172 ceph-mon[34517]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-12T11:01:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:15 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/199989662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6"}]: dispatch 2024-05-12T11:01:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:15 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/199989662' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6"}]': finished 2024-05-12T11:01:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:15 smithi172 ceph-mon[34517]: osdmap e23: 4 total, 3 up, 4 in 2024-05-12T11:01:15.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:15 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:15 smithi176 ceph-mon[34357]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:15 smithi176 ceph-mon[34357]: osdmap e22: 3 total, 3 up, 3 in 2024-05-12T11:01:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:15 smithi176 ceph-mon[34357]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-12T11:01:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:15 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/199989662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6"}]: dispatch 2024-05-12T11:01:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:15 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/199989662' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6"}]': finished 2024-05-12T11:01:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:15 smithi176 ceph-mon[34357]: osdmap e23: 4 total, 3 up, 4 in 2024-05-12T11:01:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:15 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:16.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:16 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/31691656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:01:16.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:16 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/31691656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:01:17.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:16 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/31691656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:01:17.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:17 smithi086 ceph-mon[30110]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:17.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:17 smithi172 ceph-mon[34517]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:17 smithi176 ceph-mon[34357]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:19.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:19 smithi086 ceph-mon[30110]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:19 smithi172 ceph-mon[34517]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:19 smithi176 ceph-mon[34357]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:21.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:21 smithi086 ceph-mon[30110]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:21 smithi172 ceph-mon[34517]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:22.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:21 smithi176 ceph-mon[34357]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:23.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:23 smithi086 ceph-mon[30110]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:23.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:23 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-12T11:01:23.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:23 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:23.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:23 smithi086 ceph-mon[30110]: Deploying daemon osd.3 on smithi086 2024-05-12T11:01:23.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:23 smithi172 ceph-mon[34517]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:23.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:23 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-12T11:01:23.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:23 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:23.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:23 smithi172 ceph-mon[34517]: Deploying daemon osd.3 on smithi086 2024-05-12T11:01:24.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:23 smithi176 ceph-mon[34357]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:24.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:23 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-12T11:01:24.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:23 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:24.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:23 smithi176 ceph-mon[34357]: Deploying daemon osd.3 on smithi086 2024-05-12T11:01:25.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:25 smithi086 ceph-mon[30110]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:25 smithi172 ceph-mon[34517]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:26.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:25 smithi176 ceph-mon[34357]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:27.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:27 smithi086 ceph-mon[30110]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:27.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:27 smithi172 ceph-mon[34517]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:28.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:27 smithi176 ceph-mon[34357]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:29.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:29 smithi086 ceph-mon[30110]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:29.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:29.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:29.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:29 smithi172 ceph-mon[34517]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:29.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:29 smithi176 ceph-mon[34357]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:29.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:29.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:29.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:31.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:31 smithi086 ceph-mon[30110]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:31.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:31.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:31.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:31.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:31.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:31 smithi172 ceph-mon[34517]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:31.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:31 smithi176 ceph-mon[34357]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:31.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:31.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:31.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:31.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:31.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:32.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.118+0000 7fcebb7fe700 1 -- 172.21.15.86:0/2821766650 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcecc06c300 con 0x7fceb40b27f0 2024-05-12T11:01:32.110 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 3 on host 'smithi086' 2024-05-12T11:01:32.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fceb40b27f0 msgr2=0x7fceb40b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:32.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fceb40b27f0 0x7fceb40b4cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcecc103470 tx=0x7fcebc00a380 comp rx=0 tx=0).stop 2024-05-12T11:01:32.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103fb0 msgr2=0x7fcecc1a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:32.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103fb0 0x7fcecc1a0c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcec400b9a0 tx=0x7fcec400bcb0 comp rx=0 tx=0).stop 2024-05-12T11:01:32.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 shutdown_connections 2024-05-12T11:01:32.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fceb40b27f0 0x7fceb40b4cb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:32.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcecc103fb0 0x7fcecc1a0c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:32.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcecc102410 0x7fcecc199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:32.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 --2- 172.21.15.86:0/2821766650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcecc103610 0x7fcecc199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:32.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 >> 172.21.15.86:0/2821766650 conn(0x7fcecc0fd9d0 msgr2=0x7fcecc06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:01:32.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 shutdown_connections 2024-05-12T11:01:32.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:01:32.121+0000 7fced09df700 1 -- 172.21.15.86:0/2821766650 wait complete. 2024-05-12T11:01:32.807 DEBUG:teuthology.orchestra.run.smithi086:osd.3> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.3.service 2024-05-12T11:01:32.809 INFO:tasks.cephadm:Deploying osd.4 on smithi172 with /dev/vg_nvme/lv_3... 2024-05-12T11:01:32.809 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-12T11:01:33.054 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:01:33.379 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:33 smithi172 ceph-mon[34517]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:33.380 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:33 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:33.380 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:33 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:33.380 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:33 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:33.380 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:33 smithi172 ceph-mon[34517]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-12T11:01:33.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:33 smithi086 ceph-mon[30110]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:33.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:33 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:33.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:33 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:33.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:33 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:33.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:33 smithi086 ceph-mon[30110]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-12T11:01:33.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:33 smithi176 ceph-mon[34357]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:33.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:33 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:33.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:33 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:33.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:33 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:33.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:33 smithi176 ceph-mon[34357]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-12T11:01:34.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:34 smithi172 ceph-mon[34517]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-12T11:01:34.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:34 smithi172 ceph-mon[34517]: osdmap e24: 4 total, 3 up, 4 in 2024-05-12T11:01:34.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:34 smithi172 ceph-mon[34517]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:01:34.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:34.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:34 smithi086 ceph-mon[30110]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-12T11:01:34.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:34 smithi086 ceph-mon[30110]: osdmap e24: 4 total, 3 up, 4 in 2024-05-12T11:01:34.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:34 smithi086 ceph-mon[30110]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:01:34.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:34.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:34 smithi176 ceph-mon[34357]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-12T11:01:34.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:34 smithi176 ceph-mon[34357]: osdmap e24: 4 total, 3 up, 4 in 2024-05-12T11:01:34.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:34 smithi176 ceph-mon[34357]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:01:34.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:34.921 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:01:34 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:01:34.585+0000 7f7ce6230700 -1 osd.3 0 waiting for initial osdmap 2024-05-12T11:01:34.921 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:01:34 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:01:34.590+0000 7f7cde01b700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:01:35.190 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-12T11:01:35.190 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-12T11:01:35.190 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-12T11:01:35.190 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-12T11:01:35.191 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127694 s, 821 MB/s 2024-05-12T11:01:35.191 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-12T11:01:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:01:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: osdmap e25: 4 total, 3 up, 4 in 2024-05-12T11:01:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' 2024-05-12T11:01:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] boot 2024-05-12T11:01:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: osdmap e26: 4 total, 4 up, 4 in 2024-05-12T11:01:35.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:35 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: osdmap e25: 4 total, 3 up, 4 in 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] boot 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: osdmap e26: 4 total, 4 up, 4 in 2024-05-12T11:01:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:35 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-12T11:01:35.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:01:35.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: osdmap e25: 4 total, 3 up, 4 in 2024-05-12T11:01:35.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: from='osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147]' entity='osd.3' 2024-05-12T11:01:35.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: osd.3 [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] boot 2024-05-12T11:01:35.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: osdmap e26: 4 total, 4 up, 4 in 2024-05-12T11:01:35.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:35 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:01:35.862 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-05-12T11:01:36.098 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:01:36.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:01:36.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:01:36.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: osdmap e27: 4 total, 4 up, 4 in 2024-05-12T11:01:36.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:36.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:36.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:36.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:36.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:01:36.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:01:36.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: osdmap e27: 4 total, 4 up, 4 in 2024-05-12T11:01:36.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:36.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:36.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:36.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:36.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: osdmap e27: 4 total, 4 up, 4 in 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 -- 172.21.15.172:0/2192127606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 msgr2=0x7efd48103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 --2- 172.21.15.172:0/2192127606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 0x7efd48103950 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efd380099c0 tx=0x7efd38009cd0 comp rx=0 tx=0).stop 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 -- 172.21.15.172:0/2192127606 shutdown_connections 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 --2- 172.21.15.172:0/2192127606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd481050d0 0x7efd4810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 --2- 172.21.15.172:0/2192127606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 0x7efd48103950 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 --2- 172.21.15.172:0/2192127606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd48104730 0x7efd48104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 -- 172.21.15.172:0/2192127606 >> 172.21.15.172:0/2192127606 conn(0x7efd480feaf0 msgr2=0x7efd48100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 -- 172.21.15.172:0/2192127606 shutdown_connections 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.732+0000 7efd4e3db700 1 -- 172.21.15.172:0/2192127606 wait complete. 2024-05-12T11:01:37.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4e3db700 1 Processor -- start 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4e3db700 1 -- start start 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4e3db700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 0x7efd481996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4e3db700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48104730 0x7efd48199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4e3db700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd481050d0 0x7efd481a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4e3db700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efd4810f000 con 0x7efd48104730 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4e3db700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd4810ee80 con 0x7efd48103530 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4e3db700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efd4810f180 con 0x7efd481050d0 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd47fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 0x7efd481996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd47fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 0x7efd481996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50554/0 (socket says 172.21.15.172:50554) 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd47fff700 1 -- 172.21.15.172:0/3958096990 learned_addr learned my addr 172.21.15.172:0/3958096990 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd477fe700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48104730 0x7efd48199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.733+0000 7efd4c978700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd481050d0 0x7efd481a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd47fff700 1 -- 172.21.15.172:0/3958096990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd481050d0 msgr2=0x7efd481a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:37.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd47fff700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd481050d0 0x7efd481a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd47fff700 1 -- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48104730 msgr2=0x7efd48199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd47fff700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48104730 0x7efd48199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd47fff700 1 -- 172.21.15.172:0/3958096990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd481a1300 con 0x7efd48103530 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd47fff700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 0x7efd481996f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efd38006010 tx=0x7efd380047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd457fa700 1 -- 172.21.15.172:0/3958096990 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38027070 con 0x7efd48103530 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd481a1590 con 0x7efd48103530 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd457fa700 1 -- 172.21.15.172:0/3958096990 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd380040e0 con 0x7efd48103530 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd457fa700 1 -- 172.21.15.172:0/3958096990 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3800f460 con 0x7efd48103530 2024-05-12T11:01:37.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.734+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd481a19e0 con 0x7efd48103530 2024-05-12T11:01:37.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.735+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd4806a190 con 0x7efd48103530 2024-05-12T11:01:37.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.736+0000 7efd457fa700 1 -- 172.21.15.172:0/3958096990 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7efd3802a070 con 0x7efd48103530 2024-05-12T11:01:37.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.737+0000 7efd457fa700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd300b2880 0x7efd300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:01:37.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.737+0000 7efd477fe700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd300b2880 0x7efd300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:01:37.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.737+0000 7efd457fa700 1 -- 172.21.15.172:0/3958096990 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7efd380e2570 con 0x7efd48103530 2024-05-12T11:01:37.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.738+0000 7efd477fe700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd300b2880 0x7efd300b4d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005950 tx=0x7efd3c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:01:37.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.741+0000 7efd457fa700 1 -- 172.21.15.172:0/3958096990 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efd38031070 con 0x7efd48103530 2024-05-12T11:01:37.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:37.959+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7efd480638e0 con 0x7efd300b2880 2024-05-12T11:01:37.951 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:37 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi086 2024-05-12T11:01:37.951 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:37 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi086 to 8544M 2024-05-12T11:01:37.951 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:37 smithi172 ceph-mon[34517]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:37.951 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:37 smithi172 ceph-mon[34517]: osdmap e28: 4 total, 4 up, 4 in 2024-05-12T11:01:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:37 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi086 2024-05-12T11:01:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:37 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi086 to 8544M 2024-05-12T11:01:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:37 smithi086 ceph-mon[30110]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:37 smithi086 ceph-mon[30110]: osdmap e28: 4 total, 4 up, 4 in 2024-05-12T11:01:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:37 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi086 2024-05-12T11:01:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:37 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi086 to 8544M 2024-05-12T11:01:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:37 smithi176 ceph-mon[34357]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:37 smithi176 ceph-mon[34357]: osdmap e28: 4 total, 4 up, 4 in 2024-05-12T11:01:38.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:38 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:01:38.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:38 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:01:38.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:38 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:38.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:01:38.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:01:38.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:39.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:38 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:01:39.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:38 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:01:39.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:38 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:39.841 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:39 smithi172 ceph-mon[34517]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:01:39.841 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:39 smithi172 ceph-mon[34517]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-12T11:01:39.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:39 smithi086 ceph-mon[30110]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:01:39.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:39 smithi086 ceph-mon[30110]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-12T11:01:40.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:39 smithi176 ceph-mon[34357]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:01:40.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:39 smithi176 ceph-mon[34357]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-12T11:01:41.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:41 smithi086 ceph-mon[30110]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-12T11:01:41.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:41 smithi086 ceph-mon[30110]: from='client.? 172.21.15.172:0/4050655960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]: dispatch 2024-05-12T11:01:41.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:41 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]: dispatch 2024-05-12T11:01:41.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:41 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]': finished 2024-05-12T11:01:41.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:41 smithi086 ceph-mon[30110]: osdmap e29: 5 total, 4 up, 5 in 2024-05-12T11:01:41.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:41 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:01:41.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:41 smithi086 ceph-mon[30110]: from='client.? 172.21.15.172:0/687672070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:01:41.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:41 smithi172 ceph-mon[34517]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-12T11:01:41.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:41 smithi172 ceph-mon[34517]: from='client.? 172.21.15.172:0/4050655960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]: dispatch 2024-05-12T11:01:41.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:41 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]: dispatch 2024-05-12T11:01:41.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:41 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]': finished 2024-05-12T11:01:41.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:41 smithi172 ceph-mon[34517]: osdmap e29: 5 total, 4 up, 5 in 2024-05-12T11:01:41.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:41 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:01:41.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:41 smithi172 ceph-mon[34517]: from='client.? 172.21.15.172:0/687672070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:01:42.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:41 smithi176 ceph-mon[34357]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-12T11:01:42.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:41 smithi176 ceph-mon[34357]: from='client.? 172.21.15.172:0/4050655960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]: dispatch 2024-05-12T11:01:42.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:41 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]: dispatch 2024-05-12T11:01:42.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:41 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d396904-c535-4618-afc4-706ddd9c478b"}]': finished 2024-05-12T11:01:42.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:41 smithi176 ceph-mon[34357]: osdmap e29: 5 total, 4 up, 5 in 2024-05-12T11:01:42.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:41 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:01:42.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:41 smithi176 ceph-mon[34357]: from='client.? 172.21.15.172:0/687672070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:01:43.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:43 smithi086 ceph-mon[30110]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-12T11:01:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:43 smithi172 ceph-mon[34517]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-12T11:01:44.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:43 smithi176 ceph-mon[34357]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-12T11:01:45.877 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:45 smithi172 ceph-mon[34517]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-12T11:01:45.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:45 smithi086 ceph-mon[30110]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-12T11:01:46.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:45 smithi176 ceph-mon[34357]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-12T11:01:47.932 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:47 smithi086 ceph-mon[30110]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-12T11:01:47.962 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:47 smithi172 ceph-mon[34517]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-12T11:01:48.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:47 smithi176 ceph-mon[34357]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-12T11:01:48.908 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-12T11:01:48.908 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:48.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-12T11:01:48.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:49.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-12T11:01:49.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:49.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:49 smithi172 ceph-mon[34517]: Deploying daemon osd.4 on smithi172 2024-05-12T11:01:49.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:49 smithi172 ceph-mon[34517]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:49.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:49 smithi086 ceph-mon[30110]: Deploying daemon osd.4 on smithi172 2024-05-12T11:01:49.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:49 smithi086 ceph-mon[30110]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:50.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:49 smithi176 ceph-mon[34357]: Deploying daemon osd.4 on smithi172 2024-05-12T11:01:50.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:49 smithi176 ceph-mon[34357]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:51.872 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:51 smithi172 ceph-mon[34517]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:51.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:51 smithi086 ceph-mon[30110]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:52.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:51 smithi176 ceph-mon[34357]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:53.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:53 smithi172 ceph-mon[34517]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:53.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:53.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:53.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:53 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:53 smithi086 ceph-mon[30110]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:53.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:53.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:53 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:54.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:53 smithi176 ceph-mon[34357]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:54.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:54.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:54.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:53 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:55.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:55 smithi172 ceph-mon[34517]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:55.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:55 smithi086 ceph-mon[30110]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:56.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:55 smithi176 ceph-mon[34357]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:57.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.425+0000 7efd457fa700 1 -- 172.21.15.172:0/3958096990 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efd480638e0 con 0x7efd300b2880 2024-05-12T11:01:57.417 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 4 on host 'smithi172' 2024-05-12T11:01:57.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd300b2880 msgr2=0x7efd300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:57.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd300b2880 0x7efd300b4d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005950 tx=0x7efd3c00b410 comp rx=0 tx=0).stop 2024-05-12T11:01:57.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 msgr2=0x7efd481996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:01:57.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 0x7efd481996f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efd38006010 tx=0x7efd380047b0 comp rx=0 tx=0).stop 2024-05-12T11:01:57.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 shutdown_connections 2024-05-12T11:01:57.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd300b2880 0x7efd300b4d40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:57.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd481050d0 0x7efd481a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:57.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103530 0x7efd481996f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:57.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 --2- 172.21.15.172:0/3958096990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48104730 0x7efd48199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:01:57.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 >> 172.21.15.172:0/3958096990 conn(0x7efd480feaf0 msgr2=0x7efd48107b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:01:57.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.429+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 shutdown_connections 2024-05-12T11:01:57.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:01:57.430+0000 7efd4e3db700 1 -- 172.21.15.172:0/3958096990 wait complete. 2024-05-12T11:01:57.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:57.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:57.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:57.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-12T11:01:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:57 smithi172 ceph-mon[34517]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:57.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-12T11:01:57.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:57 smithi086 ceph-mon[30110]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-12T11:01:58.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:57 smithi176 ceph-mon[34357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-12T11:01:58.019 DEBUG:teuthology.orchestra.run.smithi172:osd.4> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.4.service 2024-05-12T11:01:58.021 INFO:tasks.cephadm:Deploying osd.5 on smithi176 with /dev/vg_nvme/lv_3... 2024-05-12T11:01:58.021 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-12T11:01:58.266 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:01:59.455 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:59 smithi172 ceph-mon[34517]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:59.455 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:59 smithi172 ceph-mon[34517]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-12T11:01:59.456 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:59 smithi172 ceph-mon[34517]: from='osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:01:59.456 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:59 smithi172 ceph-mon[34517]: osdmap e30: 5 total, 4 up, 5 in 2024-05-12T11:01:59.456 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:59 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:01:59.456 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:01:59 smithi172 ceph-mon[34517]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:01:59.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:59 smithi086 ceph-mon[30110]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:59.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:59 smithi086 ceph-mon[30110]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-12T11:01:59.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:59 smithi086 ceph-mon[30110]: from='osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:01:59.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:59 smithi086 ceph-mon[30110]: osdmap e30: 5 total, 4 up, 5 in 2024-05-12T11:01:59.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:59 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:01:59.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:01:59 smithi086 ceph-mon[30110]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:01:59.719 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:59 smithi176 ceph-mon[34357]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:01:59.719 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:59 smithi176 ceph-mon[34357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-12T11:01:59.719 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:59 smithi176 ceph-mon[34357]: from='osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:01:59.719 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:59 smithi176 ceph-mon[34357]: osdmap e30: 5 total, 4 up, 5 in 2024-05-12T11:01:59.719 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:59 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:01:59.719 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:01:59 smithi176 ceph-mon[34357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:02:00.224 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:01:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4[45768]: 2024-05-12T11:01:59.820+0000 7f05eedc8700 -1 osd.4 0 waiting for initial osdmap 2024-05-12T11:02:00.224 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:01:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4[45768]: 2024-05-12T11:01:59.827+0000 7f05e6bb3700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:02:00.321 INFO:teuthology.orchestra.run.smithi176.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-12T11:02:00.321 INFO:teuthology.orchestra.run.smithi176.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-12T11:02:00.322 INFO:teuthology.orchestra.run.smithi176.stderr: stderr: 10+0 records in 2024-05-12T11:02:00.322 INFO:teuthology.orchestra.run.smithi176.stderr:10+0 records out 2024-05-12T11:02:00.322 INFO:teuthology.orchestra.run.smithi176.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115144 s, 911 MB/s 2024-05-12T11:02:00.322 INFO:teuthology.orchestra.run.smithi176.stderr:--> Zapping successful for: 2024-05-12T11:02:00.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:00 smithi176 ceph-mon[34357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:02:00.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:00 smithi176 ceph-mon[34357]: osdmap e31: 5 total, 4 up, 5 in 2024-05-12T11:02:00.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:00.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:00.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:00 smithi176 ceph-mon[34357]: from='osd.4 ' entity='osd.4' 2024-05-12T11:02:00.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:00 smithi172 ceph-mon[34517]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:02:00.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:00 smithi172 ceph-mon[34517]: osdmap e31: 5 total, 4 up, 5 in 2024-05-12T11:02:00.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:00.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:00.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:00 smithi172 ceph-mon[34517]: from='osd.4 ' entity='osd.4' 2024-05-12T11:02:00.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:00 smithi086 ceph-mon[30110]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:02:00.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:00 smithi086 ceph-mon[30110]: osdmap e31: 5 total, 4 up, 5 in 2024-05-12T11:02:00.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:00.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:00.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:00 smithi086 ceph-mon[30110]: from='osd.4 ' entity='osd.4' 2024-05-12T11:02:00.940 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi176:vg_nvme/lv_3 2024-05-12T11:02:01.192 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:02:01.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:02:01.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:02:01.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:02:01.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] boot 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: osdmap e32: 5 total, 5 up, 5 in 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:01.591 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:02:01.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:02:01.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:02:01.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:01.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] boot 2024-05-12T11:02:01.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: osdmap e32: 5 total, 5 up, 5 in 2024-05-12T11:02:01.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:02:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:02:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-12T11:02:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: osd.4 [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] boot 2024-05-12T11:02:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: osdmap e32: 5 total, 5 up, 5 in 2024-05-12T11:02:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:02:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:01.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:01.726 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:02.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:02 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi172 2024-05-12T11:02:02.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:02 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-12T11:02:02.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:02 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi172 2024-05-12T11:02:02.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:02 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-12T11:02:02.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:02 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi172 2024-05-12T11:02:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:02 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-12T11:02:02.828 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 -- 172.21.15.176:0/4281150225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c102400 msgr2=0x7fb30c102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:02.828 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4281150225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c102400 0x7fb30c102820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009990 tx=0x7fb2fc009ca0 comp rx=0 tx=0).stop 2024-05-12T11:02:02.828 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 -- 172.21.15.176:0/4281150225 shutdown_connections 2024-05-12T11:02:02.828 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4281150225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb30c103fa0 0x7fb30c10a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:02.828 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4281150225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c102400 0x7fb30c102820 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:02.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4281150225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30c103600 0x7fb30c103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:02.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 -- 172.21.15.176:0/4281150225 >> 172.21.15.176:0/4281150225 conn(0x7fb30c0fd9a0 msgr2=0x7fb30c0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:02:02.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 -- 172.21.15.176:0/4281150225 shutdown_connections 2024-05-12T11:02:02.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.836+0000 7fb3134e5700 1 -- 172.21.15.176:0/4281150225 wait complete. 2024-05-12T11:02:02.831 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb3134e5700 1 Processor -- start 2024-05-12T11:02:02.831 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb3134e5700 1 -- start start 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb3134e5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30c102400 0x7fb30c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb3134e5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb30c103600 0x7fb30c1a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb3134e5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c103fa0 0x7fb30c1a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb3134e5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c10ded0 con 0x7fb30c103600 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb3134e5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c10dd50 con 0x7fb30c102400 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb3134e5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c10e050 con 0x7fb30c103fa0 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb311a82700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c103fa0 0x7fb30c1a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb311a82700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c103fa0 0x7fb30c1a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:60576/0 (socket says 172.21.15.176:60576) 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb311a82700 1 -- 172.21.15.176:0/4137191315 learned_addr learned my addr 172.21.15.176:0/4137191315 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb311281700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30c102400 0x7fb30c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.837+0000 7fb310a80700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb30c103600 0x7fb30c1a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:02.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb311a82700 1 -- 172.21.15.176:0/4137191315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30c102400 msgr2=0x7fb30c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb311a82700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30c102400 0x7fb30c06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb311a82700 1 -- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb30c103600 msgr2=0x7fb30c1a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb311a82700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb30c103600 0x7fb30c1a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb311a82700 1 -- 172.21.15.176:0/4137191315 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c1a34f0 con 0x7fb30c103fa0 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb310a80700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb30c103600 0x7fb30c1a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb311281700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30c102400 0x7fb30c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb311a82700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c103fa0 0x7fb30c1a2da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb304007d70 tx=0x7fb30400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb3027fc700 1 -- 172.21.15.176:0/4137191315 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb304016020 con 0x7fb30c103fa0 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb3027fc700 1 -- 172.21.15.176:0/4137191315 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb30400ad40 con 0x7fb30c103fa0 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb3027fc700 1 -- 172.21.15.176:0/4137191315 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3040115e0 con 0x7fb30c103fa0 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c1a37e0 con 0x7fb30c103fa0 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.838+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c1a3d20 con 0x7fb30c103fa0 2024-05-12T11:02:02.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.839+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c06a190 con 0x7fb30c103fa0 2024-05-12T11:02:02.834 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.840+0000 7fb3027fc700 1 -- 172.21.15.176:0/4137191315 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb304019020 con 0x7fb30c103fa0 2024-05-12T11:02:02.835 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.841+0000 7fb3027fc700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb2f80b2900 0x7fb2f80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:02.835 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.841+0000 7fb3027fc700 1 -- 172.21.15.176:0/4137191315 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7fb3040e1530 con 0x7fb30c103fa0 2024-05-12T11:02:02.835 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.841+0000 7fb311281700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb2f80b2900 0x7fb2f80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:02.835 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.842+0000 7fb311281700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb2f80b2900 0x7fb2f80b4dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00b5c0 tx=0x7fb2fc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:02:02.836 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:02.845+0000 7fb3027fc700 1 -- 172.21.15.176:0/4137191315 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb304020020 con 0x7fb30c103fa0 2024-05-12T11:02:03.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:03.055+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb30c0638e0 con 0x7fb2f80b2900 2024-05-12T11:02:03.659 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:03 smithi176 ceph-mon[34357]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:03.659 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:03 smithi176 ceph-mon[34357]: osdmap e33: 5 total, 5 up, 5 in 2024-05-12T11:02:03.659 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:03.659 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:03.659 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:03.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:03 smithi086 ceph-mon[30110]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:03.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:03 smithi086 ceph-mon[30110]: osdmap e33: 5 total, 5 up, 5 in 2024-05-12T11:02:03.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:03.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:03.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:03.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:03 smithi172 ceph-mon[34517]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:03.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:03 smithi172 ceph-mon[34517]: osdmap e33: 5 total, 5 up, 5 in 2024-05-12T11:02:03.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:03.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:03.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:04.693 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:04 smithi176 ceph-mon[34357]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:04.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:04 smithi086 ceph-mon[30110]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:04.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:04 smithi172 ceph-mon[34517]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:05.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:05 smithi086 ceph-mon[30110]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:05.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:05 smithi172 ceph-mon[34517]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:05.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:05 smithi176 ceph-mon[34357]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:06.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:06 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/4141474037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]: dispatch 2024-05-12T11:02:06.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:06 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]: dispatch 2024-05-12T11:02:06.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:06 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]': finished 2024-05-12T11:02:06.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:06 smithi086 ceph-mon[30110]: osdmap e34: 6 total, 5 up, 6 in 2024-05-12T11:02:06.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:06 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:06.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:06 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/269311639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:06.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:06 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/4141474037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]: dispatch 2024-05-12T11:02:06.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:06 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]: dispatch 2024-05-12T11:02:06.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:06 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]': finished 2024-05-12T11:02:06.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:06 smithi172 ceph-mon[34517]: osdmap e34: 6 total, 5 up, 6 in 2024-05-12T11:02:06.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:06 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:06.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:06 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/269311639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:06.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:06 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/4141474037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]: dispatch 2024-05-12T11:02:06.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:06 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]: dispatch 2024-05-12T11:02:06.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:06 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41cdc75e-1b3c-4555-8135-71c5fc91a504"}]': finished 2024-05-12T11:02:06.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:06 smithi176 ceph-mon[34357]: osdmap e34: 6 total, 5 up, 6 in 2024-05-12T11:02:06.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:06 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:06.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:06 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/269311639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:08.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:07 smithi176 ceph-mon[34357]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:08.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:07 smithi086 ceph-mon[30110]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:08.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:07 smithi172 ceph-mon[34517]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:10.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:09 smithi176 ceph-mon[34357]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:09 smithi086 ceph-mon[30110]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:09 smithi172 ceph-mon[34517]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:11.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:11 smithi176 ceph-mon[34357]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:12.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:11 smithi086 ceph-mon[30110]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:12.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:11 smithi172 ceph-mon[34517]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:13.928 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:13 smithi176 ceph-mon[34357]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:13.928 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-12T11:02:13.928 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:13 smithi086 ceph-mon[30110]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-12T11:02:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:14.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:13 smithi172 ceph-mon[34517]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-12T11:02:14.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:14.998 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:14 smithi176 ceph-mon[34357]: Deploying daemon osd.5 on smithi176 2024-05-12T11:02:15.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:14 smithi086 ceph-mon[30110]: Deploying daemon osd.5 on smithi176 2024-05-12T11:02:15.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:14 smithi172 ceph-mon[34517]: Deploying daemon osd.5 on smithi176 2024-05-12T11:02:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:15 smithi176 ceph-mon[34357]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:16.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:15 smithi086 ceph-mon[30110]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:16.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:15 smithi172 ceph-mon[34517]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:17 smithi176 ceph-mon[34357]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:18.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:17 smithi086 ceph-mon[30110]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:18.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:17 smithi172 ceph-mon[34517]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:19.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:19 smithi086 ceph-mon[30110]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:19.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:19.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:19.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:19.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:19 smithi172 ceph-mon[34517]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:19.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:19 smithi176 ceph-mon[34357]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:20.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:21.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:21 smithi086 ceph-mon[30110]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:21.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:21.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:21.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:21.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:21.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:21.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:21 smithi172 ceph-mon[34517]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:21.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:21 smithi176 ceph-mon[34357]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:21.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:21.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:21.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:21.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:21.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:22.364 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.371+0000 7fb3027fc700 1 -- 172.21.15.176:0/4137191315 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb30c0638e0 con 0x7fb2f80b2900 2024-05-12T11:02:22.364 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 5 on host 'smithi176' 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb2f80b2900 msgr2=0x7fb2f80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb2f80b2900 0x7fb2f80b4dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00b5c0 tx=0x7fb2fc005fb0 comp rx=0 tx=0).stop 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c103fa0 msgr2=0x7fb30c1a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c103fa0 0x7fb30c1a2da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb304007d70 tx=0x7fb30400a340 comp rx=0 tx=0).stop 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 shutdown_connections 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb2f80b2900 0x7fb2f80b4dc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb30c103fa0 0x7fb30c1a2da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30c102400 0x7fb30c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 --2- 172.21.15.176:0/4137191315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb30c103600 0x7fb30c1a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:22.366 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 >> 172.21.15.176:0/4137191315 conn(0x7fb30c0fd9a0 msgr2=0x7fb30c106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:02:22.367 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 shutdown_connections 2024-05-12T11:02:22.367 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:02:22.374+0000 7fb3134e5700 1 -- 172.21.15.176:0/4137191315 wait complete. 2024-05-12T11:02:22.989 DEBUG:teuthology.orchestra.run.smithi176:osd.5> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.5.service 2024-05-12T11:02:22.991 INFO:tasks.cephadm:Deploying osd.6 on smithi086 with /dev/vg_nvme/lv_2... 2024-05-12T11:02:22.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-12T11:02:23.242 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:02:23.569 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:23 smithi086 ceph-mon[30110]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:23.569 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:23 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:23.569 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:23 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:23.569 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:23 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:23.569 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:23 smithi086 ceph-mon[30110]: from='osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-12T11:02:23.569 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:23 smithi086 ceph-mon[30110]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-12T11:02:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:23 smithi172 ceph-mon[34517]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:23 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:23 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:23 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:23 smithi172 ceph-mon[34517]: from='osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-12T11:02:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:23 smithi172 ceph-mon[34517]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-12T11:02:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:23 smithi176 ceph-mon[34357]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:23 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:23 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:23 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:23 smithi176 ceph-mon[34357]: from='osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-12T11:02:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:23 smithi176 ceph-mon[34357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-12T11:02:24.513 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:24 smithi176 ceph-mon[34357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-12T11:02:24.513 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:24 smithi176 ceph-mon[34357]: osdmap e35: 6 total, 5 up, 6 in 2024-05-12T11:02:24.513 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:24 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:24.513 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:24 smithi176 ceph-mon[34357]: from='osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:02:24.514 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:24 smithi176 ceph-mon[34357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:02:24.600 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:24 smithi086 ceph-mon[30110]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-12T11:02:24.601 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:24 smithi086 ceph-mon[30110]: osdmap e35: 6 total, 5 up, 6 in 2024-05-12T11:02:24.601 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:24 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:24.601 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:24 smithi086 ceph-mon[30110]: from='osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:02:24.601 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:24 smithi086 ceph-mon[30110]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:02:24.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:24 smithi172 ceph-mon[34517]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-12T11:02:24.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:24 smithi172 ceph-mon[34517]: osdmap e35: 6 total, 5 up, 6 in 2024-05-12T11:02:24.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:24 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:24.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:24 smithi172 ceph-mon[34517]: from='osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:02:24.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:24 smithi172 ceph-mon[34517]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:02:25.267 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:02:24 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:02:24.790+0000 7f53c63aa700 -1 osd.5 0 waiting for initial osdmap 2024-05-12T11:02:25.267 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:02:24 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:02:24.796+0000 7f53be195700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:02:25.323 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-12T11:02:25.323 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-12T11:02:25.324 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-05-12T11:02:25.324 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-05-12T11:02:25.324 INFO:teuthology.orchestra.run.smithi086.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131611 s, 797 MB/s 2024-05-12T11:02:25.324 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-05-12T11:02:25.537 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:25 smithi176 ceph-mon[34357]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:25.537 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:25 smithi176 ceph-mon[34357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:02:25.538 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:25 smithi176 ceph-mon[34357]: osdmap e36: 6 total, 5 up, 6 in 2024-05-12T11:02:25.538 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.538 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.538 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:25 smithi176 ceph-mon[34357]: osdmap e37: 6 total, 5 up, 6 in 2024-05-12T11:02:25.538 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.538 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:25 smithi176 ceph-mon[34357]: from='osd.5 ' entity='osd.5' 2024-05-12T11:02:25.625 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:25 smithi172 ceph-mon[34517]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:25.625 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:25 smithi172 ceph-mon[34517]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:02:25.625 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:25 smithi172 ceph-mon[34517]: osdmap e36: 6 total, 5 up, 6 in 2024-05-12T11:02:25.625 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.625 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.625 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:25 smithi172 ceph-mon[34517]: osdmap e37: 6 total, 5 up, 6 in 2024-05-12T11:02:25.626 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.626 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:25 smithi172 ceph-mon[34517]: from='osd.5 ' entity='osd.5' 2024-05-12T11:02:25.654 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:25 smithi086 ceph-mon[30110]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:25.654 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:25 smithi086 ceph-mon[30110]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:02:25.655 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:25 smithi086 ceph-mon[30110]: osdmap e36: 6 total, 5 up, 6 in 2024-05-12T11:02:25.655 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.655 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.655 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:25 smithi086 ceph-mon[30110]: osdmap e37: 6 total, 5 up, 6 in 2024-05-12T11:02:25.655 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:25.655 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:25 smithi086 ceph-mon[30110]: from='osd.5 ' entity='osd.5' 2024-05-12T11:02:25.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_2 2024-05-12T11:02:26.236 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:02:26.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:02:26.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:02:26.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:26.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] boot 2024-05-12T11:02:26.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: osdmap e38: 6 total, 6 up, 6 in 2024-05-12T11:02:26.583 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:26.584 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.584 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.584 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:26.584 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:26.584 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.584 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:26.584 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:26.584 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] boot 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: osdmap e38: 6 total, 6 up, 6 in 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:26.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:26.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:26.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:02:26.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:02:26.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:26.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: osd.5 [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] boot 2024-05-12T11:02:26.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: osdmap e38: 6 total, 6 up, 6 in 2024-05-12T11:02:26.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:02:26.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:26.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:26.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:26.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:26.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:26.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.904+0000 7fc94d74a700 1 -- 172.21.15.86:0/1595109807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9481091f0 msgr2=0x7fc94810b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.904+0000 7fc94d74a700 1 --2- 172.21.15.86:0/1595109807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9481091f0 0x7fc94810b660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc94000b0a0 tx=0x7fc94000b3b0 comp rx=0 tx=0).stop 2024-05-12T11:02:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.904+0000 7fc94d74a700 1 -- 172.21.15.86:0/1595109807 shutdown_connections 2024-05-12T11:02:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.904+0000 7fc94d74a700 1 --2- 172.21.15.86:0/1595109807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9481091f0 0x7fc94810b660 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.904+0000 7fc94d74a700 1 --2- 172.21.15.86:0/1595109807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc948103f90 0x7fc948106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.904+0000 7fc94d74a700 1 --2- 172.21.15.86:0/1595109807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9481068c0 0x7fc948108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.904+0000 7fc94d74a700 1 -- 172.21.15.86:0/1595109807 >> 172.21.15.86:0/1595109807 conn(0x7fc9480fd9c0 msgr2=0x7fc9480ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:02:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.905+0000 7fc94d74a700 1 -- 172.21.15.86:0/1595109807 shutdown_connections 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.905+0000 7fc94d74a700 1 -- 172.21.15.86:0/1595109807 wait complete. 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.905+0000 7fc94d74a700 1 Processor -- start 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.905+0000 7fc94d74a700 1 -- start start 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.905+0000 7fc94d74a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc948103f90 0x7fc948199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.905+0000 7fc94d74a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9481068c0 0x7fc948199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc94d74a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9481091f0 0x7fc9481a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc94d74a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc94810efe0 con 0x7fc948103f90 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc94d74a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc94810ee60 con 0x7fc9481068c0 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc94d74a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc94810f160 con 0x7fc9481091f0 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc948103f90 0x7fc948199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc948103f90 0x7fc948199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58960/0 (socket says 172.21.15.86:58960) 2024-05-12T11:02:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 -- 172.21.15.86:0/2407458747 learned_addr learned my addr 172.21.15.86:0/2407458747 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc9467fc700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9481068c0 0x7fc948199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc9477fe700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9481091f0 0x7fc9481a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 -- 172.21.15.86:0/2407458747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9481091f0 msgr2=0x7fc9481a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9481091f0 0x7fc9481a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 -- 172.21.15.86:0/2407458747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9481068c0 msgr2=0x7fc948199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9481068c0 0x7fc948199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 -- 172.21.15.86:0/2407458747 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9481a1290 con 0x7fc948103f90 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc946ffd700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc948103f90 0x7fc948199630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc93800b560 tx=0x7fc93800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc92ffff700 1 -- 172.21.15.86:0/2407458747 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938015020 con 0x7fc948103f90 2024-05-12T11:02:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9481a1580 con 0x7fc948103f90 2024-05-12T11:02:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc92ffff700 1 -- 172.21.15.86:0/2407458747 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc938011ce0 con 0x7fc948103f90 2024-05-12T11:02:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc92ffff700 1 -- 172.21.15.86:0/2407458747 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938010d40 con 0x7fc948103f90 2024-05-12T11:02:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.906+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9481a1b40 con 0x7fc948103f90 2024-05-12T11:02:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.907+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc94806a190 con 0x7fc948103f90 2024-05-12T11:02:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.909+0000 7fc92ffff700 1 -- 172.21.15.86:0/2407458747 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc938018020 con 0x7fc948103f90 2024-05-12T11:02:27.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:27 smithi086 ceph-mon[30110]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:27.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:27 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi176 2024-05-12T11:02:27.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:27 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi176 to 8544M 2024-05-12T11:02:27.902 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:27 smithi086 ceph-mon[30110]: osdmap e39: 6 total, 6 up, 6 in 2024-05-12T11:02:27.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.909+0000 7fc92ffff700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fc9300b2880 0x7fc9300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:27.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.910+0000 7fc9467fc700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fc9300b2880 0x7fc9300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:27.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.910+0000 7fc92ffff700 1 -- 172.21.15.86:0/2407458747 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4533+0+0 (secure 0 0 0) 0x7fc9380e1030 con 0x7fc948103f90 2024-05-12T11:02:27.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.910+0000 7fc9467fc700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fc9300b2880 0x7fc9300b4d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc93c005950 tx=0x7fc93c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:02:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:27.913+0000 7fc92ffff700 1 -- 172.21.15.86:0/2407458747 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc93801f020 con 0x7fc948103f90 2024-05-12T11:02:27.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:27 smithi172 ceph-mon[34517]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:27.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:27 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi176 2024-05-12T11:02:27.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:27 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi176 to 8544M 2024-05-12T11:02:27.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:27 smithi172 ceph-mon[34517]: osdmap e39: 6 total, 6 up, 6 in 2024-05-12T11:02:28.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:27 smithi176 ceph-mon[34357]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-12T11:02:28.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:27 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi176 2024-05-12T11:02:28.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:27 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi176 to 8544M 2024-05-12T11:02:28.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:27 smithi176 ceph-mon[34357]: osdmap e39: 6 total, 6 up, 6 in 2024-05-12T11:02:28.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:28.129+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc9480638e0 con 0x7fc9300b2880 2024-05-12T11:02:28.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:28 smithi086 ceph-mon[30110]: osdmap e40: 6 total, 6 up, 6 in 2024-05-12T11:02:28.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:28 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:28.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:28 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:28.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:28 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:28.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:28 smithi172 ceph-mon[34517]: osdmap e40: 6 total, 6 up, 6 in 2024-05-12T11:02:28.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:28 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:28.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:28 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:28.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:28 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:29.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:28 smithi176 ceph-mon[34357]: osdmap e40: 6 total, 6 up, 6 in 2024-05-12T11:02:29.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:28 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:29.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:28 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:29.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:28 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:29.912 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:29 smithi086 ceph-mon[30110]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:29.912 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:29 smithi086 ceph-mon[30110]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:29.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:29 smithi172 ceph-mon[34517]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:29.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:29 smithi172 ceph-mon[34517]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:30.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:29 smithi176 ceph-mon[34357]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:30.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:29 smithi176 ceph-mon[34357]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:31.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:31 smithi086 ceph-mon[30110]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:31.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:31 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/683646097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7389cd75-eea2-4ce4-adeb-b8e8db25b3b4"}]: dispatch 2024-05-12T11:02:31.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:31 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/683646097' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7389cd75-eea2-4ce4-adeb-b8e8db25b3b4"}]': finished 2024-05-12T11:02:31.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:31 smithi086 ceph-mon[30110]: osdmap e41: 7 total, 6 up, 7 in 2024-05-12T11:02:31.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:31.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:31 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/384371376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:31.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:31 smithi172 ceph-mon[34517]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:31 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/683646097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7389cd75-eea2-4ce4-adeb-b8e8db25b3b4"}]: dispatch 2024-05-12T11:02:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:31 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/683646097' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7389cd75-eea2-4ce4-adeb-b8e8db25b3b4"}]': finished 2024-05-12T11:02:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:31 smithi172 ceph-mon[34517]: osdmap e41: 7 total, 6 up, 7 in 2024-05-12T11:02:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:31 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/384371376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:32.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:31 smithi176 ceph-mon[34357]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:32.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:31 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/683646097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7389cd75-eea2-4ce4-adeb-b8e8db25b3b4"}]: dispatch 2024-05-12T11:02:32.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:31 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/683646097' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7389cd75-eea2-4ce4-adeb-b8e8db25b3b4"}]': finished 2024-05-12T11:02:32.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:31 smithi176 ceph-mon[34357]: osdmap e41: 7 total, 6 up, 7 in 2024-05-12T11:02:32.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:32.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:31 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/384371376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:33.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:33 smithi086 ceph-mon[30110]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:33.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:33 smithi172 ceph-mon[34517]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:34.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:33 smithi176 ceph-mon[34357]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:35.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:35 smithi086 ceph-mon[30110]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-12T11:02:35.972 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:35 smithi176 ceph-mon[34357]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-12T11:02:35.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:35 smithi172 ceph-mon[34517]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-12T11:02:37.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:37 smithi086 ceph-mon[30110]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-12T11:02:37.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:37 smithi172 ceph-mon[34517]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-12T11:02:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:37 smithi176 ceph-mon[34357]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-12T11:02:38.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:38 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-12T11:02:38.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:38 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:38.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-12T11:02:38.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:39.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:38 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-12T11:02:39.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:38 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:39.904 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:39 smithi086 ceph-mon[30110]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:02:39.904 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:39 smithi086 ceph-mon[30110]: Deploying daemon osd.6 on smithi086 2024-05-12T11:02:39.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:39 smithi172 ceph-mon[34517]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:02:39.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:39 smithi172 ceph-mon[34517]: Deploying daemon osd.6 on smithi086 2024-05-12T11:02:40.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:39 smithi176 ceph-mon[34357]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:02:40.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:39 smithi176 ceph-mon[34357]: Deploying daemon osd.6 on smithi086 2024-05-12T11:02:41.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:41 smithi086 ceph-mon[30110]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:02:41.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:41 smithi172 ceph-mon[34517]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:02:42.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:41 smithi176 ceph-mon[34357]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:02:43.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:43 smithi086 ceph-mon[30110]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-12T11:02:43.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:43 smithi172 ceph-mon[34517]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-12T11:02:44.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:43 smithi176 ceph-mon[34357]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-12T11:02:45.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:45 smithi086 ceph-mon[30110]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-12T11:02:45.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:45.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:45.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:45 smithi172 ceph-mon[34517]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-12T11:02:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:45.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:45 smithi176 ceph-mon[34357]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-12T11:02:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:47.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:47 smithi086 ceph-mon[30110]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:47.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:47 smithi172 ceph-mon[34517]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:47.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:47 smithi176 ceph-mon[34357]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.486+0000 7fc92ffff700 1 -- 172.21.15.86:0/2407458747 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9480638e0 con 0x7fc9300b2880 2024-05-12T11:02:48.479 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 6 on host 'smithi086' 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fc9300b2880 msgr2=0x7fc9300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fc9300b2880 0x7fc9300b4d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc93c005950 tx=0x7fc93c00a300 comp rx=0 tx=0).stop 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc948103f90 msgr2=0x7fc948199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc948103f90 0x7fc948199630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc93800b560 tx=0x7fc93800b870 comp rx=0 tx=0).stop 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 shutdown_connections 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fc9300b2880 0x7fc9300b4d40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9481091f0 0x7fc9481a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc948103f90 0x7fc948199630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 --2- 172.21.15.86:0/2407458747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9481068c0 0x7fc948199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.489+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 >> 172.21.15.86:0/2407458747 conn(0x7fc9480fd9c0 msgr2=0x7fc9481048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.490+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 shutdown_connections 2024-05-12T11:02:48.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:02:48.490+0000 7fc94d74a700 1 -- 172.21.15.86:0/2407458747 wait complete. 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:48.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:48.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:48.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-12T11:02:48.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:48.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:02:49.176 DEBUG:teuthology.orchestra.run.smithi086:osd.6> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.6.service 2024-05-12T11:02:49.179 INFO:tasks.cephadm:Deploying osd.7 on smithi172 with /dev/vg_nvme/lv_2... 2024-05-12T11:02:49.179 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-12T11:02:49.424 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:02:49.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:49 smithi086 ceph-mon[30110]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:49 smithi086 ceph-mon[30110]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-12T11:02:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:49 smithi086 ceph-mon[30110]: osdmap e42: 7 total, 6 up, 7 in 2024-05-12T11:02:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:49 smithi086 ceph-mon[30110]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:02:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:49 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:49.865 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:49 smithi172 ceph-mon[34517]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:49.865 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:49 smithi172 ceph-mon[34517]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-12T11:02:49.865 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:49 smithi172 ceph-mon[34517]: osdmap e42: 7 total, 6 up, 7 in 2024-05-12T11:02:49.866 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:49 smithi172 ceph-mon[34517]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:02:49.866 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:49 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:50.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:49 smithi176 ceph-mon[34357]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:50.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:49 smithi176 ceph-mon[34357]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-12T11:02:50.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:49 smithi176 ceph-mon[34357]: osdmap e42: 7 total, 6 up, 7 in 2024-05-12T11:02:50.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:49 smithi176 ceph-mon[34357]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:02:50.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:49 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:50.213 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:02:49 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:02:49.950+0000 7f061a20a700 -1 osd.6 0 waiting for initial osdmap 2024-05-12T11:02:50.213 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:02:49 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:02:49.960+0000 7f06117f4700 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:02:50.772 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:50 smithi086 ceph-mon[30110]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:02:50.773 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:50 smithi086 ceph-mon[30110]: osdmap e43: 7 total, 6 up, 7 in 2024-05-12T11:02:50.773 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:50.773 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:50.773 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:50 smithi086 ceph-mon[30110]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' 2024-05-12T11:02:50.786 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:50 smithi172 ceph-mon[34517]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:02:50.786 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:50 smithi172 ceph-mon[34517]: osdmap e43: 7 total, 6 up, 7 in 2024-05-12T11:02:50.786 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:50.786 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:50.786 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:50 smithi172 ceph-mon[34517]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' 2024-05-12T11:02:51.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:50 smithi176 ceph-mon[34357]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:02:51.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:50 smithi176 ceph-mon[34357]: osdmap e43: 7 total, 6 up, 7 in 2024-05-12T11:02:51.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:51.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:51.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:50 smithi176 ceph-mon[34357]: from='osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720]' entity='osd.6' 2024-05-12T11:02:51.470 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-12T11:02:51.471 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-12T11:02:51.471 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-12T11:02:51.471 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-12T11:02:51.471 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114882 s, 913 MB/s 2024-05-12T11:02:51.471 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 2024-05-12T11:02:51.471 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-12T11:02:51.686 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:51 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:02:51.687 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:51 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:02:51.687 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:51 smithi086 ceph-mon[30110]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:51.687 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:51 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:51.687 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:51 smithi086 ceph-mon[30110]: osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] boot 2024-05-12T11:02:51.687 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:51 smithi086 ceph-mon[30110]: osdmap e44: 7 total, 7 up, 7 in 2024-05-12T11:02:51.687 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:51 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:51.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:51 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:02:51.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:51 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:02:51.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:51 smithi172 ceph-mon[34517]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:51.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:51 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:51.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:51 smithi172 ceph-mon[34517]: osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] boot 2024-05-12T11:02:51.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:51 smithi172 ceph-mon[34517]: osdmap e44: 7 total, 7 up, 7 in 2024-05-12T11:02:51.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:51 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:52.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:51 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:02:52.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:51 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:02:52.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:51 smithi176 ceph-mon[34357]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-12T11:02:52.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:51 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:52.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:51 smithi176 ceph-mon[34357]: osd.6 [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] boot 2024-05-12T11:02:52.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:51 smithi176 ceph-mon[34357]: osdmap e44: 7 total, 7 up, 7 in 2024-05-12T11:02:52.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:51 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:02:52.146 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-05-12T11:02:52.386 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:02:53.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: osdmap e45: 7 total, 7 up, 7 in 2024-05-12T11:02:53.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:53.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi086 2024-05-12T11:02:53.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi086 to 5696M 2024-05-12T11:02:53.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:53.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:53.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: osdmap e45: 7 total, 7 up, 7 in 2024-05-12T11:02:53.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:53.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi086 2024-05-12T11:02:53.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi086 to 5696M 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:53.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: osdmap e45: 7 total, 7 up, 7 in 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi086 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi086 to 5696M 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:02:53.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:02:54.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 -- 172.21.15.172:0/3345505002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c104000 msgr2=0x7f7c5c1063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:54.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 --2- 172.21.15.172:0/3345505002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c104000 0x7f7c5c1063f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009990 tx=0x7f7c58009ca0 comp rx=0 tx=0).stop 2024-05-12T11:02:54.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 -- 172.21.15.172:0/3345505002 shutdown_connections 2024-05-12T11:02:54.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 --2- 172.21.15.172:0/3345505002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5c109260 0x7f7c5c10b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 --2- 172.21.15.172:0/3345505002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c104000 0x7f7c5c1063f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 --2- 172.21.15.172:0/3345505002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c106930 0x7f7c5c108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 -- 172.21.15.172:0/3345505002 >> 172.21.15.172:0/3345505002 conn(0x7f7c5c0fd990 msgr2=0x7f7c5c0ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 -- 172.21.15.172:0/3345505002 shutdown_connections 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 -- 172.21.15.172:0/3345505002 wait complete. 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 Processor -- start 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 -- start start 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.084+0000 7f7c63d84700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c104000 0x7f7c5c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c63d84700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5c106930 0x7f7c5c199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c63d84700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c109260 0x7f7c5c1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c63d84700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c10efb0 con 0x7f7c5c104000 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c63d84700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c10ee30 con 0x7f7c5c109260 2024-05-12T11:02:54.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c63d84700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c10f130 con 0x7f7c5c106930 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c109260 0x7f7c5c1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c109260 0x7f7c5c1a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59894/0 (socket says 172.21.15.172:59894) 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 -- 172.21.15.172:0/2926656808 learned_addr learned my addr 172.21.15.172:0/2926656808 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c61b20700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c104000 0x7f7c5c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c6131f700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5c106930 0x7f7c5c199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 -- 172.21.15.172:0/2926656808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5c106930 msgr2=0x7f7c5c199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5c106930 0x7f7c5c199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 -- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c104000 msgr2=0x7f7c5c199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c104000 0x7f7c5c199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 -- 172.21.15.172:0/2926656808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c1a1260 con 0x7f7c5c109260 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c62321700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c109260 0x7f7c5c1a0bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400ef90 tx=0x7f7c5400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c52ffd700 1 -- 172.21.15.172:0/2926656808 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c540092e0 con 0x7f7c5c109260 2024-05-12T11:02:54.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5c1a14f0 con 0x7f7c5c109260 2024-05-12T11:02:54.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c52ffd700 1 -- 172.21.15.172:0/2926656808 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c54004bb0 con 0x7f7c5c109260 2024-05-12T11:02:54.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c52ffd700 1 -- 172.21.15.172:0/2926656808 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54004040 con 0x7f7c5c109260 2024-05-12T11:02:54.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.085+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5c1a19e0 con 0x7f7c5c109260 2024-05-12T11:02:54.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.086+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5c06a190 con 0x7f7c5c109260 2024-05-12T11:02:54.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.088+0000 7f7c52ffd700 1 -- 172.21.15.172:0/2926656808 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7c5401b030 con 0x7f7c5c109260 2024-05-12T11:02:54.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.089+0000 7f7c52ffd700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7c480b2880 0x7f7c480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:02:54.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.089+0000 7f7c52ffd700 1 -- 172.21.15.172:0/2926656808 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4965+0+0 (secure 0 0 0) 0x7f7c540e1990 con 0x7f7c5c109260 2024-05-12T11:02:54.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.089+0000 7f7c61b20700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7c480b2880 0x7f7c480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:02:54.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.090+0000 7f7c61b20700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7c480b2880 0x7f7c480b4d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800b2e0 tx=0x7f7c58005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:02:54.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.093+0000 7f7c52ffd700 1 -- 172.21.15.172:0/2926656808 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7c54022020 con 0x7f7c5c109260 2024-05-12T11:02:54.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:02:54.304+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7c5c0639a0 con 0x7f7c480b2880 2024-05-12T11:02:55.207 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:55 smithi172 ceph-mon[34517]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:55.207 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:55 smithi172 ceph-mon[34517]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:55.207 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:55.207 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:55.207 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:55 smithi086 ceph-mon[30110]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:55 smithi086 ceph-mon[30110]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:55.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:55 smithi176 ceph-mon[34357]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:55.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:55 smithi176 ceph-mon[34357]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:02:55.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:02:55.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:02:55.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:02:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:57 smithi172 ceph-mon[34517]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:57 smithi172 ceph-mon[34517]: from='client.? 172.21.15.172:0/2426956298' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]: dispatch 2024-05-12T11:02:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:57 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]: dispatch 2024-05-12T11:02:57.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:57 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]': finished 2024-05-12T11:02:57.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:57 smithi172 ceph-mon[34517]: osdmap e46: 8 total, 7 up, 8 in 2024-05-12T11:02:57.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:57 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:02:57.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:57 smithi086 ceph-mon[30110]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:57.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:57 smithi086 ceph-mon[30110]: from='client.? 172.21.15.172:0/2426956298' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]: dispatch 2024-05-12T11:02:57.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:57 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]: dispatch 2024-05-12T11:02:57.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:57 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]': finished 2024-05-12T11:02:57.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:57 smithi086 ceph-mon[30110]: osdmap e46: 8 total, 7 up, 8 in 2024-05-12T11:02:57.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:57 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:02:57.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:57 smithi176 ceph-mon[34357]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:57.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:57 smithi176 ceph-mon[34357]: from='client.? 172.21.15.172:0/2426956298' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]: dispatch 2024-05-12T11:02:57.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:57 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]: dispatch 2024-05-12T11:02:57.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:57 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688"}]': finished 2024-05-12T11:02:57.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:57 smithi176 ceph-mon[34357]: osdmap e46: 8 total, 7 up, 8 in 2024-05-12T11:02:57.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:57 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:02:58.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:58 smithi086 ceph-mon[30110]: from='client.? 172.21.15.172:0/1380702226' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:58 smithi172 ceph-mon[34517]: from='client.? 172.21.15.172:0/1380702226' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:58.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:58 smithi176 ceph-mon[34357]: from='client.? 172.21.15.172:0/1380702226' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:02:59.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:02:59 smithi086 ceph-mon[30110]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:59.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:02:59 smithi172 ceph-mon[34517]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:02:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:02:59 smithi176 ceph-mon[34357]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:01.387 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:01 smithi172 ceph-mon[34517]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:01.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:01 smithi086 ceph-mon[30110]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:01 smithi176 ceph-mon[34357]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:03.296 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:03 smithi172 ceph-mon[34517]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:03.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:03 smithi086 ceph-mon[30110]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:03.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:03 smithi176 ceph-mon[34357]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:05.346 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:05 smithi172 ceph-mon[34517]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:05.346 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-12T11:03:05.346 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:05.346 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:05 smithi172 ceph-mon[34517]: Deploying daemon osd.7 on smithi172 2024-05-12T11:03:05.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:05 smithi086 ceph-mon[30110]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:05.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-12T11:03:05.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:05.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:05 smithi086 ceph-mon[30110]: Deploying daemon osd.7 on smithi172 2024-05-12T11:03:05.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:05 smithi176 ceph-mon[34357]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:05.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-12T11:03:05.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:05.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:05 smithi176 ceph-mon[34357]: Deploying daemon osd.7 on smithi172 2024-05-12T11:03:07.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:07 smithi172 ceph-mon[34517]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:07.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:07 smithi086 ceph-mon[30110]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:07.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:07 smithi176 ceph-mon[34357]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:09.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:09 smithi086 ceph-mon[30110]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:09 smithi172 ceph-mon[34517]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:09.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:09 smithi176 ceph-mon[34357]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:11.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:11 smithi172 ceph-mon[34517]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:11.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:11.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:11.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:11 smithi176 ceph-mon[34357]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:11.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:11.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:11.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:11.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:11 smithi086 ceph-mon[30110]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:11.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:13.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:13 smithi086 ceph-mon[30110]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:13.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:13.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:13.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:13 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:13 smithi172 ceph-mon[34517]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:13.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:13.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:13.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:13 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:13 smithi176 ceph-mon[34357]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:13.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:13.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:13.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:13 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:13.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.868+0000 7f7c52ffd700 1 -- 172.21.15.172:0/2926656808 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7c5c0639a0 con 0x7f7c480b2880 2024-05-12T11:03:13.860 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 7 on host 'smithi172' 2024-05-12T11:03:13.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.870+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7c480b2880 msgr2=0x7f7c480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:13.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.870+0000 7f7c63d84700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7c480b2880 0x7f7c480b4d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800b2e0 tx=0x7f7c58005fb0 comp rx=0 tx=0).stop 2024-05-12T11:03:13.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.870+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c109260 msgr2=0x7f7c5c1a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.870+0000 7f7c63d84700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c109260 0x7f7c5c1a0bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400ef90 tx=0x7f7c5400c3a0 comp rx=0 tx=0).stop 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.871+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 shutdown_connections 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.871+0000 7f7c63d84700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7c480b2880 0x7f7c480b4d40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.871+0000 7f7c63d84700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c5c109260 0x7f7c5c1a0bc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.871+0000 7f7c63d84700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c104000 0x7f7c5c199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.871+0000 7f7c63d84700 1 --2- 172.21.15.172:0/2926656808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5c106930 0x7f7c5c199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.871+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 >> 172.21.15.172:0/2926656808 conn(0x7f7c5c0fd990 msgr2=0x7f7c5c104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.871+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 shutdown_connections 2024-05-12T11:03:13.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:03:13.871+0000 7f7c63d84700 1 -- 172.21.15.172:0/2926656808 wait complete. 2024-05-12T11:03:14.610 DEBUG:teuthology.orchestra.run.smithi172:osd.7> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.7.service 2024-05-12T11:03:14.613 INFO:tasks.cephadm:Deploying osd.8 on smithi176 with /dev/vg_nvme/lv_2... 2024-05-12T11:03:14.613 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-12T11:03:14.859 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:03:14.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:14.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:14.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:14.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:14 smithi172 ceph-mon[34517]: from='osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-12T11:03:14.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:14 smithi172 ceph-mon[34517]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-12T11:03:14.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:14.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:14.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:14.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:14 smithi176 ceph-mon[34357]: from='osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-12T11:03:14.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:14 smithi176 ceph-mon[34357]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-12T11:03:15.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:15.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:15.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:15.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:14 smithi086 ceph-mon[30110]: from='osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-12T11:03:15.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:14 smithi086 ceph-mon[30110]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-12T11:03:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:15 smithi176 ceph-mon[34357]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:15 smithi176 ceph-mon[34357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-12T11:03:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:15 smithi176 ceph-mon[34357]: osdmap e47: 8 total, 7 up, 8 in 2024-05-12T11:03:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:15 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:15 smithi176 ceph-mon[34357]: from='osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:03:16.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:15 smithi176 ceph-mon[34357]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:03:16.125 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:15 smithi172 ceph-mon[34517]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:16.125 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:15 smithi172 ceph-mon[34517]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-12T11:03:16.125 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:15 smithi172 ceph-mon[34517]: osdmap e47: 8 total, 7 up, 8 in 2024-05-12T11:03:16.125 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:15 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:16.125 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:15 smithi172 ceph-mon[34517]: from='osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:03:16.125 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:15 smithi172 ceph-mon[34517]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:03:16.126 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:03:15 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:03:15.862+0000 7f30dc483700 -1 osd.7 0 waiting for initial osdmap 2024-05-12T11:03:16.126 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:03:15 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:03:15.872+0000 7f30d8276700 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:03:16.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:15 smithi086 ceph-mon[30110]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:16.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:15 smithi086 ceph-mon[30110]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-12T11:03:16.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:15 smithi086 ceph-mon[30110]: osdmap e47: 8 total, 7 up, 8 in 2024-05-12T11:03:16.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:16.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:15 smithi086 ceph-mon[30110]: from='osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:03:16.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:15 smithi086 ceph-mon[30110]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:03:16.889 INFO:teuthology.orchestra.run.smithi176.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-12T11:03:16.889 INFO:teuthology.orchestra.run.smithi176.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-12T11:03:16.889 INFO:teuthology.orchestra.run.smithi176.stderr: stderr: 10+0 records in 2024-05-12T11:03:16.889 INFO:teuthology.orchestra.run.smithi176.stderr:10+0 records out 2024-05-12T11:03:16.889 INFO:teuthology.orchestra.run.smithi176.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114797 s, 913 MB/s 2024-05-12T11:03:16.890 INFO:teuthology.orchestra.run.smithi176.stderr:--> Zapping successful for: 2024-05-12T11:03:17.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:16 smithi086 ceph-mon[30110]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:03:17.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:16 smithi086 ceph-mon[30110]: osdmap e48: 8 total, 7 up, 8 in 2024-05-12T11:03:17.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:16 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:17.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:16 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:17.216 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:16 smithi176 ceph-mon[34357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:03:17.217 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:16 smithi176 ceph-mon[34357]: osdmap e48: 8 total, 7 up, 8 in 2024-05-12T11:03:17.217 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:16 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:17.217 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:16 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:17.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:16 smithi172 ceph-mon[34517]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:03:17.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:16 smithi172 ceph-mon[34517]: osdmap e48: 8 total, 7 up, 8 in 2024-05-12T11:03:17.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:16 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:17.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:16 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:17.532 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi176:vg_nvme/lv_2 2024-05-12T11:03:17.774 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:03:17.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] boot 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: osdmap e49: 8 total, 8 up, 8 in 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:17.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:17.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:17.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] boot 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: osdmap e49: 8 total, 8 up, 8 in 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:18.099 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:18.100 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:18.100 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:18.100 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:18.100 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:18.100 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:18.100 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:18.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:03:18.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:03:18.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-12T11:03:18.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:18.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: osd.7 [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] boot 2024-05-12T11:03:18.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: osdmap e49: 8 total, 8 up, 8 in 2024-05-12T11:03:18.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:18.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:19.100 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:18 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi172 2024-05-12T11:03:19.101 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:18 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-12T11:03:19.101 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:18 smithi176 ceph-mon[34357]: osdmap e50: 8 total, 8 up, 8 in 2024-05-12T11:03:19.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:18 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi172 2024-05-12T11:03:19.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:18 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-12T11:03:19.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:18 smithi086 ceph-mon[30110]: osdmap e50: 8 total, 8 up, 8 in 2024-05-12T11:03:19.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:18 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi172 2024-05-12T11:03:19.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:18 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-12T11:03:19.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:18 smithi172 ceph-mon[34517]: osdmap e50: 8 total, 8 up, 8 in 2024-05-12T11:03:19.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 -- 172.21.15.176:0/3798087998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc105190 msgr2=0x7f04fc10ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:19.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 --2- 172.21.15.176:0/3798087998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc105190 0x7f04fc10ba40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f04f400b0a0 tx=0x7f04f400b3b0 comp rx=0 tx=0).stop 2024-05-12T11:03:19.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 -- 172.21.15.176:0/3798087998 shutdown_connections 2024-05-12T11:03:19.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 --2- 172.21.15.176:0/3798087998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc105190 0x7f04fc10ba40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:19.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 --2- 172.21.15.176:0/3798087998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc101810 0x7f04fc101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:19.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 --2- 172.21.15.176:0/3798087998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc1047f0 0x7f04fc104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:19.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 -- 172.21.15.176:0/3798087998 >> 172.21.15.176:0/3798087998 conn(0x7f04fc0fd170 msgr2=0x7f04fc0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:03:19.294 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 -- 172.21.15.176:0/3798087998 shutdown_connections 2024-05-12T11:03:19.294 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.301+0000 7f0500ae2700 1 -- 172.21.15.176:0/3798087998 wait complete. 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f0500ae2700 1 Processor -- start 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f0500ae2700 1 -- start start 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f0500ae2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc101810 0x7f04fc1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f0500ae2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc1047f0 0x7f04fc199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f0500ae2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc105190 0x7f04fc1a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f0500ae2700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc10efe0 con 0x7f04fc101810 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f0500ae2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc10ee60 con 0x7f04fc105190 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f0500ae2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc10f160 con 0x7f04fc1047f0 2024-05-12T11:03:19.296 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f04f9d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc1047f0 0x7f04fc199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f04f9d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc1047f0 0x7f04fc199b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:47122/0 (socket says 172.21.15.176:47122) 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.302+0000 7f04f9d9b700 1 -- 172.21.15.176:0/878398427 learned_addr learned my addr 172.21.15.176:0/878398427 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04fad9d700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc105190 0x7f04fc1a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04fa59c700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc101810 0x7f04fc1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04f9d9b700 1 -- 172.21.15.176:0/878398427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc105190 msgr2=0x7f04fc1a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04f9d9b700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc105190 0x7f04fc1a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04f9d9b700 1 -- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc101810 msgr2=0x7f04fc1995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04f9d9b700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc101810 0x7f04fc1995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04f9d9b700 1 -- 172.21.15.176:0/878398427 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc1a1220 con 0x7f04fc1047f0 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04fa59c700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc101810 0x7f04fc1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04f9d9b700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc1047f0 0x7f04fc199b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f04f000d9b0 tx=0x7f04f000dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04eb7fe700 1 -- 172.21.15.176:0/878398427 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0017070 con 0x7f04fc1047f0 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04eb7fe700 1 -- 172.21.15.176:0/878398427 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f0004830 con 0x7f04fc1047f0 2024-05-12T11:03:19.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc1a1510 con 0x7f04fc1047f0 2024-05-12T11:03:19.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f04eb7fe700 1 -- 172.21.15.176:0/878398427 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00053a0 con 0x7f04fc1047f0 2024-05-12T11:03:19.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.303+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc1a1a50 con 0x7f04fc1047f0 2024-05-12T11:03:19.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.304+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc06a190 con 0x7f04fc1047f0 2024-05-12T11:03:19.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.305+0000 7f04eb7fe700 1 -- 172.21.15.176:0/878398427 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f04f00049e0 con 0x7f04fc1047f0 2024-05-12T11:03:19.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.306+0000 7f04eb7fe700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f04e40b2900 0x7f04e40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:03:19.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.306+0000 7f04eb7fe700 1 -- 172.21.15.176:0/878398427 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5397+0+0 (secure 0 0 0) 0x7f04f00e1a00 con 0x7f04fc1047f0 2024-05-12T11:03:19.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.306+0000 7f04fa59c700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f04e40b2900 0x7f04e40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:03:19.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.307+0000 7f04fa59c700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f04e40b2900 0x7f04e40b4dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04ec005fd0 tx=0x7f04ec005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:03:19.301 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.309+0000 7f04eb7fe700 1 -- 172.21.15.176:0/878398427 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f04f0020020 con 0x7f04fc1047f0 2024-05-12T11:03:19.515 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:19.523+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f04fc0638e0 con 0x7f04e40b2900 2024-05-12T11:03:20.128 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:19 smithi176 ceph-mon[34357]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:20.128 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:19 smithi176 ceph-mon[34357]: osdmap e51: 8 total, 8 up, 8 in 2024-05-12T11:03:20.128 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:03:20.128 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:03:20.129 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:19 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:20.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:19 smithi086 ceph-mon[30110]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:20.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:19 smithi086 ceph-mon[30110]: osdmap e51: 8 total, 8 up, 8 in 2024-05-12T11:03:20.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:03:20.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:03:20.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:19 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:20.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:19 smithi172 ceph-mon[34517]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:20.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:19 smithi172 ceph-mon[34517]: osdmap e51: 8 total, 8 up, 8 in 2024-05-12T11:03:20.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:03:20.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:03:20.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:19 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:21.171 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:20 smithi176 ceph-mon[34357]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:03:21.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:20 smithi086 ceph-mon[30110]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:03:21.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:20 smithi172 ceph-mon[34517]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:03:22.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:21 smithi086 ceph-mon[30110]: pgmap v179: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:22.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:21 smithi172 ceph-mon[34517]: pgmap v179: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:22.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:21 smithi176 ceph-mon[34357]: pgmap v179: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:23.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:22 smithi176 ceph-mon[34357]: pgmap v180: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:23.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:22 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/3405046420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]: dispatch 2024-05-12T11:03:23.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:22 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]: dispatch 2024-05-12T11:03:23.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:22 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]': finished 2024-05-12T11:03:23.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:22 smithi176 ceph-mon[34357]: osdmap e52: 9 total, 8 up, 9 in 2024-05-12T11:03:23.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:23.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:22 smithi086 ceph-mon[30110]: pgmap v180: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:22 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/3405046420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]: dispatch 2024-05-12T11:03:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:22 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]: dispatch 2024-05-12T11:03:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:22 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]': finished 2024-05-12T11:03:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:22 smithi086 ceph-mon[30110]: osdmap e52: 9 total, 8 up, 9 in 2024-05-12T11:03:23.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:23.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:22 smithi172 ceph-mon[34517]: pgmap v180: 1 pgs: 1 unknown; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:22 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/3405046420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]: dispatch 2024-05-12T11:03:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:22 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]: dispatch 2024-05-12T11:03:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:22 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45bf3d95-2150-45a9-8b6f-ea01eb14ba83"}]': finished 2024-05-12T11:03:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:22 smithi172 ceph-mon[34517]: osdmap e52: 9 total, 8 up, 9 in 2024-05-12T11:03:23.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:24.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:23 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/606328978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:03:24.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:23 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/606328978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:03:24.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:23 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/606328978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:03:25.138 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:24 smithi172 ceph-mon[34517]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 187 KiB/s, 0 objects/s recovering 2024-05-12T11:03:25.168 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:24 smithi176 ceph-mon[34357]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 187 KiB/s, 0 objects/s recovering 2024-05-12T11:03:25.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:24 smithi086 ceph-mon[30110]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 187 KiB/s, 0 objects/s recovering 2024-05-12T11:03:27.340 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:27 smithi176 ceph-mon[34357]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-12T11:03:27.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:27 smithi086 ceph-mon[30110]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-12T11:03:27.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:27 smithi172 ceph-mon[34517]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-12T11:03:29.367 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:29 smithi176 ceph-mon[34357]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-05-12T11:03:29.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:29 smithi086 ceph-mon[30110]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-05-12T11:03:29.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:29 smithi172 ceph-mon[34517]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-05-12T11:03:30.439 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:30 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-12T11:03:30.439 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:30 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:30.439 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:30 smithi176 ceph-mon[34357]: Deploying daemon osd.8 on smithi176 2024-05-12T11:03:30.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:30 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-12T11:03:30.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:30 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:30.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:30 smithi086 ceph-mon[30110]: Deploying daemon osd.8 on smithi176 2024-05-12T11:03:30.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:30 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-12T11:03:30.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:30 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:30.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:30 smithi172 ceph-mon[34517]: Deploying daemon osd.8 on smithi176 2024-05-12T11:03:31.183 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:31 smithi176 ceph-mon[34357]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-12T11:03:31.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:31 smithi086 ceph-mon[30110]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-12T11:03:31.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:31 smithi172 ceph-mon[34517]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-12T11:03:33.362 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:33 smithi176 ceph-mon[34357]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-12T11:03:33.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:33 smithi086 ceph-mon[30110]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-12T11:03:33.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:33 smithi172 ceph-mon[34517]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-12T11:03:35.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:35 smithi176 ceph-mon[34357]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-12T11:03:35.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:35 smithi086 ceph-mon[30110]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-12T11:03:35.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:35 smithi172 ceph-mon[34517]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-12T11:03:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:36.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:36 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:36.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:36.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:36.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:36 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:36.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:36.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:36.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:36 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:37.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:37 smithi176 ceph-mon[34357]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:37.614 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:37 smithi086 ceph-mon[30110]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:37.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:37 smithi172 ceph-mon[34517]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:39.179 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.187+0000 7f04eb7fe700 1 -- 172.21.15.176:0/878398427 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f04fc0638e0 con 0x7f04e40b2900 2024-05-12T11:03:39.180 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 8 on host 'smithi176' 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f04e40b2900 msgr2=0x7f04e40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f04e40b2900 0x7f04e40b4dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04ec005fd0 tx=0x7f04ec005f00 comp rx=0 tx=0).stop 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc1047f0 msgr2=0x7f04fc199b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc1047f0 0x7f04fc199b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f04f000d9b0 tx=0x7f04f000dd70 comp rx=0 tx=0).stop 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 shutdown_connections 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f04e40b2900 0x7f04e40b4dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc105190 0x7f04fc1a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc101810 0x7f04fc1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 --2- 172.21.15.176:0/878398427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc1047f0 0x7f04fc199b00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:39.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 >> 172.21.15.176:0/878398427 conn(0x7f04fc0fd170 msgr2=0x7f04fc107a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:03:39.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 shutdown_connections 2024-05-12T11:03:39.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:03:39.189+0000 7f0500ae2700 1 -- 172.21.15.176:0/878398427 wait complete. 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:39.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:39.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-12T11:03:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-12T11:03:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:03:39.875 DEBUG:teuthology.orchestra.run.smithi176:osd.8> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.8.service 2024-05-12T11:03:39.878 INFO:tasks.cephadm:Deploying osd.9 on smithi086 with /dev/vg_nvme/lv_1... 2024-05-12T11:03:39.878 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-12T11:03:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:03:40.419 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:40 smithi176 ceph-mon[34357]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-12T11:03:40.419 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:40 smithi176 ceph-mon[34357]: osdmap e53: 9 total, 8 up, 9 in 2024-05-12T11:03:40.419 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:40 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:40.419 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:40 smithi176 ceph-mon[34357]: from='osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:03:40.420 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:40 smithi176 ceph-mon[34357]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:03:40.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:40 smithi086 ceph-mon[30110]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-12T11:03:40.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:40 smithi086 ceph-mon[30110]: osdmap e53: 9 total, 8 up, 9 in 2024-05-12T11:03:40.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:40 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:40.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:40 smithi086 ceph-mon[30110]: from='osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:03:40.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:40 smithi086 ceph-mon[30110]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:03:40.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:40 smithi172 ceph-mon[34517]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-12T11:03:40.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:40 smithi172 ceph-mon[34517]: osdmap e53: 9 total, 8 up, 9 in 2024-05-12T11:03:40.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:40 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:40.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:40 smithi172 ceph-mon[34517]: from='osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:03:40.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:40 smithi172 ceph-mon[34517]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:03:41.017 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:03:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:03:40.722+0000 7f9d74f60700 -1 osd.8 0 waiting for initial osdmap 2024-05-12T11:03:41.017 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:03:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:03:40.732+0000 7f9d6cd4b700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:03:41.467 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:41 smithi176 ceph-mon[34357]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:41.468 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:41 smithi176 ceph-mon[34357]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:03:41.468 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:41 smithi176 ceph-mon[34357]: osdmap e54: 9 total, 8 up, 9 in 2024-05-12T11:03:41.468 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:41 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:41.468 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:41 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:41.468 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:41 smithi176 ceph-mon[34357]: from='osd.8 ' entity='osd.8' 2024-05-12T11:03:41.696 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:41 smithi086 ceph-mon[30110]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:41.696 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:41 smithi086 ceph-mon[30110]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:03:41.696 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:41 smithi086 ceph-mon[30110]: osdmap e54: 9 total, 8 up, 9 in 2024-05-12T11:03:41.696 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:41 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:41.696 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:41 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:41.696 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:41 smithi086 ceph-mon[30110]: from='osd.8 ' entity='osd.8' 2024-05-12T11:03:41.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:41 smithi172 ceph-mon[34517]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:41.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:41 smithi172 ceph-mon[34517]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:03:41.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:41 smithi172 ceph-mon[34517]: osdmap e54: 9 total, 8 up, 9 in 2024-05-12T11:03:41.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:41 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:41.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:41 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:41.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:41 smithi172 ceph-mon[34517]: from='osd.8 ' entity='osd.8' 2024-05-12T11:03:42.457 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-12T11:03:42.458 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-12T11:03:42.458 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-05-12T11:03:42.458 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-05-12T11:03:42.458 INFO:teuthology.orchestra.run.smithi086.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011299 s, 928 MB/s 2024-05-12T11:03:42.458 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 2024-05-12T11:03:42.458 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-05-12T11:03:42.647 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:42 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:03:42.647 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:42 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:03:42.647 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:42 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:42.648 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:42 smithi176 ceph-mon[34357]: osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] boot 2024-05-12T11:03:42.648 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:42 smithi176 ceph-mon[34357]: osdmap e55: 9 total, 9 up, 9 in 2024-05-12T11:03:42.648 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:42 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:42.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:42 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:03:42.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:42 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:03:42.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:42 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:42.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:42 smithi086 ceph-mon[30110]: osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] boot 2024-05-12T11:03:42.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:42 smithi086 ceph-mon[30110]: osdmap e55: 9 total, 9 up, 9 in 2024-05-12T11:03:42.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:42 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:42.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:42 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:03:42.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:42 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:03:42.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:42 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:42.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:42 smithi172 ceph-mon[34517]: osd.8 [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] boot 2024-05-12T11:03:42.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:42 smithi172 ceph-mon[34517]: osdmap e55: 9 total, 9 up, 9 in 2024-05-12T11:03:42.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:42 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:03:43.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_1 2024-05-12T11:03:43.386 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:03:43.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: osdmap e56: 9 total, 9 up, 9 in 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: osdmap e56: 9 total, 9 up, 9 in 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: osdmap e56: 9 total, 9 up, 9 in 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:03:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:03:44.568 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:44 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi176 2024-05-12T11:03:44.568 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:44 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi176 to 5696M 2024-05-12T11:03:44.568 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:44 smithi086 ceph-mon[30110]: osdmap e57: 9 total, 9 up, 9 in 2024-05-12T11:03:44.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:44 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi176 2024-05-12T11:03:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:44 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi176 to 5696M 2024-05-12T11:03:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:44 smithi172 ceph-mon[34517]: osdmap e57: 9 total, 9 up, 9 in 2024-05-12T11:03:44.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:44 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi176 2024-05-12T11:03:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:44 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi176 to 5696M 2024-05-12T11:03:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:44 smithi176 ceph-mon[34357]: osdmap e57: 9 total, 9 up, 9 in 2024-05-12T11:03:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 -- 172.21.15.86:0/84596324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4102410 msgr2=0x7fdae4102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 --2- 172.21.15.86:0/84596324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4102410 0x7fdae4102830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdad80099c0 tx=0x7fdad8009cd0 comp rx=0 tx=0).stop 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 -- 172.21.15.86:0/84596324 shutdown_connections 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 --2- 172.21.15.86:0/84596324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4103fb0 0x7fdae410a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 --2- 172.21.15.86:0/84596324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4102410 0x7fdae4102830 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 --2- 172.21.15.86:0/84596324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae4103610 0x7fdae4103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 -- 172.21.15.86:0/84596324 >> 172.21.15.86:0/84596324 conn(0x7fdae40fd9d0 msgr2=0x7fdae40ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 -- 172.21.15.86:0/84596324 shutdown_connections 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.067+0000 7fdaeb964700 1 -- 172.21.15.86:0/84596324 wait complete. 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdaeb964700 1 Processor -- start 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdaeb964700 1 -- start start 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdaeb964700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4102410 0x7fdae4199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdaeb964700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4103610 0x7fdae4199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:03:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdaeb964700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae4103fb0 0x7fdae41a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdaeb964700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdae410df00 con 0x7fdae4103610 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdaeb964700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdae410dd80 con 0x7fdae4102410 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdaeb964700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdae410e080 con 0x7fdae4103fb0 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdae8eff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4103610 0x7fdae4199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdae8eff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4103610 0x7fdae4199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51632/0 (socket says 172.21.15.86:51632) 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdae8eff700 1 -- 172.21.15.86:0/2402826956 learned_addr learned my addr 172.21.15.86:0/2402826956 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.068+0000 7fdae9700700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4102410 0x7fdae4199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdae8eff700 1 -- 172.21.15.86:0/2402826956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae4103fb0 msgr2=0x7fdae41a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdae8eff700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae4103fb0 0x7fdae41a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdae8eff700 1 -- 172.21.15.86:0/2402826956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4102410 msgr2=0x7fdae4199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdae8eff700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4102410 0x7fdae4199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdae8eff700 1 -- 172.21.15.86:0/2402826956 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae41a1370 con 0x7fdae4103610 2024-05-12T11:03:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdae8eff700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4103610 0x7fdae4199c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdae000c950 tx=0x7fdae000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:03:45.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdad67fc700 1 -- 172.21.15.86:0/2402826956 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0007ac0 con 0x7fdae4103610 2024-05-12T11:03:45.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae41a1660 con 0x7fdae4103610 2024-05-12T11:03:45.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdad67fc700 1 -- 172.21.15.86:0/2402826956 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdae0004ce0 con 0x7fdae4103610 2024-05-12T11:03:45.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdad67fc700 1 -- 172.21.15.86:0/2402826956 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0005550 con 0x7fdae4103610 2024-05-12T11:03:45.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.069+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae41a1ba0 con 0x7fdae4103610 2024-05-12T11:03:45.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.070+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdae406a190 con 0x7fdae4103610 2024-05-12T11:03:45.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.071+0000 7fdad67fc700 1 -- 172.21.15.86:0/2402826956 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fdae0007c60 con 0x7fdae4103610 2024-05-12T11:03:45.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.072+0000 7fdad67fc700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdad00b2880 0x7fdad00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:03:45.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.072+0000 7fdae9700700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdad00b2880 0x7fdad00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:03:45.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.072+0000 7fdad67fc700 1 -- 172.21.15.86:0/2402826956 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7fdae00e1880 con 0x7fdae4103610 2024-05-12T11:03:45.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.072+0000 7fdae9700700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdad00b2880 0x7fdad00b4d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdad8000c00 tx=0x7fdad8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:03:45.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.076+0000 7fdad67fc700 1 -- 172.21.15.86:0/2402826956 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdae0014030 con 0x7fdae4103610 2024-05-12T11:03:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:03:45.289+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fdae406c330 con 0x7fdad00b2880 2024-05-12T11:03:45.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:45 smithi086 ceph-mon[30110]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:03:45.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:03:45.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:03:45.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:45.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:45 smithi172 ceph-mon[34517]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:03:45.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:03:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:03:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:45.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:45 smithi176 ceph-mon[34357]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:03:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:03:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:03:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:46.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:46 smithi086 ceph-mon[30110]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:03:46.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:46 smithi172 ceph-mon[34517]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:03:46.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:46 smithi176 ceph-mon[34357]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:03:47.424 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:47 smithi086 ceph-mon[30110]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:03:47.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:47 smithi172 ceph-mon[34517]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:03:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:47 smithi176 ceph-mon[34357]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:03:48.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:48 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4214614639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaaf5d21-ebd3-4757-b50c-531bf69652aa"}]: dispatch 2024-05-12T11:03:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:48 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4214614639' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aaaf5d21-ebd3-4757-b50c-531bf69652aa"}]': finished 2024-05-12T11:03:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:48 smithi086 ceph-mon[30110]: osdmap e58: 10 total, 9 up, 10 in 2024-05-12T11:03:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:03:48.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:48 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4214614639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaaf5d21-ebd3-4757-b50c-531bf69652aa"}]: dispatch 2024-05-12T11:03:48.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:48 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4214614639' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aaaf5d21-ebd3-4757-b50c-531bf69652aa"}]': finished 2024-05-12T11:03:48.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:48 smithi172 ceph-mon[34517]: osdmap e58: 10 total, 9 up, 10 in 2024-05-12T11:03:48.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:03:48.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:48 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4214614639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaaf5d21-ebd3-4757-b50c-531bf69652aa"}]: dispatch 2024-05-12T11:03:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:48 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4214614639' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aaaf5d21-ebd3-4757-b50c-531bf69652aa"}]': finished 2024-05-12T11:03:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:48 smithi176 ceph-mon[34357]: osdmap e58: 10 total, 9 up, 10 in 2024-05-12T11:03:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:03:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:49 smithi086 ceph-mon[30110]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-12T11:03:49.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:49 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4071625551' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:03:49.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:49 smithi172 ceph-mon[34517]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-12T11:03:49.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:49 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4071625551' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:03:49.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:49 smithi176 ceph-mon[34357]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-12T11:03:49.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:49 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4071625551' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:03:51.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:51 smithi086 ceph-mon[30110]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-12T11:03:51.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:51 smithi172 ceph-mon[34517]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-12T11:03:51.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:51 smithi176 ceph-mon[34357]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-12T11:03:53.593 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:53 smithi086 ceph-mon[30110]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-12T11:03:53.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:53 smithi172 ceph-mon[34517]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-12T11:03:53.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:53 smithi176 ceph-mon[34357]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-12T11:03:55.447 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:55 smithi086 ceph-mon[30110]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:03:55.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:55 smithi172 ceph-mon[34517]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:03:55.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:55 smithi176 ceph-mon[34357]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:03:56.677 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:56 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-12T11:03:56.677 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:56 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:56.677 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:56 smithi086 ceph-mon[30110]: Deploying daemon osd.9 on smithi086 2024-05-12T11:03:56.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:56 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-12T11:03:56.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:56 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:56.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:56 smithi172 ceph-mon[34517]: Deploying daemon osd.9 on smithi086 2024-05-12T11:03:56.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:56 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-12T11:03:56.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:56 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:03:56.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:56 smithi176 ceph-mon[34357]: Deploying daemon osd.9 on smithi086 2024-05-12T11:03:57.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:57 smithi086 ceph-mon[30110]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:03:57.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:57 smithi172 ceph-mon[34517]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:03:57.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:57 smithi176 ceph-mon[34357]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-12T11:03:59.642 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:03:59 smithi086 ceph-mon[30110]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:03:59.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:03:59 smithi172 ceph-mon[34517]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:03:59.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:03:59 smithi176 ceph-mon[34357]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:01.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:01 smithi086 ceph-mon[30110]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:01.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:01 smithi172 ceph-mon[34517]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:01.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:01 smithi176 ceph-mon[34357]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:03.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:03.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:03.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:03.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:03.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:03.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:03.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:03.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:03.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:04.120 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:03 smithi086 ceph-mon[30110]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:04.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:03 smithi172 ceph-mon[34517]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:04.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:03 smithi176 ceph-mon[34357]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:05.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.768+0000 7fdad67fc700 1 -- 172.21.15.86:0/2402826956 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdae406c330 con 0x7fdad00b2880 2024-05-12T11:04:05.760 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 9 on host 'smithi086' 2024-05-12T11:04:05.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdad00b2880 msgr2=0x7fdad00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:05.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdad00b2880 0x7fdad00b4d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdad8000c00 tx=0x7fdad8005fb0 comp rx=0 tx=0).stop 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4103610 msgr2=0x7fdae4199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4103610 0x7fdae4199c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdae000c950 tx=0x7fdae000cd10 comp rx=0 tx=0).stop 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 shutdown_connections 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdad00b2880 0x7fdad00b4d40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae4103fb0 0x7fdae41a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4102410 0x7fdae4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 --2- 172.21.15.86:0/2402826956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdae4103610 0x7fdae4199c50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 >> 172.21.15.86:0/2402826956 conn(0x7fdae40fd9d0 msgr2=0x7fdae406bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 shutdown_connections 2024-05-12T11:04:05.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:04:05.770+0000 7fdaeb964700 1 -- 172.21.15.86:0/2402826956 wait complete. 2024-05-12T11:04:05.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:05.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:06.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-12T11:04:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:06.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:06.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:06.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:06.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-12T11:04:06.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:06.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:06.557 DEBUG:teuthology.orchestra.run.smithi086:osd.9> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.9.service 2024-05-12T11:04:06.559 INFO:tasks.cephadm:Deploying osd.10 on smithi172 with /dev/vg_nvme/lv_1... 2024-05-12T11:04:06.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-12T11:04:06.806 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:04:07.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:06 smithi086 ceph-mon[30110]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-12T11:04:07.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:06 smithi086 ceph-mon[30110]: osdmap e59: 10 total, 9 up, 10 in 2024-05-12T11:04:07.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:06 smithi086 ceph-mon[30110]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:04:07.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:06 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:07.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:06 smithi086 ceph-mon[30110]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:07.213 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:04:06 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:04:06.975+0000 7fe789e3a700 -1 osd.9 0 waiting for initial osdmap 2024-05-12T11:04:07.213 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:04:06 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:04:06.988+0000 7fe785c2d700 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:04:07.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:06 smithi172 ceph-mon[34517]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-12T11:04:07.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:06 smithi172 ceph-mon[34517]: osdmap e59: 10 total, 9 up, 10 in 2024-05-12T11:04:07.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:06 smithi172 ceph-mon[34517]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:04:07.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:06 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:07.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:06 smithi172 ceph-mon[34517]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:07.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:06 smithi176 ceph-mon[34357]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-12T11:04:07.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:06 smithi176 ceph-mon[34357]: osdmap e59: 10 total, 9 up, 10 in 2024-05-12T11:04:07.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:06 smithi176 ceph-mon[34357]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-05-12T11:04:07.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:06 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:07.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:06 smithi176 ceph-mon[34357]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:08.176 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:07 smithi086 ceph-mon[30110]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:04:08.176 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:07 smithi086 ceph-mon[30110]: osdmap e60: 10 total, 9 up, 10 in 2024-05-12T11:04:08.177 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:08.177 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:07 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:08.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:07 smithi172 ceph-mon[34517]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:04:08.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:07 smithi172 ceph-mon[34517]: osdmap e60: 10 total, 9 up, 10 in 2024-05-12T11:04:08.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:08.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:07 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:08.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:07 smithi176 ceph-mon[34357]: from='osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-05-12T11:04:08.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:07 smithi176 ceph-mon[34357]: osdmap e60: 10 total, 9 up, 10 in 2024-05-12T11:04:08.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:08.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:07 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:08.830 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-12T11:04:08.830 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-12T11:04:08.831 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-12T11:04:08.831 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-12T11:04:08.831 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114873 s, 913 MB/s 2024-05-12T11:04:08.831 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-12T11:04:09.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:08 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:04:09.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:08 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:04:09.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:08 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:09.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:08 smithi172 ceph-mon[34517]: osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] boot 2024-05-12T11:04:09.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:08 smithi172 ceph-mon[34517]: osdmap e61: 10 total, 10 up, 10 in 2024-05-12T11:04:09.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:08 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:09.239 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:08 smithi172 ceph-mon[34517]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:09.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:08 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:04:09.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:08 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:04:09.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:08 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:09.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:08 smithi176 ceph-mon[34357]: osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] boot 2024-05-12T11:04:09.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:08 smithi176 ceph-mon[34357]: osdmap e61: 10 total, 10 up, 10 in 2024-05-12T11:04:09.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:08 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:09.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:08 smithi176 ceph-mon[34357]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:09.392 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:08 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:04:09.392 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:08 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:04:09.392 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:08 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:09.393 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:08 smithi086 ceph-mon[30110]: osd.9 [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] boot 2024-05-12T11:04:09.393 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:08 smithi086 ceph-mon[30110]: osdmap e61: 10 total, 10 up, 10 in 2024-05-12T11:04:09.393 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:08 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:04:09.393 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:08 smithi086 ceph-mon[30110]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-05-12T11:04:09.678 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-05-12T11:04:09.928 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:04:10.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: osdmap e62: 10 total, 10 up, 10 in 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:10.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: osdmap e62: 10 total, 10 up, 10 in 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:10.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: osdmap e62: 10 total, 10 up, 10 in 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:11.088 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:10 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi086 2024-05-12T11:04:11.089 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:10 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi086 to 4272M 2024-05-12T11:04:11.089 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:10 smithi172 ceph-mon[34517]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:11.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:10 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi086 2024-05-12T11:04:11.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:10 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi086 to 4272M 2024-05-12T11:04:11.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:10 smithi176 ceph-mon[34357]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:11.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:10 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi086 2024-05-12T11:04:11.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:10 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi086 to 4272M 2024-05-12T11:04:11.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:10 smithi086 ceph-mon[30110]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:11.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 -- 172.21.15.172:0/1984555426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc103fa0 msgr2=0x7f9edc10a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:11.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 --2- 172.21.15.172:0/1984555426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc103fa0 0x7f9edc10a850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400b0d0 tx=0x7f9ed400b3e0 comp rx=0 tx=0).stop 2024-05-12T11:04:11.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 -- 172.21.15.172:0/1984555426 shutdown_connections 2024-05-12T11:04:11.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 --2- 172.21.15.172:0/1984555426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc103fa0 0x7f9edc10a850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:11.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 --2- 172.21.15.172:0/1984555426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9edc102400 0x7f9edc102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 --2- 172.21.15.172:0/1984555426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9edc103600 0x7f9edc103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 -- 172.21.15.172:0/1984555426 >> 172.21.15.172:0/1984555426 conn(0x7f9edc0fd9a0 msgr2=0x7f9edc0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:04:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 -- 172.21.15.172:0/1984555426 shutdown_connections 2024-05-12T11:04:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.594+0000 7f9ee2720700 1 -- 172.21.15.172:0/1984555426 wait complete. 2024-05-12T11:04:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9ee2720700 1 Processor -- start 2024-05-12T11:04:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9ee2720700 1 -- start start 2024-05-12T11:04:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9ee2720700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc102400 0x7f9edc106340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9ee2720700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9edc103600 0x7f9edc1049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9ee2720700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9edc103fa0 0x7f9edc104f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9ee2720700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10de70 con 0x7f9edc103fa0 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9ee2720700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10dcf0 con 0x7f9edc102400 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9ee2720700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10dff0 con 0x7f9edc103600 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9edbfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc102400 0x7f9edc106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9edbfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc102400 0x7f9edc106340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35670/0 (socket says 172.21.15.172:35670) 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9edbfff700 1 -- 172.21.15.172:0/3886549105 learned_addr learned my addr 172.21.15.172:0/3886549105 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.595+0000 7f9edb7fe700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9edc103600 0x7f9edc1049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9ee0cbd700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9edc103fa0 0x7f9edc104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9edbfff700 1 -- 172.21.15.172:0/3886549105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9edc103600 msgr2=0x7f9edc1049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9edbfff700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9edc103600 0x7f9edc1049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9edbfff700 1 -- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9edc103fa0 msgr2=0x7f9edc104f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9edbfff700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9edc103fa0 0x7f9edc104f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9edbfff700 1 -- 172.21.15.172:0/3886549105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc1057f0 con 0x7f9edc102400 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9ee0cbd700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9edc103fa0 0x7f9edc104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9edbfff700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc102400 0x7f9edc106340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00d980 tx=0x7f9ecc00dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9ed97fa700 1 -- 172.21.15.172:0/3886549105 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc016070 con 0x7f9edc102400 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9ed97fa700 1 -- 172.21.15.172:0/3886549105 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ecc00bb60 con 0x7f9edc102400 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc1a3770 con 0x7f9edc102400 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9ed97fa700 1 -- 172.21.15.172:0/3886549105 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00f3c0 con 0x7f9edc102400 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.596+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc1a3c80 con 0x7f9edc102400 2024-05-12T11:04:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.597+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc06a190 con 0x7f9edc102400 2024-05-12T11:04:11.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.598+0000 7f9ed97fa700 1 -- 172.21.15.172:0/3886549105 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9ecc019070 con 0x7f9edc102400 2024-05-12T11:04:11.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.599+0000 7f9ed97fa700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ec40b2880 0x7f9ec40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:04:11.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.599+0000 7f9ed97fa700 1 -- 172.21.15.172:0/3886549105 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6261+0+0 (secure 0 0 0) 0x7f9ecc0e1a30 con 0x7f9edc102400 2024-05-12T11:04:11.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.599+0000 7f9edb7fe700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ec40b2880 0x7f9ec40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:04:11.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.600+0000 7f9edb7fe700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ec40b2880 0x7f9ec40b4d40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0005fd0 tx=0x7f9ed0005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:04:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.604+0000 7f9ed97fa700 1 -- 172.21.15.172:0/3886549105 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9ecc020020 con 0x7f9edc102400 2024-05-12T11:04:11.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:11.820+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9edc0ffbc0 con 0x7f9ec40b2880 2024-05-12T11:04:12.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:11 smithi172 ceph-mon[34517]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:04:12.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:04:12.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:04:12.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:12.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:11 smithi176 ceph-mon[34357]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:04:12.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:04:12.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:04:12.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:12.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:11 smithi086 ceph-mon[30110]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:04:12.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:04:12.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:04:12.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:13.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:13 smithi176 ceph-mon[34357]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:13.446 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:13 smithi172 ceph-mon[34517]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:13.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:13 smithi086 ceph-mon[30110]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:15.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:15 smithi086 ceph-mon[30110]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:15.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:15 smithi086 ceph-mon[30110]: from='client.? 172.21.15.172:0/2797112982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]: dispatch 2024-05-12T11:04:15.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:15 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]: dispatch 2024-05-12T11:04:15.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:15 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]': finished 2024-05-12T11:04:15.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:15 smithi086 ceph-mon[30110]: osdmap e63: 11 total, 10 up, 11 in 2024-05-12T11:04:15.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:15 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:15.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:15 smithi172 ceph-mon[34517]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:15.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:15 smithi172 ceph-mon[34517]: from='client.? 172.21.15.172:0/2797112982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]: dispatch 2024-05-12T11:04:15.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:15 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]: dispatch 2024-05-12T11:04:15.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:15 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]': finished 2024-05-12T11:04:15.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:15 smithi172 ceph-mon[34517]: osdmap e63: 11 total, 10 up, 11 in 2024-05-12T11:04:15.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:15 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:15.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:15 smithi176 ceph-mon[34357]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:15.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:15 smithi176 ceph-mon[34357]: from='client.? 172.21.15.172:0/2797112982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]: dispatch 2024-05-12T11:04:15.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:15 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]: dispatch 2024-05-12T11:04:15.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:15 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b"}]': finished 2024-05-12T11:04:15.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:15 smithi176 ceph-mon[34357]: osdmap e63: 11 total, 10 up, 11 in 2024-05-12T11:04:15.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:15 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:16.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:16 smithi086 ceph-mon[30110]: from='client.? 172.21.15.172:0/3673319290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:04:16.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:16 smithi172 ceph-mon[34517]: from='client.? 172.21.15.172:0/3673319290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:04:16.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:16 smithi176 ceph-mon[34357]: from='client.? 172.21.15.172:0/3673319290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:04:17.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:17 smithi086 ceph-mon[30110]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:17.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:17 smithi172 ceph-mon[34517]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:17.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:17 smithi176 ceph-mon[34357]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:19.191 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:19 smithi172 ceph-mon[34517]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:19.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:19 smithi086 ceph-mon[30110]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:19.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:19 smithi176 ceph-mon[34357]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:21.354 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:21 smithi172 ceph-mon[34517]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:21.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:21 smithi086 ceph-mon[30110]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:21.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:21 smithi176 ceph-mon[34357]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:23.123 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:23 smithi172 ceph-mon[34517]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:23.123 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:23 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-12T11:04:23.123 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:23 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:23.124 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:23 smithi172 ceph-mon[34517]: Deploying daemon osd.10 on smithi172 2024-05-12T11:04:23.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:23 smithi086 ceph-mon[30110]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:23.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:23 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-12T11:04:23.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:23 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:23.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:23 smithi086 ceph-mon[30110]: Deploying daemon osd.10 on smithi172 2024-05-12T11:04:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:23 smithi176 ceph-mon[34357]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:23.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:23 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-12T11:04:23.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:23 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:23.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:23 smithi176 ceph-mon[34357]: Deploying daemon osd.10 on smithi172 2024-05-12T11:04:25.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:25 smithi172 ceph-mon[34517]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:25.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:25 smithi086 ceph-mon[30110]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:25.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:25 smithi176 ceph-mon[34357]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:27.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:27 smithi086 ceph-mon[30110]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:27.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:27 smithi172 ceph-mon[34517]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:27.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:27 smithi176 ceph-mon[34357]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:29.167 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:29 smithi172 ceph-mon[34517]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:29.167 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:29.167 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:29.167 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:29.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:29 smithi086 ceph-mon[30110]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:29.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:29.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:29.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:29.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:29 smithi176 ceph-mon[34357]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:31.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:31 smithi172 ceph-mon[34517]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:31.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:31 smithi086 ceph-mon[30110]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:31.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:31 smithi176 ceph-mon[34357]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:31.778 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 10 on host 'smithi172' 2024-05-12T11:04:31.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.786+0000 7f9ed97fa700 1 -- 172.21.15.172:0/3886549105 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9edc0ffbc0 con 0x7f9ec40b2880 2024-05-12T11:04:31.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ec40b2880 msgr2=0x7f9ec40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:31.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ec40b2880 0x7f9ec40b4d40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0005fd0 tx=0x7f9ed0005db0 comp rx=0 tx=0).stop 2024-05-12T11:04:31.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc102400 msgr2=0x7f9edc106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:31.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc102400 0x7f9edc106340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00d980 tx=0x7f9ecc00dd40 comp rx=0 tx=0).stop 2024-05-12T11:04:31.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 shutdown_connections 2024-05-12T11:04:31.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ec40b2880 0x7f9ec40b4d40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:31.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9edc103fa0 0x7f9edc104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:31.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9edc102400 0x7f9edc106340 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:31.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 --2- 172.21.15.172:0/3886549105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9edc103600 0x7f9edc1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:31.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 >> 172.21.15.172:0/3886549105 conn(0x7f9edc0fd9a0 msgr2=0x7f9edc0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:04:31.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 shutdown_connections 2024-05-12T11:04:31.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-12T11:04:31.789+0000 7f9ee2720700 1 -- 172.21.15.172:0/3886549105 wait complete. 2024-05-12T11:04:32.456 DEBUG:teuthology.orchestra.run.smithi172:osd.10> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.10.service 2024-05-12T11:04:32.459 INFO:tasks.cephadm:Deploying osd.11 on smithi176 with /dev/vg_nvme/lv_1... 2024-05-12T11:04:32.459 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-12T11:04:32.706 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:04:33.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:32 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:32 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:32 smithi176 ceph-mon[34357]: from='osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-12T11:04:33.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:32 smithi176 ceph-mon[34357]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-12T11:04:33.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:32 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:32 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:32 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:32 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:32 smithi086 ceph-mon[30110]: from='osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-12T11:04:33.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:32 smithi086 ceph-mon[30110]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-12T11:04:33.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:32 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:32 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:32 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:32 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:32 smithi172 ceph-mon[34517]: from='osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-12T11:04:33.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:32 smithi172 ceph-mon[34517]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-12T11:04:33.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:32 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:33.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:32 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:34.087 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:33 smithi176 ceph-mon[34357]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:34.087 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:33 smithi176 ceph-mon[34357]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-12T11:04:34.087 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:33 smithi176 ceph-mon[34357]: osdmap e64: 11 total, 10 up, 11 in 2024-05-12T11:04:34.087 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:33 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:34.087 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:33 smithi176 ceph-mon[34357]: from='osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:04:34.087 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:33 smithi176 ceph-mon[34357]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:04:34.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:33 smithi172 ceph-mon[34517]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:34.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:33 smithi172 ceph-mon[34517]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-12T11:04:34.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:33 smithi172 ceph-mon[34517]: osdmap e64: 11 total, 10 up, 11 in 2024-05-12T11:04:34.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:33 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:34.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:33 smithi172 ceph-mon[34517]: from='osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:04:34.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:33 smithi172 ceph-mon[34517]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:04:34.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:33 smithi086 ceph-mon[30110]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:34.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:33 smithi086 ceph-mon[30110]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-12T11:04:34.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:33 smithi086 ceph-mon[30110]: osdmap e64: 11 total, 10 up, 11 in 2024-05-12T11:04:34.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:33 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:34.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:33 smithi086 ceph-mon[30110]: from='osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:04:34.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:33 smithi086 ceph-mon[30110]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-12T11:04:34.448 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:04:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:04:34.185+0000 7f44ee21f700 -1 osd.10 0 waiting for initial osdmap 2024-05-12T11:04:34.448 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:04:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:04:34.199+0000 7f44e600a700 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:04:34.779 INFO:teuthology.orchestra.run.smithi176.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-12T11:04:34.779 INFO:teuthology.orchestra.run.smithi176.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-12T11:04:34.779 INFO:teuthology.orchestra.run.smithi176.stderr: stderr: 10+0 records in 2024-05-12T11:04:34.779 INFO:teuthology.orchestra.run.smithi176.stderr:10+0 records out 2024-05-12T11:04:34.779 INFO:teuthology.orchestra.run.smithi176.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117305 s, 894 MB/s 2024-05-12T11:04:34.779 INFO:teuthology.orchestra.run.smithi176.stderr:--> Zapping successful for: 2024-05-12T11:04:35.117 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:34 smithi176 ceph-mon[34357]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:04:35.117 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:34 smithi176 ceph-mon[34357]: osdmap e65: 11 total, 10 up, 11 in 2024-05-12T11:04:35.117 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.117 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.117 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:34 smithi176 ceph-mon[34357]: from='osd.10 ' entity='osd.10' 2024-05-12T11:04:35.118 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:34 smithi176 ceph-mon[34357]: osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] boot 2024-05-12T11:04:35.118 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:34 smithi176 ceph-mon[34357]: osdmap e66: 11 total, 11 up, 11 in 2024-05-12T11:04:35.118 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:34 smithi086 ceph-mon[30110]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:04:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:34 smithi086 ceph-mon[30110]: osdmap e65: 11 total, 10 up, 11 in 2024-05-12T11:04:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:34 smithi086 ceph-mon[30110]: from='osd.10 ' entity='osd.10' 2024-05-12T11:04:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:34 smithi086 ceph-mon[30110]: osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] boot 2024-05-12T11:04:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:34 smithi086 ceph-mon[30110]: osdmap e66: 11 total, 11 up, 11 in 2024-05-12T11:04:35.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:34 smithi172 ceph-mon[34517]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-12T11:04:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:34 smithi172 ceph-mon[34517]: osdmap e65: 11 total, 10 up, 11 in 2024-05-12T11:04:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:34 smithi172 ceph-mon[34517]: from='osd.10 ' entity='osd.10' 2024-05-12T11:04:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:34 smithi172 ceph-mon[34517]: osd.10 [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] boot 2024-05-12T11:04:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:34 smithi172 ceph-mon[34517]: osdmap e66: 11 total, 11 up, 11 in 2024-05-12T11:04:35.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:04:35.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi176:vg_nvme/lv_1 2024-05-12T11:04:35.816 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:04:35.938 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:35 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:04:35.938 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:35 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:04:35.938 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:35 smithi176 ceph-mon[34357]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:35.938 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:35 smithi176 ceph-mon[34357]: osdmap e67: 11 total, 11 up, 11 in 2024-05-12T11:04:35.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:35 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:04:35.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:35 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:04:35.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:35 smithi172 ceph-mon[34517]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:35.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:35 smithi172 ceph-mon[34517]: osdmap e67: 11 total, 11 up, 11 in 2024-05-12T11:04:36.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:35 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:04:36.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:35 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:04:36.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:35 smithi086 ceph-mon[30110]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-12T11:04:36.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:35 smithi086 ceph-mon[30110]: osdmap e67: 11 total, 11 up, 11 in 2024-05-12T11:04:37.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 -- 172.21.15.176:0/895708047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dfc102410 msgr2=0x7f1dfc102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 --2- 172.21.15.176:0/895708047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dfc102410 0x7f1dfc102830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009990 tx=0x7f1dec009ca0 comp rx=0 tx=0).stop 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 -- 172.21.15.176:0/895708047 shutdown_connections 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 --2- 172.21.15.176:0/895708047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc103fb0 0x7f1dfc10a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 --2- 172.21.15.176:0/895708047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dfc102410 0x7f1dfc102830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 --2- 172.21.15.176:0/895708047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dfc103610 0x7f1dfc103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 -- 172.21.15.176:0/895708047 >> 172.21.15.176:0/895708047 conn(0x7f1dfc0fd9d0 msgr2=0x7f1dfc0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 -- 172.21.15.176:0/895708047 shutdown_connections 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 -- 172.21.15.176:0/895708047 wait complete. 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 Processor -- start 2024-05-12T11:04:37.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 -- start start 2024-05-12T11:04:37.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.516+0000 7f1e022e5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc102410 0x7f1dfc1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:04:37.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e022e5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dfc103610 0x7f1dfc1049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:04:37.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e022e5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dfc103fb0 0x7f1dfc104f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:04:37.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e022e5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10de80 con 0x7f1dfc102410 2024-05-12T11:04:37.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e022e5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10dd00 con 0x7f1dfc103fb0 2024-05-12T11:04:37.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e022e5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10e000 con 0x7f1dfc103610 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfb7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dfc103610 0x7f1dfc1049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc102410 0x7f1dfc1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc102410 0x7f1dfc1063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.176:47646/0 (socket says 172.21.15.176:47646) 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 -- 172.21.15.176:0/4107034641 learned_addr learned my addr 172.21.15.176:0/4107034641 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e00882700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dfc103fb0 0x7f1dfc104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 -- 172.21.15.176:0/4107034641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dfc103610 msgr2=0x7f1dfc1049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dfc103610 0x7f1dfc1049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 -- 172.21.15.176:0/4107034641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dfc103fb0 msgr2=0x7f1dfc104f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dfc103fb0 0x7f1dfc104f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 -- 172.21.15.176:0/4107034641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc1057e0 con 0x7f1dfc102410 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e00882700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dfc103fb0 0x7f1dfc104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:04:37.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1dfbfff700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc102410 0x7f1dfc1063a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1dec006010 tx=0x7f1dec0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:04:37.512 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1df97fa700 1 -- 172.21.15.176:0/4107034641 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec027070 con 0x7f1dfc102410 2024-05-12T11:04:37.512 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc1a3790 con 0x7f1dfc102410 2024-05-12T11:04:37.512 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1df97fa700 1 -- 172.21.15.176:0/4107034641 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dec004080 con 0x7f1dfc102410 2024-05-12T11:04:37.512 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1df97fa700 1 -- 172.21.15.176:0/4107034641 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec022dd0 con 0x7f1dfc102410 2024-05-12T11:04:37.512 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.517+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1a3be0 con 0x7f1dfc102410 2024-05-12T11:04:37.512 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.518+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc06a190 con 0x7f1dfc102410 2024-05-12T11:04:37.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.520+0000 7f1df97fa700 1 -- 172.21.15.176:0/4107034641 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1dec02a070 con 0x7f1dfc102410 2024-05-12T11:04:37.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.521+0000 7f1df97fa700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1de40b2880 0x7f1de40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:04:37.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.521+0000 7f1dfb7fe700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1de40b2880 0x7f1de40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:04:37.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.521+0000 7f1df97fa700 1 -- 172.21.15.176:0/4107034641 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6694+0+0 (secure 0 0 0) 0x7f1dec0e3120 con 0x7f1dfc102410 2024-05-12T11:04:37.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.521+0000 7f1dfb7fe700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1de40b2880 0x7f1de40b4d40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1df000ac50 tx=0x7f1df000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:04:37.518 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.527+0000 7f1df97fa700 1 -- 172.21.15.176:0/4107034641 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1dec031020 con 0x7f1dfc102410 2024-05-12T11:04:37.740 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:37.748+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1dfc06c300 con 0x7f1de40b2880 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: osdmap e68: 11 total, 11 up, 11 in 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi172 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:37.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:37.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:37.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:37.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:37.964 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:37.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: osdmap e68: 11 total, 11 up, 11 in 2024-05-12T11:04:37.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi172 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:37.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:37.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:37.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: osdmap e68: 11 total, 11 up, 11 in 2024-05-12T11:04:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi172 2024-05-12T11:04:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:38.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:38.018 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:38.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:38 smithi086 ceph-mon[30110]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:04:38.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:38 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:04:38.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:38 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:04:38.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:38 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:38.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:38 smithi172 ceph-mon[34517]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:04:38.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:04:38.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:04:38.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:38 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:39.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:38 smithi176 ceph-mon[34357]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:04:39.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:38 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-12T11:04:39.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:38 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-12T11:04:39.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:38 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:39.916 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:39 smithi176 ceph-mon[34357]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-12T11:04:39.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:39 smithi086 ceph-mon[30110]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-12T11:04:39.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:39 smithi172 ceph-mon[34517]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-12T11:04:40.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:40 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/3043131889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]: dispatch 2024-05-12T11:04:40.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:40 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]: dispatch 2024-05-12T11:04:40.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:40 smithi086 ceph-mon[30110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]': finished 2024-05-12T11:04:40.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:40 smithi086 ceph-mon[30110]: osdmap e69: 12 total, 11 up, 12 in 2024-05-12T11:04:40.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:40 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:04:40.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:40 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/3043131889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]: dispatch 2024-05-12T11:04:40.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:40 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]: dispatch 2024-05-12T11:04:40.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:40 smithi172 ceph-mon[34517]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]': finished 2024-05-12T11:04:40.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:40 smithi172 ceph-mon[34517]: osdmap e69: 12 total, 11 up, 12 in 2024-05-12T11:04:40.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:40 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:04:41.004 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:40 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/3043131889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]: dispatch 2024-05-12T11:04:41.004 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:40 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]: dispatch 2024-05-12T11:04:41.004 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:40 smithi176 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "daa12269-209c-4940-adcf-129c9470f578"}]': finished 2024-05-12T11:04:41.004 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:40 smithi176 ceph-mon[34357]: osdmap e69: 12 total, 11 up, 12 in 2024-05-12T11:04:41.004 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:40 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:04:41.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:41 smithi086 ceph-mon[30110]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-12T11:04:41.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:41 smithi086 ceph-mon[30110]: from='client.? 172.21.15.176:0/722791450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:04:41.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:41 smithi172 ceph-mon[34517]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-12T11:04:41.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:41 smithi172 ceph-mon[34517]: from='client.? 172.21.15.176:0/722791450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:04:42.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:41 smithi176 ceph-mon[34357]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-12T11:04:42.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:41 smithi176 ceph-mon[34357]: from='client.? 172.21.15.176:0/722791450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-12T11:04:43.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:43 smithi086 ceph-mon[30110]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-12T11:04:43.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:43 smithi172 ceph-mon[34517]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-12T11:04:44.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:43 smithi176 ceph-mon[34357]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-12T11:04:45.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:45 smithi176 ceph-mon[34357]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-12T11:04:45.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:45 smithi086 ceph-mon[30110]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-12T11:04:45.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:45 smithi172 ceph-mon[34517]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-12T11:04:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:47 smithi176 ceph-mon[34357]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-12T11:04:47.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:47 smithi086 ceph-mon[30110]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-12T11:04:47.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:47 smithi172 ceph-mon[34517]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-12T11:04:48.952 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-12T11:04:48.953 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:48.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-12T11:04:48.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:48.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-12T11:04:48.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:49.944 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:49 smithi176 ceph-mon[34357]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:49.945 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:49 smithi176 ceph-mon[34357]: Deploying daemon osd.11 on smithi176 2024-05-12T11:04:49.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:49 smithi086 ceph-mon[30110]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:49.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:49 smithi086 ceph-mon[30110]: Deploying daemon osd.11 on smithi176 2024-05-12T11:04:49.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:49 smithi172 ceph-mon[34517]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:49.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:49 smithi172 ceph-mon[34517]: Deploying daemon osd.11 on smithi176 2024-05-12T11:04:51.922 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:51 smithi176 ceph-mon[34357]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:51.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:51 smithi086 ceph-mon[30110]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:51.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:51 smithi172 ceph-mon[34517]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:53.954 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:53 smithi176 ceph-mon[34357]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:53.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:53 smithi086 ceph-mon[30110]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:53.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:53 smithi172 ceph-mon[34517]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:55.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:55 smithi086 ceph-mon[30110]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:55.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:55.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:55.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:55.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:55 smithi172 ceph-mon[34517]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:55.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:55.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:55.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:55.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:55 smithi176 ceph-mon[34357]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:55.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:55.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:55.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:57.475 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:57 smithi176 ceph-mon[34357]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:57.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:57 smithi086 ceph-mon[30110]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:57.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:57 smithi172 ceph-mon[34517]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:58.255 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 11 on host 'smithi176' 2024-05-12T11:04:58.255 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.263+0000 7f1df97fa700 1 -- 172.21.15.176:0/4107034641 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1dfc06c300 con 0x7f1de40b2880 2024-05-12T11:04:58.257 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1de40b2880 msgr2=0x7f1de40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:58.257 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1de40b2880 0x7f1de40b4d40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1df000ac50 tx=0x7f1df000a380 comp rx=0 tx=0).stop 2024-05-12T11:04:58.257 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc102410 msgr2=0x7f1dfc1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:04:58.257 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc102410 0x7f1dfc1063a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1dec006010 tx=0x7f1dec0057c0 comp rx=0 tx=0).stop 2024-05-12T11:04:58.258 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 shutdown_connections 2024-05-12T11:04:58.258 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1de40b2880 0x7f1de40b4d40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:58.258 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dfc103fb0 0x7f1dfc104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:58.258 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc102410 0x7f1dfc1063a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:58.258 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 --2- 172.21.15.176:0/4107034641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dfc103610 0x7f1dfc1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:04:58.258 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 >> 172.21.15.176:0/4107034641 conn(0x7f1dfc0fd9d0 msgr2=0x7f1dfc06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:04:58.258 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 shutdown_connections 2024-05-12T11:04:58.258 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:04:58.266+0000 7f1e022e5700 1 -- 172.21.15.176:0/4107034641 wait complete. 2024-05-12T11:04:58.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:58.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:58.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:04:58.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:04:58.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-12T11:04:58.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-12T11:04:58.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:04:58.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:04:58.912 DEBUG:teuthology.orchestra.run.smithi176:osd.11> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.11.service 2024-05-12T11:04:58.915 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-12T11:04:58.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd stat -f json 2024-05-12T11:04:59.169 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:04:59.517 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:04:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:04:59.382+0000 7f5ac890e700 -1 osd.11 0 waiting for initial osdmap 2024-05-12T11:04:59.517 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:04:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:04:59.393+0000 7f5ac4701700 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T11:04:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:59 smithi176 ceph-mon[34357]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:59 smithi176 ceph-mon[34357]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-12T11:04:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:59 smithi176 ceph-mon[34357]: from='osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:04:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:59 smithi176 ceph-mon[34357]: osdmap e70: 12 total, 11 up, 12 in 2024-05-12T11:04:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:59 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:04:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:04:59 smithi176 ceph-mon[34357]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:04:59.543 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:59 smithi086 ceph-mon[30110]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:59.543 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:59 smithi086 ceph-mon[30110]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-12T11:04:59.543 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:59 smithi086 ceph-mon[30110]: from='osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:04:59.543 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:59 smithi086 ceph-mon[30110]: osdmap e70: 12 total, 11 up, 12 in 2024-05-12T11:04:59.543 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:59 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:04:59.543 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:04:59 smithi086 ceph-mon[30110]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:04:59.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:59 smithi172 ceph-mon[34517]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:04:59.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:59 smithi172 ceph-mon[34517]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-12T11:04:59.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:59 smithi172 ceph-mon[34517]: from='osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:04:59.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:59 smithi172 ceph-mon[34517]: osdmap e70: 12 total, 11 up, 12 in 2024-05-12T11:04:59.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:59 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:04:59.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:04:59 smithi172 ceph-mon[34517]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-05-12T11:05:00.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:00 smithi086 ceph-mon[30110]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:05:00.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:00 smithi086 ceph-mon[30110]: osdmap e71: 12 total, 11 up, 12 in 2024-05-12T11:05:00.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:00.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:00.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:00 smithi172 ceph-mon[34517]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:05:00.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:00 smithi172 ceph-mon[34517]: osdmap e71: 12 total, 11 up, 12 in 2024-05-12T11:05:00.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:00.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:00.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:00 smithi176 ceph-mon[34357]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-05-12T11:05:00.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:00 smithi176 ceph-mon[34357]: osdmap e71: 12 total, 11 up, 12 in 2024-05-12T11:05:00.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:00.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 -- 172.21.15.86:0/1684461722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401046f0 msgr2=0x7f4d40104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:00.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 --2- 172.21.15.86:0/1684461722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401046f0 0x7f4d40104b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4d280099c0 tx=0x7f4d28009cd0 comp rx=0 tx=0).stop 2024-05-12T11:05:00.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 -- 172.21.15.86:0/1684461722 shutdown_connections 2024-05-12T11:05:00.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 --2- 172.21.15.86:0/1684461722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d40105090 0x7f4d4010b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:00.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 --2- 172.21.15.86:0/1684461722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d401034f0 0x7f4d40103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:00.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 --2- 172.21.15.86:0/1684461722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401046f0 0x7f4d40104b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:00.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 -- 172.21.15.86:0/1684461722 >> 172.21.15.86:0/1684461722 conn(0x7f4d400fea90 msgr2=0x7f4d40100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:00.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 -- 172.21.15.86:0/1684461722 shutdown_connections 2024-05-12T11:05:00.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.972+0000 7f4d45a81700 1 -- 172.21.15.86:0/1684461722 wait complete. 2024-05-12T11:05:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d45a81700 1 Processor -- start 2024-05-12T11:05:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d45a81700 1 -- start start 2024-05-12T11:05:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d45a81700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401034f0 0x7f4d401996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d45a81700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d401046f0 0x7f4d40199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d45a81700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d40105090 0x7f4d401a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d45a81700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4010f030 con 0x7f4d401034f0 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d45a81700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4010eeb0 con 0x7f4d40105090 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d45a81700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4010f1b0 con 0x7f4d401046f0 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401034f0 0x7f4d401996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401034f0 0x7f4d401996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50802/0 (socket says 172.21.15.86:50802) 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d3f7fe700 1 -- 172.21.15.86:0/195315607 learned_addr learned my addr 172.21.15.86:0/195315607 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.973+0000 7f4d3effd700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d401046f0 0x7f4d40199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3f7fe700 1 -- 172.21.15.86:0/195315607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d401046f0 msgr2=0x7f4d40199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3f7fe700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d401046f0 0x7f4d40199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3f7fe700 1 -- 172.21.15.86:0/195315607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d40105090 msgr2=0x7f4d401a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3f7fe700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d40105090 0x7f4d401a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3f7fe700 1 -- 172.21.15.86:0/195315607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d401a1330 con 0x7f4d401034f0 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3f7fe700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401034f0 0x7f4d401996d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800d9b0 tx=0x7f4d3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3cff9700 1 -- 172.21.15.86:0/195315607 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38017030 con 0x7f4d401034f0 2024-05-12T11:05:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d401a1620 con 0x7f4d401034f0 2024-05-12T11:05:00.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3cff9700 1 -- 172.21.15.86:0/195315607 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d380044d0 con 0x7f4d401034f0 2024-05-12T11:05:00.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d3cff9700 1 -- 172.21.15.86:0/195315607 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d380039e0 con 0x7f4d401034f0 2024-05-12T11:05:00.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.974+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d401a1bb0 con 0x7f4d401034f0 2024-05-12T11:05:00.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.975+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4006a190 con 0x7f4d401034f0 2024-05-12T11:05:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.976+0000 7f4d3cff9700 1 -- 172.21.15.86:0/195315607 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4d3801a070 con 0x7f4d401034f0 2024-05-12T11:05:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.977+0000 7f4d3cff9700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4d2c0b2880 0x7f4d2c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.977+0000 7f4d3effd700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4d2c0b2880 0x7f4d2c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.977+0000 7f4d3cff9700 1 -- 172.21.15.86:0/195315607 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f4d380e1720 con 0x7f4d401034f0 2024-05-12T11:05:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.977+0000 7f4d3effd700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4d2c0b2880 0x7f4d2c0b4d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d28006010 tx=0x7f4d28003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:00.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:00.981+0000 7f4d3cff9700 1 -- 172.21.15.86:0/195315607 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4d380a98e0 con 0x7f4d401034f0 2024-05-12T11:05:01.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.184+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4d400640b0 con 0x7f4d401034f0 2024-05-12T11:05:01.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.185+0000 7f4d3cff9700 1 -- 172.21.15.86:0/195315607 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f4d380a91e0 con 0x7f4d401034f0 2024-05-12T11:05:01.176 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4d2c0b2880 msgr2=0x7f4d2c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4d2c0b2880 0x7f4d2c0b4d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d28006010 tx=0x7f4d28003860 comp rx=0 tx=0).stop 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401034f0 msgr2=0x7f4d401996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401034f0 0x7f4d401996d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800d9b0 tx=0x7f4d3800dcc0 comp rx=0 tx=0).stop 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 shutdown_connections 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4d2c0b2880 0x7f4d2c0b4d40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d40105090 0x7f4d401a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d401034f0 0x7f4d401996d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 --2- 172.21.15.86:0/195315607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d401046f0 0x7f4d40199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:01.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 >> 172.21.15.86:0/195315607 conn(0x7f4d400fea90 msgr2=0x7f4d40107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:01.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.187+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 shutdown_connections 2024-05-12T11:05:01.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:01.188+0000 7f4d45a81700 1 -- 172.21.15.86:0/195315607 wait complete. 2024-05-12T11:05:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:01 smithi176 ceph-mon[34357]: purged_snaps scrub starts 2024-05-12T11:05:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:01 smithi176 ceph-mon[34357]: purged_snaps scrub ok 2024-05-12T11:05:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:01 smithi176 ceph-mon[34357]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:05:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:01 smithi176 ceph-mon[34357]: osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] boot 2024-05-12T11:05:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:01 smithi176 ceph-mon[34357]: osdmap e72: 12 total, 12 up, 12 in 2024-05-12T11:05:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:01 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:01 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/195315607' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-12T11:05:01.644 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:01 smithi086 ceph-mon[30110]: purged_snaps scrub starts 2024-05-12T11:05:01.644 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:01 smithi086 ceph-mon[30110]: purged_snaps scrub ok 2024-05-12T11:05:01.644 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:01 smithi086 ceph-mon[30110]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:05:01.645 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:01.645 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:01 smithi086 ceph-mon[30110]: osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] boot 2024-05-12T11:05:01.645 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:01 smithi086 ceph-mon[30110]: osdmap e72: 12 total, 12 up, 12 in 2024-05-12T11:05:01.645 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:01 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:01.645 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:01 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/195315607' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-12T11:05:01.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:01 smithi172 ceph-mon[34517]: purged_snaps scrub starts 2024-05-12T11:05:01.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:01 smithi172 ceph-mon[34517]: purged_snaps scrub ok 2024-05-12T11:05:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:01 smithi172 ceph-mon[34517]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-05-12T11:05:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:01 smithi172 ceph-mon[34517]: osd.11 [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] boot 2024-05-12T11:05:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:01 smithi172 ceph-mon[34517]: osdmap e72: 12 total, 12 up, 12 in 2024-05-12T11:05:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:01 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:05:01.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:01 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/195315607' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-12T11:05:01.900 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1715511900,"num_in_osds":12,"osd_in_since":1715511880,"num_remapped_pgs":0} 2024-05-12T11:05:01.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:05:02.154 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:02.529 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: osdmap e73: 12 total, 12 up, 12 in 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:02.530 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: osdmap e73: 12 total, 12 up, 12 in 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:02.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: osdmap e73: 12 total, 12 up, 12 in 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:02.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:03.591 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:03 smithi086 ceph-mon[30110]: Detected new or changed devices on smithi176 2024-05-12T11:05:03.591 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:03 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi176 to 4272M 2024-05-12T11:05:03.591 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:03 smithi086 ceph-mon[30110]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:03.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:03 smithi172 ceph-mon[34517]: Detected new or changed devices on smithi176 2024-05-12T11:05:03.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:03 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi176 to 4272M 2024-05-12T11:05:03.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:03 smithi172 ceph-mon[34517]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:03.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:03 smithi176 ceph-mon[34357]: Detected new or changed devices on smithi176 2024-05-12T11:05:03.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:03 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi176 to 4272M 2024-05-12T11:05:03.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:03 smithi176 ceph-mon[34357]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:03.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.830+0000 7fe570247700 1 -- 172.21.15.86:0/3544206255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102630 msgr2=0x7fe568102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:03.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.830+0000 7fe570247700 1 --2- 172.21.15.86:0/3544206255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102630 0x7fe568102a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5640099c0 tx=0x7fe564009cd0 comp rx=0 tx=0).stop 2024-05-12T11:05:03.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 -- 172.21.15.86:0/3544206255 shutdown_connections 2024-05-12T11:05:03.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 --2- 172.21.15.86:0/3544206255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5681076c0 0x7fe56810f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:03.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 --2- 172.21.15.86:0/3544206255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102630 0x7fe568102a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:03.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 --2- 172.21.15.86:0/3544206255 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe568102fe0 0x7fe568106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 -- 172.21.15.86:0/3544206255 >> 172.21.15.86:0/3544206255 conn(0x7fe568079370 msgr2=0x7fe568079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 -- 172.21.15.86:0/3544206255 shutdown_connections 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 -- 172.21.15.86:0/3544206255 wait complete. 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 Processor -- start 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 -- start start 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.831+0000 7fe570247700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe568102630 0x7fe56819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe570247700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102fe0 0x7fe56819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe570247700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5681076c0 0x7fe568199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe570247700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681136c0 con 0x7fe568102fe0 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe570247700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe568113540 con 0x7fe5681076c0 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe570247700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe568113840 con 0x7fe568102630 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102fe0 0x7fe56819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102fe0 0x7fe56819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55902/0 (socket says 172.21.15.86:55902) 2024-05-12T11:05:03.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 -- 172.21.15.86:0/3653503551 learned_addr learned my addr 172.21.15.86:0/3653503551 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56e7e4700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5681076c0 0x7fe568199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56dfe3700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe568102630 0x7fe56819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 -- 172.21.15.86:0/3653503551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe568102630 msgr2=0x7fe56819f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe568102630 0x7fe56819f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 -- 172.21.15.86:0/3653503551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5681076c0 msgr2=0x7fe568199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5681076c0 0x7fe568199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 -- 172.21.15.86:0/3653503551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56819a180 con 0x7fe568102fe0 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56dfe3700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe568102630 0x7fe56819f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe56d7e2700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102fe0 0x7fe56819fda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c970 tx=0x7fe55800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe55effd700 1 -- 172.21.15.86:0/3653503551 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55800ce60 con 0x7fe568102fe0 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56819a470 con 0x7fe568102fe0 2024-05-12T11:05:03.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe55effd700 1 -- 172.21.15.86:0/3653503551 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe558004830 con 0x7fe568102fe0 2024-05-12T11:05:03.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe55effd700 1 -- 172.21.15.86:0/3653503551 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558005530 con 0x7fe568102fe0 2024-05-12T11:05:03.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.832+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5681a6730 con 0x7fe568102fe0 2024-05-12T11:05:03.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.834+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56806a190 con 0x7fe568102fe0 2024-05-12T11:05:03.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.836+0000 7fe55effd700 1 -- 172.21.15.86:0/3653503551 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe5580049e0 con 0x7fe568102fe0 2024-05-12T11:05:03.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.836+0000 7fe55effd700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe5540b2880 0x7fe5540b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:03.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.836+0000 7fe56dfe3700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe5540b2880 0x7fe5540b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:03.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.837+0000 7fe55effd700 1 -- 172.21.15.86:0/3653503551 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe5580e1d40 con 0x7fe568102fe0 2024-05-12T11:05:03.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.837+0000 7fe56dfe3700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe5540b2880 0x7fe5540b4d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe564000c00 tx=0x7fe564005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:03.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:03.840+0000 7fe55effd700 1 -- 172.21.15.86:0/3653503551 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe558014030 con 0x7fe568102fe0 2024-05-12T11:05:04.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.044+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe56819af50 con 0x7fe568102fe0 2024-05-12T11:05:04.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.045+0000 7fe55effd700 1 -- 172.21.15.86:0/3653503551 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18456 (secure 0 0 0) 0x7fe5580a9f00 con 0x7fe568102fe0 2024-05-12T11:05:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:04.037 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":73,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:05:01.386386+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:05:04.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.047+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe5540b2880 msgr2=0x7fe5540b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:04.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.047+0000 7fe570247700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe5540b2880 0x7fe5540b4d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe564000c00 tx=0x7fe564005fb0 comp rx=0 tx=0).stop 2024-05-12T11:05:04.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.047+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102fe0 msgr2=0x7fe56819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:04.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.047+0000 7fe570247700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102fe0 0x7fe56819fda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c970 tx=0x7fe55800cc80 comp rx=0 tx=0).stop 2024-05-12T11:05:04.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.048+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 shutdown_connections 2024-05-12T11:05:04.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.048+0000 7fe570247700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe5540b2880 0x7fe5540b4d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:04.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.048+0000 7fe570247700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5681076c0 0x7fe568199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:04.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.048+0000 7fe570247700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe568102630 0x7fe56819f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:04.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.048+0000 7fe570247700 1 --2- 172.21.15.86:0/3653503551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe568102fe0 0x7fe56819fda0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:04.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.048+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 >> 172.21.15.86:0/3653503551 conn(0x7fe568079370 msgr2=0x7fe568100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:04.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.048+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 shutdown_connections 2024-05-12T11:05:04.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:04.048+0000 7fe570247700 1 -- 172.21.15.86:0/3653503551 wait complete. 2024-05-12T11:05:04.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:04 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3653503551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:05:04.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:04 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3653503551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:05:04.764 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-12T11:01:12.074132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-12T11:05:04.764 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-12T11:05:04.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:04 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3653503551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:05:05.005 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:05.703 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:05 smithi176 ceph-mon[34357]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:05.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:05 smithi086 ceph-mon[30110]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:05.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:05 smithi172 ceph-mon[34517]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:06.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 -- 172.21.15.86:0/3136914485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf4102fe0 msgr2=0x7fcaf4106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:06.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 --2- 172.21.15.86:0/3136914485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf4102fe0 0x7fcaf4106fe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00099c0 tx=0x7fcaf0009cd0 comp rx=0 tx=0).stop 2024-05-12T11:05:06.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 -- 172.21.15.86:0/3136914485 shutdown_connections 2024-05-12T11:05:06.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 --2- 172.21.15.86:0/3136914485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf41076c0 0x7fcaf410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:06.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 --2- 172.21.15.86:0/3136914485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaf4102630 0x7fcaf4102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:06.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 --2- 172.21.15.86:0/3136914485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf4102fe0 0x7fcaf4106fe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 -- 172.21.15.86:0/3136914485 >> 172.21.15.86:0/3136914485 conn(0x7fcaf4079370 msgr2=0x7fcaf4079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 -- 172.21.15.86:0/3136914485 shutdown_connections 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.911+0000 7fcafc30f700 1 -- 172.21.15.86:0/3136914485 wait complete. 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafc30f700 1 Processor -- start 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafc30f700 1 -- start start 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafc30f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf4102630 0x7fcaf419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafc30f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaf4102fe0 0x7fcaf419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafc30f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf41076c0 0x7fcaf4199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafc30f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf4112630 con 0x7fcaf41076c0 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafc30f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf41124b0 con 0x7fcaf4102630 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafc30f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf41127b0 con 0x7fcaf4102fe0 2024-05-12T11:05:06.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf41076c0 0x7fcaf4199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf41076c0 0x7fcaf4199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55918/0 (socket says 172.21.15.86:55918) 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 -- 172.21.15.86:0/2093934256 learned_addr learned my addr 172.21.15.86:0/2093934256 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcaf98aa700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaf4102fe0 0x7fcaf419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa0ab700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf4102630 0x7fcaf419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 -- 172.21.15.86:0/2093934256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaf4102fe0 msgr2=0x7fcaf419fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaf4102fe0 0x7fcaf419fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 -- 172.21.15.86:0/2093934256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf4102630 msgr2=0x7fcaf419f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf4102630 0x7fcaf419f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 -- 172.21.15.86:0/2093934256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf419a200 con 0x7fcaf41076c0 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa0ab700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf4102630 0x7fcaf419f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.912+0000 7fcafa8ac700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf41076c0 0x7fcaf4199aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00b970 tx=0x7fcaec00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.913+0000 7fcae77fe700 1 -- 172.21.15.86:0/2093934256 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec019070 con 0x7fcaf41076c0 2024-05-12T11:05:06.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.913+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf419a4f0 con 0x7fcaf41076c0 2024-05-12T11:05:06.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.913+0000 7fcae77fe700 1 -- 172.21.15.86:0/2093934256 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaec00cde0 con 0x7fcaf41076c0 2024-05-12T11:05:06.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.913+0000 7fcae77fe700 1 -- 172.21.15.86:0/2093934256 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec007370 con 0x7fcaf41076c0 2024-05-12T11:05:06.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.913+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf41a67b0 con 0x7fcaf41076c0 2024-05-12T11:05:06.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.914+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf406a190 con 0x7fcaf41076c0 2024-05-12T11:05:06.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.915+0000 7fcae77fe700 1 -- 172.21.15.86:0/2093934256 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fcaec01c070 con 0x7fcaf41076c0 2024-05-12T11:05:06.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.916+0000 7fcae77fe700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcae00b2880 0x7fcae00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:06.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.916+0000 7fcafa0ab700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcae00b2880 0x7fcae00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:06.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.916+0000 7fcae77fe700 1 -- 172.21.15.86:0/2093934256 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fcaec0e19d0 con 0x7fcaf41076c0 2024-05-12T11:05:06.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.916+0000 7fcafa0ab700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcae00b2880 0x7fcae00b4d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcaf419abe0 tx=0x7fcae8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:06.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:06.919+0000 7fcae77fe700 1 -- 172.21.15.86:0/2093934256 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcaec023070 con 0x7fcaf41076c0 2024-05-12T11:05:07.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.129+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcaf419afd0 con 0x7fcaf41076c0 2024-05-12T11:05:07.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.129+0000 7fcae77fe700 1 -- 172.21.15.86:0/2093934256 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fcaec0a9b90 con 0x7fcaf41076c0 2024-05-12T11:05:07.121 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-05-12T11:05:07.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcae00b2880 msgr2=0x7fcae00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:07.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcae00b2880 0x7fcae00b4d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcaf419abe0 tx=0x7fcae8008040 comp rx=0 tx=0).stop 2024-05-12T11:05:07.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf41076c0 msgr2=0x7fcaf4199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:07.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf41076c0 0x7fcaf4199aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00b970 tx=0x7fcaec00bc80 comp rx=0 tx=0).stop 2024-05-12T11:05:07.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 shutdown_connections 2024-05-12T11:05:07.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcae00b2880 0x7fcae00b4d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:07.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaf41076c0 0x7fcaf4199aa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:07.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf4102630 0x7fcaf419f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:07.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 --2- 172.21.15.86:0/2093934256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaf4102fe0 0x7fcaf419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:07.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.131+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 >> 172.21.15.86:0/2093934256 conn(0x7fcaf4079370 msgr2=0x7fcaf406bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:07.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.132+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 shutdown_connections 2024-05-12T11:05:07.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:07.132+0000 7fcafc30f700 1 -- 172.21.15.86:0/2093934256 wait complete. 2024-05-12T11:05:07.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:07 smithi086 ceph-mon[30110]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:07.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:07 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2093934256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-12T11:05:07.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:07 smithi172 ceph-mon[34517]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:07.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:07 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2093934256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-12T11:05:07.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:07 smithi176 ceph-mon[34357]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:07.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:07 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2093934256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-12T11:05:07.874 INFO:tasks.cephadm:Adding mds.a on smithi086 2024-05-12T11:05:07.874 INFO:tasks.cephadm:Adding mds.d on smithi086 2024-05-12T11:05:07.874 INFO:tasks.cephadm:Adding mds.g on smithi086 2024-05-12T11:05:07.874 INFO:tasks.cephadm:Adding mds.j on smithi086 2024-05-12T11:05:07.874 INFO:tasks.cephadm:Adding mds.b on smithi172 2024-05-12T11:05:07.874 INFO:tasks.cephadm:Adding mds.e on smithi172 2024-05-12T11:05:07.874 INFO:tasks.cephadm:Adding mds.h on smithi172 2024-05-12T11:05:07.874 INFO:tasks.cephadm:Adding mds.k on smithi172 2024-05-12T11:05:07.875 INFO:tasks.cephadm:Adding mds.c on smithi176 2024-05-12T11:05:07.875 INFO:tasks.cephadm:Adding mds.f on smithi176 2024-05-12T11:05:07.875 INFO:tasks.cephadm:Adding mds.i on smithi176 2024-05-12T11:05:07.875 INFO:tasks.cephadm:Adding mds.l on smithi176 2024-05-12T11:05:07.875 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph orch apply mds all '12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l' 2024-05-12T11:05:08.127 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:05:09.509 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:09 smithi176 ceph-mon[34357]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:09.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:09 smithi086 ceph-mon[30110]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:09 smithi172 ceph-mon[34517]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 -- 172.21.15.176:0/1892821643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 msgr2=0x7fe23010b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 --2- 172.21.15.176:0/1892821643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 0x7fe23010b660 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe22800b0a0 tx=0x7fe22800b3b0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 -- 172.21.15.176:0/1892821643 shutdown_connections 2024-05-12T11:05:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 --2- 172.21.15.176:0/1892821643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 0x7fe23010b660 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 --2- 172.21.15.176:0/1892821643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe230103ff0 0x7fe2301063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 --2- 172.21.15.176:0/1892821643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe230106920 0x7fe230108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 -- 172.21.15.176:0/1892821643 >> 172.21.15.176:0/1892821643 conn(0x7fe2300fd9a0 msgr2=0x7fe2300ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 -- 172.21.15.176:0/1892821643 shutdown_connections 2024-05-12T11:05:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.732+0000 7fe23521e700 1 -- 172.21.15.176:0/1892821643 wait complete. 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.733+0000 7fe23521e700 1 Processor -- start 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.733+0000 7fe23521e700 1 -- start start 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe23521e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe230103ff0 0x7fe230103950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe23521e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe230106920 0x7fe230101fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe23521e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 0x7fe2301024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe23521e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe23010ef80 con 0x7fe230106920 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe23521e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe23010ee00 con 0x7fe230103ff0 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe23521e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe23010f100 con 0x7fe230109250 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 0x7fe2301024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 0x7fe2301024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:44618/0 (socket says 172.21.15.176:44618) 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe230103ff0 0x7fe230103950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 -- 172.21.15.176:0/225676094 learned_addr learned my addr 172.21.15.176:0/225676094 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22e59c700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe230106920 0x7fe230101fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 -- 172.21.15.176:0/225676094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe230103ff0 msgr2=0x7fe230103950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe230103ff0 0x7fe230103950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 -- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe230106920 msgr2=0x7fe230101fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe230106920 0x7fe230101fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 -- 172.21.15.176:0/225676094 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe230102d90 con 0x7fe230109250 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe22f59e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 0x7fe2301024e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe2280062a0 tx=0x7fe228004e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:09.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.734+0000 7fe217fff700 1 -- 172.21.15.176:0/225676094 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228021070 con 0x7fe230109250 2024-05-12T11:05:09.730 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.735+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2301a3700 con 0x7fe230109250 2024-05-12T11:05:09.730 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.735+0000 7fe217fff700 1 -- 172.21.15.176:0/225676094 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe228007c00 con 0x7fe230109250 2024-05-12T11:05:09.730 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.735+0000 7fe217fff700 1 -- 172.21.15.176:0/225676094 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228004780 con 0x7fe230109250 2024-05-12T11:05:09.730 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.735+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2301a3c40 con 0x7fe230109250 2024-05-12T11:05:09.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.736+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23006a190 con 0x7fe230109250 2024-05-12T11:05:09.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.737+0000 7fe217fff700 1 -- 172.21.15.176:0/225676094 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe228003a00 con 0x7fe230109250 2024-05-12T11:05:09.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.737+0000 7fe217fff700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe2180b2880 0x7fe2180b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:09.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.737+0000 7fe217fff700 1 -- 172.21.15.176:0/225676094 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe22800f020 con 0x7fe230109250 2024-05-12T11:05:09.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.737+0000 7fe22ed9d700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe2180b2880 0x7fe2180b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:09.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.738+0000 7fe22ed9d700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe2180b2880 0x7fe2180b4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe220005950 tx=0x7fe22000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:09.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.742+0000 7fe217fff700 1 -- 172.21.15.176:0/225676094 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe22802a020 con 0x7fe230109250 2024-05-12T11:05:09.952 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.960+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l", "target": ["mon-mgr", ""]}) -- 0x7fe230063ba0 con 0x7fe2180b2880 2024-05-12T11:05:09.960 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.969+0000 7fe217fff700 1 -- 172.21.15.176:0/225676094 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fe230063ba0 con 0x7fe2180b2880 2024-05-12T11:05:09.960 INFO:teuthology.orchestra.run.smithi176.stdout:Scheduled mds.all update... 2024-05-12T11:05:09.962 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe2180b2880 msgr2=0x7fe2180b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:09.962 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe2180b2880 0x7fe2180b4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe220005950 tx=0x7fe22000b410 comp rx=0 tx=0).stop 2024-05-12T11:05:09.962 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 msgr2=0x7fe2301024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 0x7fe2301024e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe2280062a0 tx=0x7fe228004e40 comp rx=0 tx=0).stop 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 shutdown_connections 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe2180b2880 0x7fe2180b4d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe230109250 0x7fe2301024e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe230103ff0 0x7fe230103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 --2- 172.21.15.176:0/225676094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe230106920 0x7fe230101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 >> 172.21.15.176:0/225676094 conn(0x7fe2300fd9a0 msgr2=0x7fe230104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 shutdown_connections 2024-05-12T11:05:09.963 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-12T11:05:09.971+0000 7fe23521e700 1 -- 172.21.15.176:0/225676094 wait complete. 2024-05-12T11:05:10.619 DEBUG:teuthology.orchestra.run.smithi086:mds.a> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.a.service 2024-05-12T11:05:10.621 DEBUG:teuthology.orchestra.run.smithi086:mds.d> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.d.service 2024-05-12T11:05:10.664 DEBUG:teuthology.orchestra.run.smithi086:mds.g> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.g.service 2024-05-12T11:05:10.707 DEBUG:teuthology.orchestra.run.smithi086:mds.j> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.j.service 2024-05-12T11:05:10.750 DEBUG:teuthology.orchestra.run.smithi172:mds.b> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.b.service 2024-05-12T11:05:10.753 DEBUG:teuthology.orchestra.run.smithi172:mds.e> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.e.service 2024-05-12T11:05:10.796 DEBUG:teuthology.orchestra.run.smithi172:mds.h> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.h.service 2024-05-12T11:05:10.839 DEBUG:teuthology.orchestra.run.smithi172:mds.k> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.k.service 2024-05-12T11:05:10.882 DEBUG:teuthology.orchestra.run.smithi176:mds.c> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.c.service 2024-05-12T11:05:10.884 DEBUG:teuthology.orchestra.run.smithi176:mds.f> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.f.service 2024-05-12T11:05:10.927 DEBUG:teuthology.orchestra.run.smithi176:mds.i> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.i.service 2024-05-12T11:05:10.970 DEBUG:teuthology.orchestra.run.smithi176:mds.l> sudo journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.l.service 2024-05-12T11:05:11.014 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-12T11:05:11.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:11.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: Saving service mds.all spec with placement smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l;count:12 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:11.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:10 smithi086 ceph-mon[30110]: Deploying daemon mds.l on smithi176 2024-05-12T11:05:11.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:05:11.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: Saving service mds.all spec with placement smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l;count:12 2024-05-12T11:05:11.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:11.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:11.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:11.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:10 smithi172 ceph-mon[34517]: Deploying daemon mds.l on smithi176 2024-05-12T11:05:11.254 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:05:11.254 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: Saving service mds.all spec with placement smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l;count:12 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:11.255 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:10 smithi176 ceph-mon[34357]: Deploying daemon mds.l on smithi176 2024-05-12T11:05:11.256 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:13.016 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:12 smithi176 systemd[1]: Starting Ceph mds.l for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 -- 172.21.15.86:0/1878341017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d90103f00 msgr2=0x7f9d901103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 --2- 172.21.15.86:0/1878341017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d90103f00 0x7f9d901103b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800b0d0 tx=0x7f9d8800b3e0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 -- 172.21.15.86:0/1878341017 shutdown_connections 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 --2- 172.21.15.86:0/1878341017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d90103f00 0x7f9d901103b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 --2- 172.21.15.86:0/1878341017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d901095e0 0x7f9d901099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 --2- 172.21.15.86:0/1878341017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d90103540 0x7f9d901039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 -- 172.21.15.86:0/1878341017 >> 172.21.15.86:0/1878341017 conn(0x7f9d9007a650 msgr2=0x7f9d9007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 -- 172.21.15.86:0/1878341017 shutdown_connections 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.057+0000 7f9d95e35700 1 -- 172.21.15.86:0/1878341017 wait complete. 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d95e35700 1 Processor -- start 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d95e35700 1 -- start start 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d95e35700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d90103540 0x7f9d900757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:13.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d95e35700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d90103f00 0x7f9d90075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d95e35700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d901095e0 0x7f9d90076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d95e35700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90113740 con 0x7f9d901095e0 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d95e35700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901135c0 con 0x7f9d90103f00 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d95e35700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901138c0 con 0x7f9d90103540 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.058+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d901095e0 0x7f9d90076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d901095e0 0x7f9d90076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38464/0 (socket says 172.21.15.86:38464) 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8ffff700 1 -- 172.21.15.86:0/2165418481 learned_addr learned my addr 172.21.15.86:0/2165418481 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8f7fe700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d90103540 0x7f9d900757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d86ffd700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d90103f00 0x7f9d90075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8ffff700 1 -- 172.21.15.86:0/2165418481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d90103540 msgr2=0x7f9d900757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8ffff700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d90103540 0x7f9d900757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8ffff700 1 -- 172.21.15.86:0/2165418481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d90103f00 msgr2=0x7f9d90075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:13.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8ffff700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d90103f00 0x7f9d90075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8ffff700 1 -- 172.21.15.86:0/2165418481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d901a8120 con 0x7f9d901095e0 2024-05-12T11:05:13.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d86ffd700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d90103f00 0x7f9d90075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:05:13.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8ffff700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d901095e0 0x7f9d90076220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9d880095c0 tx=0x7f9d88007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:13.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8d7fa700 1 -- 172.21.15.86:0/2165418481 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8801f070 con 0x7f9d901095e0 2024-05-12T11:05:13.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8d7fa700 1 -- 172.21.15.86:0/2165418481 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d88003c00 con 0x7f9d901095e0 2024-05-12T11:05:13.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d901a83b0 con 0x7f9d901095e0 2024-05-12T11:05:13.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d8d7fa700 1 -- 172.21.15.86:0/2165418481 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8801b6a0 con 0x7f9d901095e0 2024-05-12T11:05:13.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.059+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d901a87b0 con 0x7f9d901095e0 2024-05-12T11:05:13.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.060+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d9010ba70 con 0x7f9d901095e0 2024-05-12T11:05:13.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.062+0000 7f9d8d7fa700 1 -- 172.21.15.86:0/2165418481 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9d88022070 con 0x7f9d901095e0 2024-05-12T11:05:13.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.062+0000 7f9d8d7fa700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9d7c0b2880 0x7f9d7c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:13.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.062+0000 7f9d8f7fe700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9d7c0b2880 0x7f9d7c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:13.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.062+0000 7f9d8d7fa700 1 -- 172.21.15.86:0/2165418481 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f9d880e2f60 con 0x7f9d901095e0 2024-05-12T11:05:13.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.063+0000 7f9d8f7fe700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9d7c0b2880 0x7f9d7c0b4d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009a10 tx=0x7f9d80009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:13.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.066+0000 7f9d8d7fa700 1 -- 172.21.15.86:0/2165418481 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9d880ab1b0 con 0x7f9d901095e0 2024-05-12T11:05:13.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.313+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d90104c50 con 0x7f9d901095e0 2024-05-12T11:05:13.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.313+0000 7f9d8d7fa700 1 -- 172.21.15.86:0/2165418481 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f9d880aaab0 con 0x7f9d901095e0 2024-05-12T11:05:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:13.304 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9d7c0b2880 msgr2=0x7f9d7c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9d7c0b2880 0x7f9d7c0b4d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009a10 tx=0x7f9d80009190 comp rx=0 tx=0).stop 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d901095e0 msgr2=0x7f9d90076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d901095e0 0x7f9d90076220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9d880095c0 tx=0x7f9d88007a20 comp rx=0 tx=0).stop 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 shutdown_connections 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9d7c0b2880 0x7f9d7c0b4d40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d901095e0 0x7f9d90076220 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d90103540 0x7f9d900757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 --2- 172.21.15.86:0/2165418481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d90103f00 0x7f9d90075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 >> 172.21.15.86:0/2165418481 conn(0x7f9d9007a650 msgr2=0x7f9d90102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 shutdown_connections 2024-05-12T11:05:13.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:13.315+0000 7f9d95e35700 1 -- 172.21.15.86:0/2165418481 wait complete. 2024-05-12T11:05:13.308 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 1 2024-05-12T11:05:13.453 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:13 smithi176 ceph-mon[34357]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:13.454 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:13 smithi176 podman[64957]: 2024-05-12 11:05:13.072447943 +0000 UTC m=+0.018392013 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:13.454 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:13 smithi176 podman[64957]: 2024-05-12 11:05:13.193061838 +0000 UTC m=+0.139005899 container create d116c79b19031d21a53ef73bb096c0ed47f48c1f7f2b78e640fdce43068089d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-12T11:05:13.454 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:13 smithi176 podman[64957]: 2024-05-12 11:05:13.462943565 +0000 UTC m=+0.408887626 container init d116c79b19031d21a53ef73bb096c0ed47f48c1f7f2b78e640fdce43068089d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:05:13.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:13 smithi086 ceph-mon[30110]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:13.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:13 smithi172 ceph-mon[34517]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:13.766 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:13 smithi176 podman[64957]: 2024-05-12 11:05:13.465715422 +0000 UTC m=+0.411659482 container start d116c79b19031d21a53ef73bb096c0ed47f48c1f7f2b78e640fdce43068089d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=) 2024-05-12T11:05:13.767 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:13 smithi176 ceph-mds[64976]: -- 172.21.15.176:0/1904665127 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55574b5e1a40 con 0x55574b5b4800 2024-05-12T11:05:13.767 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:13 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l[64972]: starting mds.l at 2024-05-12T11:05:13.767 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:13 smithi176 bash[64957]: d116c79b19031d21a53ef73bb096c0ed47f48c1f7f2b78e640fdce43068089d3 2024-05-12T11:05:13.767 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:05:13 smithi176 systemd[1]: Started Ceph mds.l for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:14.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2165418481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6832/868497491,v1:172.21.15.176:6833/868497491] up:boot 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: fsmap 1 up:standby 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:14.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:14 smithi086 ceph-mon[30110]: Deploying daemon mds.k on smithi172 2024-05-12T11:05:14.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2165418481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6832/868497491,v1:172.21.15.176:6833/868497491] up:boot 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: fsmap 1 up:standby 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:14.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:14 smithi172 ceph-mon[34517]: Deploying daemon mds.k on smithi172 2024-05-12T11:05:14.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2165418481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6832/868497491,v1:172.21.15.176:6833/868497491] up:boot 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: fsmap 1 up:standby 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:14.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:14 smithi176 ceph-mon[34357]: Deploying daemon mds.k on smithi172 2024-05-12T11:05:15.870 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:15 smithi172 ceph-mon[34517]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:15.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:15 smithi086 ceph-mon[30110]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:15.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:16.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:15 smithi176 ceph-mon[34357]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:16.223 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 systemd[1]: Starting Ceph mds.k for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:16.239 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:16.529 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 podman[63813]: 2024-05-12 11:05:16.178493234 +0000 UTC m=+0.018032583 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:16.529 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 podman[63813]: 2024-05-12 11:05:16.301631487 +0000 UTC m=+0.141170821 container create edaeeb374b3dd7994ce88720af99c2a8244b7094e334d60f04e313504cc92078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-05-12T11:05:16.529 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 podman[63813]: 2024-05-12 11:05:16.538759851 +0000 UTC m=+0.378299198 container init edaeeb374b3dd7994ce88720af99c2a8244b7094e334d60f04e313504cc92078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-12T11:05:16.973 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 podman[63813]: 2024-05-12 11:05:16.541659498 +0000 UTC m=+0.381198845 container start edaeeb374b3dd7994ce88720af99c2a8244b7094e334d60f04e313504cc92078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:05:16.974 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 ceph-mds[63832]: -- 172.21.15.172:0/4170404012 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c34b18da40 con 0x55c34b160c00 2024-05-12T11:05:16.974 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k[63828]: starting mds.k at 2024-05-12T11:05:16.974 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 bash[63813]: edaeeb374b3dd7994ce88720af99c2a8244b7094e334d60f04e313504cc92078 2024-05-12T11:05:16.974 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:05:16 smithi172 systemd[1]: Started Ceph mds.k for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6832/3992302401,v1:172.21.15.172:6833/3992302401] up:boot 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: fsmap 2 up:standby 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:17.889 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:17.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:17.890 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:17 smithi086 ceph-mon[30110]: Deploying daemon mds.j on smithi086 2024-05-12T11:05:17.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:17.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6832/3992302401,v1:172.21.15.172:6833/3992302401] up:boot 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: fsmap 2 up:standby 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:17.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:17 smithi172 ceph-mon[34517]: Deploying daemon mds.j on smithi086 2024-05-12T11:05:17.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 -- 172.21.15.86:0/1299856257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 msgr2=0x7f58e010f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:17.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 --2- 172.21.15.86:0/1299856257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 0x7f58e010f310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f58d800b0d0 tx=0x7f58d800b3e0 comp rx=0 tx=0).stop 2024-05-12T11:05:17.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 -- 172.21.15.86:0/1299856257 shutdown_connections 2024-05-12T11:05:17.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 --2- 172.21.15.86:0/1299856257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 0x7f58e010f310 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:17.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 --2- 172.21.15.86:0/1299856257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e0106320 0x7f58e0106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:17.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 --2- 172.21.15.86:0/1299856257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58e0108190 0x7f58e0108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:17.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 -- 172.21.15.86:0/1299856257 >> 172.21.15.86:0/1299856257 conn(0x7f58e00776c0 msgr2=0x7f58e0077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:17.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 -- 172.21.15.86:0/1299856257 shutdown_connections 2024-05-12T11:05:17.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.000+0000 7f58e77be700 1 -- 172.21.15.86:0/1299856257 wait complete. 2024-05-12T11:05:17.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e77be700 1 Processor -- start 2024-05-12T11:05:17.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e77be700 1 -- start start 2024-05-12T11:05:17.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e77be700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e0106320 0x7f58e0103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e77be700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58e0108190 0x7f58e0103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e77be700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 0x7f58e0103aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e77be700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58e01125f0 con 0x7f58e0108b50 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e77be700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0112470 con 0x7f58e0106320 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e77be700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0112770 con 0x7f58e0108190 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e5d5b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 0x7f58e0103aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e5d5b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 0x7f58e0103aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38478/0 (socket says 172.21.15.86:38478) 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e5d5b700 1 -- 172.21.15.86:0/787061930 learned_addr learned my addr 172.21.15.86:0/787061930 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.001+0000 7f58e4d59700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58e0108190 0x7f58e0103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e555a700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e0106320 0x7f58e0103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e5d5b700 1 -- 172.21.15.86:0/787061930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58e0108190 msgr2=0x7f58e0103560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e5d5b700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58e0108190 0x7f58e0103560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e5d5b700 1 -- 172.21.15.86:0/787061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e0106320 msgr2=0x7f58e0103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e5d5b700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e0106320 0x7f58e0103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e5d5b700 1 -- 172.21.15.86:0/787061930 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e01a80b0 con 0x7f58e0108b50 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e5d5b700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 0x7f58e0103aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58d80095c0 tx=0x7f58d8007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58d67fc700 1 -- 172.21.15.86:0/787061930 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d801f070 con 0x7f58e0108b50 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58d67fc700 1 -- 172.21.15.86:0/787061930 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d8003c00 con 0x7f58e0108b50 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e01a8340 con 0x7f58e0108b50 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58d67fc700 1 -- 172.21.15.86:0/787061930 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d801b6a0 con 0x7f58e0108b50 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.002+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e01a87f0 con 0x7f58e0108b50 2024-05-12T11:05:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.003+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e006a190 con 0x7f58e0108b50 2024-05-12T11:05:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.005+0000 7f58d67fc700 1 -- 172.21.15.86:0/787061930 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f58d8022070 con 0x7f58e0108b50 2024-05-12T11:05:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.006+0000 7f58d67fc700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f58cc0b2900 0x7f58cc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.006+0000 7f58e555a700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f58cc0b2900 0x7f58cc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.006+0000 7f58d67fc700 1 -- 172.21.15.86:0/787061930 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f58d800f020 con 0x7f58e0108b50 2024-05-12T11:05:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.006+0000 7f58e555a700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f58cc0b2900 0x7f58cc0b4dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f58dc005ea0 tx=0x7f58dc005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:18.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.011+0000 7f58d67fc700 1 -- 172.21.15.86:0/787061930 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f58d8029020 con 0x7f58e0108b50 2024-05-12T11:05:18.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:18.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6832/3992302401,v1:172.21.15.172:6833/3992302401] up:boot 2024-05-12T11:05:18.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: fsmap 2 up:standby 2024-05-12T11:05:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:05:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:18.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:17 smithi176 ceph-mon[34357]: Deploying daemon mds.j on smithi086 2024-05-12T11:05:18.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.262+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58e002e510 con 0x7f58e0108b50 2024-05-12T11:05:18.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.263+0000 7f58d67fc700 1 -- 172.21.15.86:0/787061930 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f58d80ab1d0 con 0x7f58e0108b50 2024-05-12T11:05:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:18.255 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-12T11:05:18.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f58cc0b2900 msgr2=0x7f58cc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:18.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f58cc0b2900 0x7f58cc0b4dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f58dc005ea0 tx=0x7f58dc005e30 comp rx=0 tx=0).stop 2024-05-12T11:05:18.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 msgr2=0x7f58e0103aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:18.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 0x7f58e0103aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58d80095c0 tx=0x7f58d8007a20 comp rx=0 tx=0).stop 2024-05-12T11:05:18.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 shutdown_connections 2024-05-12T11:05:18.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f58cc0b2900 0x7f58cc0b4dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:18.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58e0108b50 0x7f58e0103aa0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:18.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e0106320 0x7f58e0103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:18.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 --2- 172.21.15.86:0/787061930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58e0108190 0x7f58e0103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:18.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 >> 172.21.15.86:0/787061930 conn(0x7f58e00776c0 msgr2=0x7f58e0101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:18.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 shutdown_connections 2024-05-12T11:05:18.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:18.265+0000 7f58e77be700 1 -- 172.21.15.86:0/787061930 wait complete. 2024-05-12T11:05:18.258 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 3 2024-05-12T11:05:18.943 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:18 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/787061930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:18.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:18 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/787061930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:19.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:18 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/787061930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:19.931 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:19 smithi086 ceph-mon[30110]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:19.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:19 smithi172 ceph-mon[34517]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:20.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:19 smithi176 ceph-mon[34357]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:20.611 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:20 smithi086 systemd[1]: Starting Ceph mds.j for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:20.891 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:20 smithi086 podman[67542]: 2024-05-12 11:05:20.523891468 +0000 UTC m=+0.018236134 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:20.891 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:20 smithi086 podman[67542]: 2024-05-12 11:05:20.647390162 +0000 UTC m=+0.141734956 container create 52c0a89746c112a3be0541366c90d5ec66b619c73180cb62f3d89775d0214b28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:05:20.891 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:20 smithi086 podman[67542]: 2024-05-12 11:05:20.900349283 +0000 UTC m=+0.394693931 container init 52c0a89746c112a3be0541366c90d5ec66b619c73180cb62f3d89775d0214b28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True) 2024-05-12T11:05:21.212 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:20 smithi086 podman[67542]: 2024-05-12 11:05:20.903428546 +0000 UTC m=+0.397773197 container start 52c0a89746c112a3be0541366c90d5ec66b619c73180cb62f3d89775d0214b28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-12T11:05:21.213 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:20 smithi086 ceph-mds[67561]: -- 172.21.15.86:0/2029740550 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577855bfa40 con 0x557785592800 2024-05-12T11:05:21.213 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j[67557]: starting mds.j at 2024-05-12T11:05:21.213 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:21 smithi086 bash[67542]: 52c0a89746c112a3be0541366c90d5ec66b619c73180cb62f3d89775d0214b28 2024-05-12T11:05:21.213 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:05:21 smithi086 systemd[1]: Started Ceph mds.j for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:21.500 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:21.868 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:21 smithi086 ceph-mon[30110]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:21.868 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:21.869 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:21.869 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:21.869 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:21.869 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:21.869 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:21 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:21 smithi172 ceph-mon[34517]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:21.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:21 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:22.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:21 smithi176 ceph-mon[34357]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:22.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:22.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:22.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:22.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:22.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:22.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:21 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:22.317 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:22.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:22 smithi086 ceph-mon[30110]: Deploying daemon mds.d on smithi086 2024-05-12T11:05:22.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:22 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.86:6834/2771013061,v1:172.21.15.86:6835/2771013061] up:boot 2024-05-12T11:05:22.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:22 smithi086 ceph-mon[30110]: fsmap 3 up:standby 2024-05-12T11:05:22.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:22 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-12T11:05:22.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:22 smithi172 ceph-mon[34517]: Deploying daemon mds.d on smithi086 2024-05-12T11:05:22.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:22 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.86:6834/2771013061,v1:172.21.15.86:6835/2771013061] up:boot 2024-05-12T11:05:22.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:22 smithi172 ceph-mon[34517]: fsmap 3 up:standby 2024-05-12T11:05:22.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:22 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-12T11:05:23.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:22 smithi176 ceph-mon[34357]: Deploying daemon mds.d on smithi086 2024-05-12T11:05:23.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:22 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.86:6834/2771013061,v1:172.21.15.86:6835/2771013061] up:boot 2024-05-12T11:05:23.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:22 smithi176 ceph-mon[34357]: fsmap 3 up:standby 2024-05-12T11:05:23.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:22 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-12T11:05:23.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:23 smithi086 ceph-mon[30110]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:23.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:23 smithi172 ceph-mon[34517]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:24.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:23 smithi176 ceph-mon[34357]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:24.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 -- 172.21.15.86:0/348327780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc1076c0 msgr2=0x7f22dc10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:24.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 --2- 172.21.15.86:0/348327780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc1076c0 0x7f22dc10f290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f22d40099c0 tx=0x7f22d4009cd0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 -- 172.21.15.86:0/348327780 shutdown_connections 2024-05-12T11:05:24.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 --2- 172.21.15.86:0/348327780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc1076c0 0x7f22dc10f290 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 --2- 172.21.15.86:0/348327780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22dc102630 0x7f22dc102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 --2- 172.21.15.86:0/348327780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22dc102fe0 0x7f22dc106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 -- 172.21.15.86:0/348327780 >> 172.21.15.86:0/348327780 conn(0x7f22dc079350 msgr2=0x7f22dc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 -- 172.21.15.86:0/348327780 shutdown_connections 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 -- 172.21.15.86:0/348327780 wait complete. 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 Processor -- start 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.623+0000 7f22e473e700 1 -- start start 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e473e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc102630 0x7f22dc19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e473e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22dc102fe0 0x7f22dc19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e473e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22dc1076c0 0x7f22dc1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e473e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc112580 con 0x7f22dc102630 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e473e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc112400 con 0x7f22dc1076c0 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e473e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc112700 con 0x7f22dc102fe0 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc102630 0x7f22dc19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc102630 0x7f22dc19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50596/0 (socket says 172.21.15.86:50596) 2024-05-12T11:05:24.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 -- 172.21.15.86:0/3989823066 learned_addr learned my addr 172.21.15.86:0/3989823066 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e2cdb700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22dc1076c0 0x7f22dc1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e1cd9700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22dc102fe0 0x7f22dc19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 -- 172.21.15.86:0/3989823066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22dc102fe0 msgr2=0x7f22dc19c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22dc102fe0 0x7f22dc19c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 -- 172.21.15.86:0/3989823066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22dc1076c0 msgr2=0x7f22dc1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22dc1076c0 0x7f22dc1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 -- 172.21.15.86:0/3989823066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc1a0d60 con 0x7f22dc102630 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e2cdb700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22dc1076c0 0x7f22dc1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e24da700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc102630 0x7f22dc19bd50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22cc007f10 tx=0x7f22cc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22db7fe700 1 -- 172.21.15.86:0/3989823066 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00dc90 con 0x7f22dc102630 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22db7fe700 1 -- 172.21.15.86:0/3989823066 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22cc00de30 con 0x7f22dc102630 2024-05-12T11:05:24.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc1a1050 con 0x7f22dc102630 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.624+0000 7f22db7fe700 1 -- 172.21.15.86:0/3989823066 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0133f0 con 0x7f22dc102630 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.625+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc1a88d0 con 0x7f22dc102630 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.625+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc06a190 con 0x7f22dc102630 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.628+0000 7f22db7fe700 1 -- 172.21.15.86:0/3989823066 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f22cc01a020 con 0x7f22dc102630 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.628+0000 7f22db7fe700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f22c40b2900 0x7f22c40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.629+0000 7f22e1cd9700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f22c40b2900 0x7f22c40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.629+0000 7f22db7fe700 1 -- 172.21.15.86:0/3989823066 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f22cc0e1c10 con 0x7f22dc102630 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.629+0000 7f22e1cd9700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f22c40b2900 0x7f22c40b4dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005950 tx=0x7f22d00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:24.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.632+0000 7f22db7fe700 1 -- 172.21.15.86:0/3989823066 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f22cc010070 con 0x7f22dc102630 2024-05-12T11:05:24.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.887+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22dc02e510 con 0x7f22dc102630 2024-05-12T11:05:24.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.887+0000 7f22db7fe700 1 -- 172.21.15.86:0/3989823066 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7f22cc0a9dd0 con 0x7f22dc102630 2024-05-12T11:05:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:24.879 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:05:24 smithi086 podman[67963]: 2024-05-12 11:05:24.771515428 +0000 UTC m=+0.371760497 container create a5800a290abdb05087555c02e8d4bbe8f4e6fcb33910b5b2e96e23612415e745 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-12T11:05:24.880 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-12T11:05:24.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f22c40b2900 msgr2=0x7f22c40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:24.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f22c40b2900 0x7f22c40b4dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005950 tx=0x7f22d00058e0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc102630 msgr2=0x7f22dc19bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:24.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc102630 0x7f22dc19bd50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22cc007f10 tx=0x7f22cc00d3b0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 shutdown_connections 2024-05-12T11:05:24.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f22c40b2900 0x7f22c40b4dc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22dc1076c0 0x7f22dc1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22dc102630 0x7f22dc19bd50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 --2- 172.21.15.86:0/3989823066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22dc102fe0 0x7f22dc19c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:24.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 >> 172.21.15.86:0/3989823066 conn(0x7f22dc079350 msgr2=0x7f22dc10de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:24.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 shutdown_connections 2024-05-12T11:05:24.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:24.890+0000 7f22e473e700 1 -- 172.21.15.86:0/3989823066 wait complete. 2024-05-12T11:05:24.883 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 4 2024-05-12T11:05:25.675 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:05:25 smithi086 podman[67963]: 2024-05-12 11:05:25.25915545 +0000 UTC m=+0.859400526 container init a5800a290abdb05087555c02e8d4bbe8f4e6fcb33910b5b2e96e23612415e745 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:05:25.675 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:05:25 smithi086 podman[67963]: 2024-05-12 11:05:25.262170003 +0000 UTC m=+0.862415075 container start a5800a290abdb05087555c02e8d4bbe8f4e6fcb33910b5b2e96e23612415e745 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:05:25.675 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mds[68017]: -- 172.21.15.86:0/1217417847 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559df891da40 con 0x559df88f0800 2024-05-12T11:05:25.675 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:05:25 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d[68002]: starting mds.d at 2024-05-12T11:05:25.675 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:05:25 smithi086 bash[67963]: a5800a290abdb05087555c02e8d4bbe8f4e6fcb33910b5b2e96e23612415e745 2024-05-12T11:05:25.675 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:05:25 smithi086 systemd[1]: Started Ceph mds.d for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:25.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mon[30110]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:25.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3989823066' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:25.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:25.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:25.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:25.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:25.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:25.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:25 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:25 smithi172 ceph-mon[34517]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:25 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3989823066' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:25.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:25.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:25.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:25.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:25.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:25 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:26.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:25 smithi176 ceph-mon[34357]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:26.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:25 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3989823066' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:26.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:26.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:26.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:26.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:26.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:26.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:25 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:26.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:26 smithi086 ceph-mon[30110]: Deploying daemon mds.e on smithi172 2024-05-12T11:05:26.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:26 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.86:6836/1659604028,v1:172.21.15.86:6837/1659604028] up:boot 2024-05-12T11:05:26.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:26 smithi086 ceph-mon[30110]: fsmap 4 up:standby 2024-05-12T11:05:26.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:26 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-12T11:05:26.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:26 smithi172 ceph-mon[34517]: Deploying daemon mds.e on smithi172 2024-05-12T11:05:26.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:26 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.86:6836/1659604028,v1:172.21.15.86:6837/1659604028] up:boot 2024-05-12T11:05:26.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:26 smithi172 ceph-mon[34517]: fsmap 4 up:standby 2024-05-12T11:05:26.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:26 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-12T11:05:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:26 smithi176 ceph-mon[34357]: Deploying daemon mds.e on smithi172 2024-05-12T11:05:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:26 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.86:6836/1659604028,v1:172.21.15.86:6837/1659604028] up:boot 2024-05-12T11:05:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:26 smithi176 ceph-mon[34357]: fsmap 4 up:standby 2024-05-12T11:05:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:26 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-12T11:05:27.683 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:27 smithi172 systemd[1]: Starting Ceph mds.e for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:27.805 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:27.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:27 smithi086 ceph-mon[30110]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:27.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:27 smithi172 ceph-mon[34517]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:27.969 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:27 smithi172 podman[64132]: 2024-05-12 11:05:27.727998275 +0000 UTC m=+0.017509234 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:27.969 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:27 smithi172 podman[64132]: 2024-05-12 11:05:27.848762452 +0000 UTC m=+0.138273406 container create 8602267d807b9c30a1186f4b5363c9cdc6b236818f9d1a44dfcc31059dbe379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-12T11:05:28.014 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:27 smithi176 ceph-mon[34357]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:28.061 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:28.223 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:28 smithi172 podman[64132]: 2024-05-12 11:05:28.101950483 +0000 UTC m=+0.391461441 container init 8602267d807b9c30a1186f4b5363c9cdc6b236818f9d1a44dfcc31059dbe379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-12T11:05:28.223 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:28 smithi172 podman[64132]: 2024-05-12 11:05:28.104544099 +0000 UTC m=+0.394055062 container start 8602267d807b9c30a1186f4b5363c9cdc6b236818f9d1a44dfcc31059dbe379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-12T11:05:28.224 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:28 smithi172 ceph-mds[64151]: -- 172.21.15.172:0/3777878530 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa4b895a40 con 0x55aa4b869000 2024-05-12T11:05:28.224 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:28 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e[64147]: starting mds.e at 2024-05-12T11:05:28.224 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:28 smithi172 bash[64132]: 8602267d807b9c30a1186f4b5363c9cdc6b236818f9d1a44dfcc31059dbe379e 2024-05-12T11:05:28.224 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:05:28 smithi172 systemd[1]: Started Ceph mds.e for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: Deploying daemon mds.f on smithi176 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6834/3404000495,v1:172.21.15.172:6835/3404000495] up:boot 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: fsmap 5 up:standby 2024-05-12T11:05:29.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:29 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:05:29.540 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:29.540 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.540 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.540 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.540 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:29.540 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:29.540 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:29.540 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: Deploying daemon mds.f on smithi176 2024-05-12T11:05:29.541 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6834/3404000495,v1:172.21.15.172:6835/3404000495] up:boot 2024-05-12T11:05:29.541 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: fsmap 5 up:standby 2024-05-12T11:05:29.541 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:29 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:05:29.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:29.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: Deploying daemon mds.f on smithi176 2024-05-12T11:05:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6834/3404000495,v1:172.21.15.172:6835/3404000495] up:boot 2024-05-12T11:05:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: fsmap 5 up:standby 2024-05-12T11:05:29.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:29 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.758+0000 7face4e47700 1 -- 172.21.15.86:0/2836821588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 msgr2=0x7face01087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.758+0000 7face4e47700 1 --2- 172.21.15.86:0/2836821588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 0x7face01087f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facd000b0a0 tx=0x7facd000b3b0 comp rx=0 tx=0).stop 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 -- 172.21.15.86:0/2836821588 shutdown_connections 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 --2- 172.21.15.86:0/2836821588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face0102d60 0x7face010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 --2- 172.21.15.86:0/2836821588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 0x7face01087f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 --2- 172.21.15.86:0/2836821588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7face01023a0 0x7face0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 -- 172.21.15.86:0/2836821588 >> 172.21.15.86:0/2836821588 conn(0x7face0079350 msgr2=0x7face0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 -- 172.21.15.86:0/2836821588 shutdown_connections 2024-05-12T11:05:29.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 -- 172.21.15.86:0/2836821588 wait complete. 2024-05-12T11:05:29.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 Processor -- start 2024-05-12T11:05:29.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.759+0000 7face4e47700 1 -- start start 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7face4e47700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01023a0 0x7face019e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7face4e47700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7face0102d60 0x7face019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7face4e47700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 0x7face0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7face4e47700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7face0112560 con 0x7face0108410 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7face4e47700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7face01123e0 con 0x7face01023a0 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7face4e47700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7face01126e0 con 0x7face0102d60 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 0x7face0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 0x7face0198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50620/0 (socket says 172.21.15.86:50620) 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 -- 172.21.15.86:0/2171581806 learned_addr learned my addr 172.21.15.86:0/2171581806 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facddd9b700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7face0102d60 0x7face019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facde59c700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01023a0 0x7face019e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 -- 172.21.15.86:0/2171581806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7face0102d60 msgr2=0x7face019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7face0102d60 0x7face019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:29.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 -- 172.21.15.86:0/2171581806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01023a0 msgr2=0x7face019e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01023a0 0x7face019e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 -- 172.21.15.86:0/2171581806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face0199040 con 0x7face0108410 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facded9d700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 0x7face0198860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facd800c900 tx=0x7facd800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facd77fe700 1 -- 172.21.15.86:0/2171581806 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8007b00 con 0x7face0108410 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face0199330 con 0x7face0108410 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.760+0000 7facd77fe700 1 -- 172.21.15.86:0/2171581806 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facd800ce50 con 0x7face0108410 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.761+0000 7facd77fe700 1 -- 172.21.15.86:0/2171581806 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8018660 con 0x7face0108410 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.761+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face006bc10 con 0x7face0108410 2024-05-12T11:05:29.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.762+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face0103ac0 con 0x7face0108410 2024-05-12T11:05:29.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.764+0000 7facd77fe700 1 -- 172.21.15.86:0/2171581806 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7facd800f450 con 0x7face0108410 2024-05-12T11:05:29.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.765+0000 7facd77fe700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faccc0b2900 0x7faccc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:29.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.765+0000 7facde59c700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faccc0b2900 0x7faccc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:29.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.765+0000 7facd77fe700 1 -- 172.21.15.86:0/2171581806 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7facd80e1d10 con 0x7face0108410 2024-05-12T11:05:29.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.766+0000 7facde59c700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faccc0b2900 0x7faccc0b4dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facd0006130 tx=0x7facd00060a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:29.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:29.768+0000 7facd77fe700 1 -- 172.21.15.86:0/2171581806 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7facd8014030 con 0x7face0108410 2024-05-12T11:05:30.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.015+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7face006c740 con 0x7face0108410 2024-05-12T11:05:30.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.015+0000 7facd77fe700 1 -- 172.21.15.86:0/2171581806 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4699 (secure 0 0 0) 0x7facd80a9ec0 con 0x7face0108410 2024-05-12T11:05:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:30.007 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faccc0b2900 msgr2=0x7faccc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faccc0b2900 0x7faccc0b4dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facd0006130 tx=0x7facd00060a0 comp rx=0 tx=0).stop 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 msgr2=0x7face0198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 0x7face0198860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facd800c900 tx=0x7facd800cc10 comp rx=0 tx=0).stop 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 shutdown_connections 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faccc0b2900 0x7faccc0b4dc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0108410 0x7face0198860 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01023a0 0x7face019e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 --2- 172.21.15.86:0/2171581806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7face0102d60 0x7face019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.017+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 >> 172.21.15.86:0/2171581806 conn(0x7face0079350 msgr2=0x7face0101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:30.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.018+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 shutdown_connections 2024-05-12T11:05:30.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:30.018+0000 7face4e47700 1 -- 172.21.15.86:0/2171581806 wait complete. 2024-05-12T11:05:30.010 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 6 2024-05-12T11:05:30.422 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:30 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2171581806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:30.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:30 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2171581806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:30.517 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 systemd[1]: Starting Ceph mds.f for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:30.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:30 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2171581806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:30.807 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 podman[65279]: 2024-05-12 11:05:30.467603924 +0000 UTC m=+0.018342806 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:30.807 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 podman[65279]: 2024-05-12 11:05:30.580527999 +0000 UTC m=+0.131266910 container create b18ed50f408895097a1a4b9f9ca7852d35dfe3c684c22420fcd86557627f2396 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-12T11:05:30.807 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 podman[65279]: 2024-05-12 11:05:30.816348765 +0000 UTC m=+0.367087634 container init b18ed50f408895097a1a4b9f9ca7852d35dfe3c684c22420fcd86557627f2396 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:05:31.242 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 podman[65279]: 2024-05-12 11:05:30.818828784 +0000 UTC m=+0.369567656 container start b18ed50f408895097a1a4b9f9ca7852d35dfe3c684c22420fcd86557627f2396 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f, org.label-schema.build-date=20240507, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-12T11:05:31.243 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 ceph-mds[65298]: -- 172.21.15.176:0/3283754478 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630b59a3a40 con 0x5630b5977000 2024-05-12T11:05:31.243 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f[65294]: starting mds.f at 2024-05-12T11:05:31.243 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 bash[65279]: b18ed50f408895097a1a4b9f9ca7852d35dfe3c684c22420fcd86557627f2396 2024-05-12T11:05:31.243 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:05:30 smithi176 systemd[1]: Started Ceph mds.f for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:31.243 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:31 smithi176 ceph-mon[34357]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:31.243 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.243 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.243 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.244 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:31.244 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:31.244 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:31 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:31.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:31 smithi086 ceph-mon[30110]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:31.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:31.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:31.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:31 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:31.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:31 smithi172 ceph-mon[34517]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:31.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:31.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:31.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:31 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:32.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:32 smithi176 ceph-mon[34357]: Deploying daemon mds.c on smithi176 2024-05-12T11:05:32.554 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:32 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] up:boot 2024-05-12T11:05:32.554 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:32 smithi176 ceph-mon[34357]: fsmap 6 up:standby 2024-05-12T11:05:32.554 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:32 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:05:32.605 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:32.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:32 smithi086 ceph-mon[30110]: Deploying daemon mds.c on smithi176 2024-05-12T11:05:32.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:32 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] up:boot 2024-05-12T11:05:32.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:32 smithi086 ceph-mon[30110]: fsmap 6 up:standby 2024-05-12T11:05:32.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:32 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:05:32.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:32 smithi172 ceph-mon[34517]: Deploying daemon mds.c on smithi176 2024-05-12T11:05:32.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:32 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] up:boot 2024-05-12T11:05:32.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:32 smithi172 ceph-mon[34517]: fsmap 6 up:standby 2024-05-12T11:05:32.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:32 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:05:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:33.256 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 systemd[1]: Starting Ceph mds.c for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:33.509 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:33 smithi176 ceph-mon[34357]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:33.509 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 podman[65585]: 2024-05-12 11:05:33.261290585 +0000 UTC m=+0.018184503 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:33.510 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 podman[65585]: 2024-05-12 11:05:33.41850794 +0000 UTC m=+0.175401885 container create 2a5c72407815e4ec079441b5d2216323584226db39689e23b01ec2d240cbbe84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-12T11:05:33.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:33 smithi086 ceph-mon[30110]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:33.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:33 smithi172 ceph-mon[34517]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:34.017 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 podman[65585]: 2024-05-12 11:05:33.596658059 +0000 UTC m=+0.353551962 container init 2a5c72407815e4ec079441b5d2216323584226db39689e23b01ec2d240cbbe84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-12T11:05:34.017 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 podman[65585]: 2024-05-12 11:05:33.599512359 +0000 UTC m=+0.356406269 container start 2a5c72407815e4ec079441b5d2216323584226db39689e23b01ec2d240cbbe84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-05-12T11:05:34.017 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 ceph-mds[65604]: -- 172.21.15.176:0/331683999 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d441beda40 con 0x55d441bc0c00 2024-05-12T11:05:34.017 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c[65600]: starting mds.c at 2024-05-12T11:05:34.017 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 bash[65585]: 2a5c72407815e4ec079441b5d2216323584226db39689e23b01ec2d240cbbe84 2024-05-12T11:05:34.017 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:05:33 smithi176 systemd[1]: Started Ceph mds.c for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 -- 172.21.15.86:0/4031019202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48104130 msgr2=0x7efd48108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/4031019202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48104130 0x7efd48108140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd340099c0 tx=0x7efd34009cd0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 -- 172.21.15.86:0/4031019202 shutdown_connections 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/4031019202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd48108870 0x7efd481103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/4031019202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48103780 0x7efd48103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/4031019202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48104130 0x7efd48108140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 -- 172.21.15.86:0/4031019202 >> 172.21.15.86:0/4031019202 conn(0x7efd4807a610 msgr2=0x7efd4807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 -- 172.21.15.86:0/4031019202 shutdown_connections 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.541+0000 7efd4ee3a700 1 -- 172.21.15.86:0/4031019202 wait complete. 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4ee3a700 1 Processor -- start 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4ee3a700 1 -- start start 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4ee3a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd48103780 0x7efd4819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4ee3a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48104130 0x7efd4819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4ee3a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48108870 0x7efd48199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4ee3a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efd48113630 con 0x7efd48108870 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4ee3a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd481134b0 con 0x7efd48104130 2024-05-12T11:05:34.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4ee3a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efd481137b0 con 0x7efd48103780 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4d3d7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48108870 0x7efd48199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4d3d7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48108870 0x7efd48199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44010/0 (socket says 172.21.15.86:44010) 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4d3d7700 1 -- 172.21.15.86:0/1887969788 learned_addr learned my addr 172.21.15.86:0/1887969788 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd47fff700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48104130 0x7efd4819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4cbd6700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd48103780 0x7efd4819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4d3d7700 1 -- 172.21.15.86:0/1887969788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd48103780 msgr2=0x7efd4819f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4d3d7700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd48103780 0x7efd4819f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4d3d7700 1 -- 172.21.15.86:0/1887969788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48104130 msgr2=0x7efd4819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4d3d7700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48104130 0x7efd4819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.542+0000 7efd4d3d7700 1 -- 172.21.15.86:0/1887969788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4819a090 con 0x7efd48108870 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.543+0000 7efd4d3d7700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48108870 0x7efd48199930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd40007ee0 tx=0x7efd4000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.543+0000 7efd45ffb700 1 -- 172.21.15.86:0/1887969788 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4000dbd0 con 0x7efd48108870 2024-05-12T11:05:34.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.543+0000 7efd45ffb700 1 -- 172.21.15.86:0/1887969788 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd4000dd70 con 0x7efd48108870 2024-05-12T11:05:34.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.543+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4819a380 con 0x7efd48108870 2024-05-12T11:05:34.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.543+0000 7efd45ffb700 1 -- 172.21.15.86:0/1887969788 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40005990 con 0x7efd48108870 2024-05-12T11:05:34.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.543+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd481a65f0 con 0x7efd48108870 2024-05-12T11:05:34.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.544+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd4806a190 con 0x7efd48108870 2024-05-12T11:05:34.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.545+0000 7efd45ffb700 1 -- 172.21.15.86:0/1887969788 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7efd4001a020 con 0x7efd48108870 2024-05-12T11:05:34.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.546+0000 7efd45ffb700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd380b2880 0x7efd380b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:34.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.546+0000 7efd4cbd6700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd380b2880 0x7efd380b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:34.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.546+0000 7efd45ffb700 1 -- 172.21.15.86:0/1887969788 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7efd400e1500 con 0x7efd48108870 2024-05-12T11:05:34.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.546+0000 7efd4cbd6700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd380b2880 0x7efd380b4d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005950 tx=0x7efd3c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:34.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.550+0000 7efd45ffb700 1 -- 172.21.15.86:0/1887969788 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efd40010070 con 0x7efd48108870 2024-05-12T11:05:34.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.802+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd4802e510 con 0x7efd48108870 2024-05-12T11:05:34.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.802+0000 7efd45ffb700 1 -- 172.21.15.86:0/1887969788 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6352 (secure 0 0 0) 0x7efd400a96c0 con 0x7efd48108870 2024-05-12T11:05:34.794 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:34.794 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24436,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-12T11:05:34.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd380b2880 msgr2=0x7efd380b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:34.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd380b2880 0x7efd380b4d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005950 tx=0x7efd3c0058e0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48108870 msgr2=0x7efd48199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:34.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48108870 0x7efd48199930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd40007ee0 tx=0x7efd4000d3b0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 shutdown_connections 2024-05-12T11:05:34.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efd380b2880 0x7efd380b4d40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48108870 0x7efd48199930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd48103780 0x7efd4819f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 --2- 172.21.15.86:0/1887969788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48104130 0x7efd4819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:34.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 >> 172.21.15.86:0/1887969788 conn(0x7efd4807a610 msgr2=0x7efd481017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:34.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 shutdown_connections 2024-05-12T11:05:34.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:34.805+0000 7efd4ee3a700 1 -- 172.21.15.86:0/1887969788 wait complete. 2024-05-12T11:05:34.797 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: Deploying daemon mds.h on smithi172 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] up:boot 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: fsmap 7 up:standby 2024-05-12T11:05:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:34 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:05:35.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:35.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:35.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:35.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:35.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:35.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:35.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: Deploying daemon mds.h on smithi172 2024-05-12T11:05:35.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] up:boot 2024-05-12T11:05:35.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: fsmap 7 up:standby 2024-05-12T11:05:35.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:34 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: Deploying daemon mds.h on smithi172 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] up:boot 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: fsmap 7 up:standby 2024-05-12T11:05:35.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:34 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:05:35.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:35 smithi086 ceph-mon[30110]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:35.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:35 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1887969788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:35.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:35 smithi172 ceph-mon[34517]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:35.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:35 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1887969788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:36.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:35 smithi176 ceph-mon[34357]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:36.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:35 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1887969788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:36.973 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:05:36 smithi172 systemd[1]: Started Ceph mds.h for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:37.426 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:37.671 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:37.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:37.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] up:boot 2024-05-12T11:05:37.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: fsmap 8 up:standby 2024-05-12T11:05:37.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:05:37.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:37.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:37.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:37.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:37.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:37.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:37 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:38.042 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] up:boot 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: fsmap 8 up:standby 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:38.043 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:37 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:38.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] up:boot 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: fsmap 8 up:standby 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:38.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:37 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:38.853 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:38 smithi176 ceph-mon[34357]: Deploying daemon mds.i on smithi176 2024-05-12T11:05:39.109 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:38 smithi086 ceph-mon[30110]: Deploying daemon mds.i on smithi176 2024-05-12T11:05:39.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:38 smithi172 ceph-mon[34517]: Deploying daemon mds.i on smithi176 2024-05-12T11:05:39.250 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 systemd[1]: Starting Ceph mds.i for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 -- 172.21.15.86:0/1546232567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 msgr2=0x7ff19c109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/1546232567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 0x7ff19c109970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0099c0 tx=0x7ff18c009cd0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 -- 172.21.15.86:0/1546232567 shutdown_connections 2024-05-12T11:05:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/1546232567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff19c06c630 0x7ff19c110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/1546232567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 0x7ff19c109970 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/1546232567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff19c06bc70 0x7ff19c06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 -- 172.21.15.86:0/1546232567 >> 172.21.15.86:0/1546232567 conn(0x7ff19c079440 msgr2=0x7ff19c079850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:39.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 -- 172.21.15.86:0/1546232567 shutdown_connections 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.337+0000 7ff1a0d35700 1 -- 172.21.15.86:0/1546232567 wait complete. 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff1a0d35700 1 Processor -- start 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff1a0d35700 1 -- start start 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff1a0d35700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff19c06bc70 0x7ff19c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff1a0d35700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff19c06c630 0x7ff19c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff1a0d35700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 0x7ff19c199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff1a0d35700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c113760 con 0x7ff19c109590 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff1a0d35700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1135e0 con 0x7ff19c06c630 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff1a0d35700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1138e0 con 0x7ff19c06bc70 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 0x7ff19c199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 0x7ff19c199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44032/0 (socket says 172.21.15.86:44032) 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 -- 172.21.15.86:0/2623310949 learned_addr learned my addr 172.21.15.86:0/2623310949 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:39.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19a59c700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff19c06bc70 0x7ff19c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff199d9b700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff19c06c630 0x7ff19c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 -- 172.21.15.86:0/2623310949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff19c06bc70 msgr2=0x7ff19c19f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff19c06bc70 0x7ff19c19f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 -- 172.21.15.86:0/2623310949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff19c06c630 msgr2=0x7ff19c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff19c06c630 0x7ff19c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 -- 172.21.15.86:0/2623310949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c19a180 con 0x7ff19c109590 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.338+0000 7ff19ad9d700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 0x7ff19c199a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff194007ee0 tx=0x7ff19400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.339+0000 7ff18b7fe700 1 -- 172.21.15.86:0/2623310949 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19400dbd0 con 0x7ff19c109590 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.339+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19c19a470 con 0x7ff19c109590 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.339+0000 7ff18b7fe700 1 -- 172.21.15.86:0/2623310949 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff19400dd70 con 0x7ff19c109590 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.339+0000 7ff18b7fe700 1 -- 172.21.15.86:0/2623310949 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194005990 con 0x7ff19c109590 2024-05-12T11:05:39.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.339+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19c1a6730 con 0x7ff19c109590 2024-05-12T11:05:39.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.340+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19c10ba20 con 0x7ff19c109590 2024-05-12T11:05:39.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.342+0000 7ff18b7fe700 1 -- 172.21.15.86:0/2623310949 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff19401a020 con 0x7ff19c109590 2024-05-12T11:05:39.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.343+0000 7ff18b7fe700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1840b2880 0x7ff1840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:39.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.343+0000 7ff19a59c700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1840b2880 0x7ff1840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:39.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.343+0000 7ff18b7fe700 1 -- 172.21.15.86:0/2623310949 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff1940e1ca0 con 0x7ff19c109590 2024-05-12T11:05:39.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.343+0000 7ff19a59c700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1840b2880 0x7ff1840b4d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff19c19ab60 tx=0x7ff18c005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:39.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.346+0000 7ff18b7fe700 1 -- 172.21.15.86:0/2623310949 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff194010070 con 0x7ff19c109590 2024-05-12T11:05:39.516 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 podman[65891]: 2024-05-12 11:05:39.161969544 +0000 UTC m=+0.018421852 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:39.517 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 podman[65891]: 2024-05-12 11:05:39.273714132 +0000 UTC m=+0.130166459 container create dae97fceaa9af3a091dbfafa7eca71bfee0c1bd4037b2b4d0838671c0e99bf0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.600+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff19c19af80 con 0x7ff19c109590 2024-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.601+0000 7ff18b7fe700 1 -- 172.21.15.86:0/2623310949 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7180 (secure 0 0 0) 0x7ff19c19af80 con 0x7ff19c109590 2024-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24422,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24436,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1840b2880 msgr2=0x7ff1840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1840b2880 0x7ff1840b4d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff19c19ab60 tx=0x7ff18c005c40 comp rx=0 tx=0).stop 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 msgr2=0x7ff19c199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 0x7ff19c199a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff194007ee0 tx=0x7ff19400d3b0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 shutdown_connections 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff1840b2880 0x7ff1840b4d40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c109590 0x7ff19c199a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff19c06bc70 0x7ff19c19f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 --2- 172.21.15.86:0/2623310949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff19c06c630 0x7ff19c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 >> 172.21.15.86:0/2623310949 conn(0x7ff19c079440 msgr2=0x7ff19c1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.603+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 shutdown_connections 2024-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:39.604+0000 7ff1a0d35700 1 -- 172.21.15.86:0/2623310949 wait complete. 2024-05-12T11:05:39.596 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-05-12T11:05:39.773 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 podman[65891]: 2024-05-12 11:05:39.535028968 +0000 UTC m=+0.391481253 container init dae97fceaa9af3a091dbfafa7eca71bfee0c1bd4037b2b4d0838671c0e99bf0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-12T11:05:39.773 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 podman[65891]: 2024-05-12 11:05:39.537961602 +0000 UTC m=+0.394413894 container start dae97fceaa9af3a091dbfafa7eca71bfee0c1bd4037b2b4d0838671c0e99bf0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:05:39.773 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mds[65910]: -- 172.21.15.176:0/4162835331 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b7ac32fa40 con 0x55b7ac303000 2024-05-12T11:05:39.773 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i[65906]: starting mds.i at 2024-05-12T11:05:39.773 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 bash[65891]: dae97fceaa9af3a091dbfafa7eca71bfee0c1bd4037b2b4d0838671c0e99bf0b 2024-05-12T11:05:39.773 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:05:39 smithi176 systemd[1]: Started Ceph mds.i for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:39.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:39 smithi086 ceph-mon[30110]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:39.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:39 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2623310949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:39.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:39.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:39.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:39.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:39.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:39.897 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:39 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:40.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:39 smithi172 ceph-mon[34517]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:40.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:39 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2623310949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:40.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:40.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:40.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:40.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:40.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:40.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:39 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:40.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mon[34357]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:40.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2623310949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:40.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:40.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:40.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:40.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:40.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:40.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:39 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:40.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:40 smithi086 ceph-mon[30110]: Deploying daemon mds.g on smithi086 2024-05-12T11:05:40.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:40 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] up:boot 2024-05-12T11:05:40.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:40 smithi086 ceph-mon[30110]: fsmap 9 up:standby 2024-05-12T11:05:40.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:40 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:05:41.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:40 smithi172 ceph-mon[34517]: Deploying daemon mds.g on smithi086 2024-05-12T11:05:41.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:40 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] up:boot 2024-05-12T11:05:41.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:40 smithi172 ceph-mon[34517]: fsmap 9 up:standby 2024-05-12T11:05:41.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:40 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:05:41.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:40 smithi176 ceph-mon[34357]: Deploying daemon mds.g on smithi086 2024-05-12T11:05:41.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:40 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] up:boot 2024-05-12T11:05:41.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:40 smithi176 ceph-mon[34357]: fsmap 9 up:standby 2024-05-12T11:05:41.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:40 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:05:41.961 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:41 smithi176 ceph-mon[34357]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:41.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:41 smithi086 ceph-mon[30110]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:41.962 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:41 smithi086 systemd[1]: Starting Ceph mds.g for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:42.219 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:42.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:41 smithi172 ceph-mon[34517]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:42.349 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:42 smithi086 podman[68798]: 2024-05-12 11:05:41.994313735 +0000 UTC m=+0.018256863 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:42.349 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:42 smithi086 podman[68798]: 2024-05-12 11:05:42.099211271 +0000 UTC m=+0.123154385 container create 4d7310f5c6c3fba07c711e14c537a693d8c5412485d877b24449778d1856ef72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0) 2024-05-12T11:05:42.349 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:42 smithi086 podman[68798]: 2024-05-12 11:05:42.331769003 +0000 UTC m=+0.355712117 container init 4d7310f5c6c3fba07c711e14c537a693d8c5412485d877b24449778d1856ef72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-05-12T11:05:42.350 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:42 smithi086 podman[68798]: 2024-05-12 11:05:42.335287112 +0000 UTC m=+0.359230227 container start 4d7310f5c6c3fba07c711e14c537a693d8c5412485d877b24449778d1856ef72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:05:42.350 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:42 smithi086 ceph-mds[68835]: -- 172.21.15.86:0/175312894 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c5614e5a40 con 0x55c5614b8800 2024-05-12T11:05:42.507 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:42.629 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g[68813]: starting mds.g at 2024-05-12T11:05:42.629 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:42 smithi086 bash[68798]: 4d7310f5c6c3fba07c711e14c537a693d8c5412485d877b24449778d1856ef72 2024-05-12T11:05:42.629 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:05:42 smithi086 systemd[1]: Started Ceph mds.g for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:43.679 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: Deploying daemon mds.a on smithi086 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.86:6838/2477289859,v1:172.21.15.86:6839/2477289859] up:boot 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: fsmap 10 up:standby 2024-05-12T11:05:43.680 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:43 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:05:43.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: Deploying daemon mds.a on smithi086 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.86:6838/2477289859,v1:172.21.15.86:6839/2477289859] up:boot 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: fsmap 10 up:standby 2024-05-12T11:05:43.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:43 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:05:43.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: Deploying daemon mds.a on smithi086 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.86:6838/2477289859,v1:172.21.15.86:6839/2477289859] up:boot 2024-05-12T11:05:43.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: fsmap 10 up:standby 2024-05-12T11:05:43.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:43 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:05:44.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 -- 172.21.15.86:0/2603345724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4781076c0 msgr2=0x7fd47810f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:44.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 --2- 172.21.15.86:0/2603345724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4781076c0 0x7fd47810f290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd47000b0d0 tx=0x7fd47000b3e0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 -- 172.21.15.86:0/2603345724 shutdown_connections 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 --2- 172.21.15.86:0/2603345724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4781076c0 0x7fd47810f290 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 --2- 172.21.15.86:0/2603345724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd478102630 0x7fd478102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 --2- 172.21.15.86:0/2603345724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd478102fe0 0x7fd478106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 -- 172.21.15.86:0/2603345724 >> 172.21.15.86:0/2603345724 conn(0x7fd478079370 msgr2=0x7fd478079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 -- 172.21.15.86:0/2603345724 shutdown_connections 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.228+0000 7fd48041c700 1 -- 172.21.15.86:0/2603345724 wait complete. 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd48041c700 1 Processor -- start 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd48041c700 1 -- start start 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd48041c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd478102630 0x7fd47819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd48041c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd478102fe0 0x7fd47819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd48041c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4781076c0 0x7fd4781a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd48041c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd478112580 con 0x7fd478102630 2024-05-12T11:05:44.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd48041c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd478112400 con 0x7fd478102fe0 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd48041c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd478112700 con 0x7fd4781076c0 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd47e1b8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd478102630 0x7fd47819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd47e1b8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd478102630 0x7fd47819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42876/0 (socket says 172.21.15.86:42876) 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd47e1b8700 1 -- 172.21.15.86:0/25831708 learned_addr learned my addr 172.21.15.86:0/25831708 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.229+0000 7fd47e9b9700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4781076c0 0x7fd4781a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd47e1b8700 1 -- 172.21.15.86:0/25831708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4781076c0 msgr2=0x7fd4781a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd47e1b8700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4781076c0 0x7fd4781a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd47e1b8700 1 -- 172.21.15.86:0/25831708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd478102fe0 msgr2=0x7fd47819af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd47e1b8700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd478102fe0 0x7fd47819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd47e1b8700 1 -- 172.21.15.86:0/25831708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4781a5fc0 con 0x7fd478102630 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd47e9b9700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4781076c0 0x7fd4781a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd47e1b8700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd478102630 0x7fd47819aa00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c920 tx=0x7fd47400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd46f7fe700 1 -- 172.21.15.86:0/25831708 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474007b00 con 0x7fd478102630 2024-05-12T11:05:44.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4781a61f0 con 0x7fd478102630 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd46f7fe700 1 -- 172.21.15.86:0/25831708 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd474004ce0 con 0x7fd478102630 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd46f7fe700 1 -- 172.21.15.86:0/25831708 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474005650 con 0x7fd478102630 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.230+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4781a6750 con 0x7fd478102630 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.231+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd47806a190 con 0x7fd478102630 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.232+0000 7fd46f7fe700 1 -- 172.21.15.86:0/25831708 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd474007ca0 con 0x7fd478102630 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.233+0000 7fd46f7fe700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd4640b2880 0x7fd4640b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.233+0000 7fd47d9b7700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd4640b2880 0x7fd4640b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.233+0000 7fd46f7fe700 1 -- 172.21.15.86:0/25831708 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd4740e1d40 con 0x7fd478102630 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.233+0000 7fd47d9b7700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd4640b2880 0x7fd4640b4d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd468005fd0 tx=0x7fd468005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:44.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.236+0000 7fd46f7fe700 1 -- 172.21.15.86:0/25831708 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd474014030 con 0x7fd478102630 2024-05-12T11:05:44.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.492+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd47802e510 con 0x7fd478102630 2024-05-12T11:05:44.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.493+0000 7fd46f7fe700 1 -- 172.21.15.86:0/25831708 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8833 (secure 0 0 0) 0x7fd4740a9f00 con 0x7fd478102630 2024-05-12T11:05:44.484 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:44.485 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24422,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24436,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd4640b2880 msgr2=0x7fd4640b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd4640b2880 0x7fd4640b4d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd468005fd0 tx=0x7fd468005ee0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd478102630 msgr2=0x7fd47819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd478102630 0x7fd47819aa00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c920 tx=0x7fd47400cce0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 shutdown_connections 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd4640b2880 0x7fd4640b4d40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4781076c0 0x7fd4781a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd478102630 0x7fd47819aa00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.496+0000 7fd48041c700 1 --2- 172.21.15.86:0/25831708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd478102fe0 0x7fd47819af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:44.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.497+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 >> 172.21.15.86:0/25831708 conn(0x7fd478079370 msgr2=0x7fd478100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:44.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.497+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 shutdown_connections 2024-05-12T11:05:44.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:44.497+0000 7fd48041c700 1 -- 172.21.15.86:0/25831708 wait complete. 2024-05-12T11:05:44.489 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 11 2024-05-12T11:05:45.585 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:45 smithi086 ceph-mon[30110]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:45.585 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:45 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/25831708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:45.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:45 smithi176 ceph-mon[34357]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:45.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:45 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/25831708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:45.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:45 smithi172 ceph-mon[34517]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:45.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:45 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/25831708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:46.678 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:46 smithi086 systemd[1]: Starting Ceph mds.a for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:46.951 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:46 smithi086 podman[69251]: 2024-05-12 11:05:46.590421643 +0000 UTC m=+0.018451544 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:46.952 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:46 smithi086 podman[69251]: 2024-05-12 11:05:46.700032273 +0000 UTC m=+0.128062163 container create e11230b9fcd1c629b76ec9c21678f8c2019c0410312185506e35a389d5a53613 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-12T11:05:46.952 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:46 smithi086 podman[69251]: 2024-05-12 11:05:46.961168297 +0000 UTC m=+0.389198184 container init e11230b9fcd1c629b76ec9c21678f8c2019c0410312185506e35a389d5a53613 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-12T11:05:47.213 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:46 smithi086 podman[69251]: 2024-05-12 11:05:46.964033903 +0000 UTC m=+0.392063793 container start e11230b9fcd1c629b76ec9c21678f8c2019c0410312185506e35a389d5a53613 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-12T11:05:47.213 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:46 smithi086 ceph-mds[69271]: -- 172.21.15.86:0/544106297 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e09f03da40 con 0x55e09f010800 2024-05-12T11:05:47.213 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:46 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a[69267]: starting mds.a at 2024-05-12T11:05:47.213 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:47 smithi086 bash[69251]: e11230b9fcd1c629b76ec9c21678f8c2019c0410312185506e35a389d5a53613 2024-05-12T11:05:47.213 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:05:47 smithi086 systemd[1]: Started Ceph mds.a for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:47.617 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:47.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:47 smithi172 ceph-mon[34517]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:47.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:47.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:47.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:47 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:47 smithi176 ceph-mon[34357]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:47.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:47.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:47 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:47.863 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:47.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:47 smithi086 ceph-mon[30110]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:47.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:47.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-12T11:05:47.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-12T11:05:47.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:47 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:48.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:48 smithi086 ceph-mon[30110]: Deploying daemon mds.b on smithi172 2024-05-12T11:05:48.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:48 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.86:6840/637755871,v1:172.21.15.86:6841/637755871] up:boot 2024-05-12T11:05:48.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:48 smithi086 ceph-mon[30110]: fsmap 11 up:standby 2024-05-12T11:05:48.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:48 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:05:48.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:48 smithi176 ceph-mon[34357]: Deploying daemon mds.b on smithi172 2024-05-12T11:05:48.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:48 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.86:6840/637755871,v1:172.21.15.86:6841/637755871] up:boot 2024-05-12T11:05:48.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:48 smithi176 ceph-mon[34357]: fsmap 11 up:standby 2024-05-12T11:05:48.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:48 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:05:48.905 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:48 smithi172 ceph-mon[34517]: Deploying daemon mds.b on smithi172 2024-05-12T11:05:48.905 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:48 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.86:6840/637755871,v1:172.21.15.86:6841/637755871] up:boot 2024-05-12T11:05:48.906 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:48 smithi172 ceph-mon[34517]: fsmap 11 up:standby 2024-05-12T11:05:48.906 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:48 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:05:49.473 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 systemd[1]: Starting Ceph mds.b for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:05:49.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 -- 172.21.15.86:0/3692907876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06c5d0 msgr2=0x7fd73c110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 --2- 172.21.15.86:0/3692907876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06c5d0 0x7fd73c110380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd73400b0a0 tx=0x7fd73400b3b0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 -- 172.21.15.86:0/3692907876 shutdown_connections 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 --2- 172.21.15.86:0/3692907876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06c5d0 0x7fd73c110380 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 --2- 172.21.15.86:0/3692907876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73c109540 0x7fd73c109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 --2- 172.21.15.86:0/3692907876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd73c06bc10 0x7fd73c06c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 -- 172.21.15.86:0/3692907876 >> 172.21.15.86:0/3692907876 conn(0x7fd73c078410 msgr2=0x7fd73c078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 -- 172.21.15.86:0/3692907876 shutdown_connections 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.535+0000 7fd740e52700 1 -- 172.21.15.86:0/3692907876 wait complete. 2024-05-12T11:05:49.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd740e52700 1 Processor -- start 2024-05-12T11:05:49.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd740e52700 1 -- start start 2024-05-12T11:05:49.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd740e52700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06bc10 0x7fd73c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:49.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd740e52700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd73c06c5d0 0x7fd73c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:49.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd740e52700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73c109540 0x7fd73c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:49.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd740e52700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c113640 con 0x7fd73c06bc10 2024-05-12T11:05:49.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd740e52700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c1134c0 con 0x7fd73c109540 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd740e52700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c1137c0 con 0x7fd73c06c5d0 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd73a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06bc10 0x7fd73c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd73a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06bc10 0x7fd73c19f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42912/0 (socket says 172.21.15.86:42912) 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd73a59c700 1 -- 172.21.15.86:0/2932423690 learned_addr learned my addr 172.21.15.86:0/2932423690 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd73ad9d700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73c109540 0x7fd73c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.536+0000 7fd731d9b700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd73c06c5d0 0x7fd73c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd73a59c700 1 -- 172.21.15.86:0/2932423690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd73c06c5d0 msgr2=0x7fd73c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd73a59c700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd73c06c5d0 0x7fd73c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd73a59c700 1 -- 172.21.15.86:0/2932423690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73c109540 msgr2=0x7fd73c199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd73a59c700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73c109540 0x7fd73c199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd73a59c700 1 -- 172.21.15.86:0/2932423690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c199fe0 con 0x7fd73c06bc10 2024-05-12T11:05:49.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd73ad9d700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73c109540 0x7fd73c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:05:49.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd73a59c700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06bc10 0x7fd73c19f6c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd72c00c9b0 tx=0x7fd72c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:49.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd733fff700 1 -- 172.21.15.86:0/2932423690 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c007b00 con 0x7fd73c06bc10 2024-05-12T11:05:49.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd733fff700 1 -- 172.21.15.86:0/2932423690 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd72c00ce50 con 0x7fd73c06bc10 2024-05-12T11:05:49.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73c19a2d0 con 0x7fd73c06bc10 2024-05-12T11:05:49.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd733fff700 1 -- 172.21.15.86:0/2932423690 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c018660 con 0x7fd73c06bc10 2024-05-12T11:05:49.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.537+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd73c1a6590 con 0x7fd73c06bc10 2024-05-12T11:05:49.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.538+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73c104c00 con 0x7fd73c06bc10 2024-05-12T11:05:49.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.539+0000 7fd733fff700 1 -- 172.21.15.86:0/2932423690 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd72c00f450 con 0x7fd73c06bc10 2024-05-12T11:05:49.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.540+0000 7fd733fff700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd7280b2880 0x7fd7280b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:49.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.540+0000 7fd731d9b700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd7280b2880 0x7fd7280b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:49.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.540+0000 7fd733fff700 1 -- 172.21.15.86:0/2932423690 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd72c0e1eb0 con 0x7fd73c06bc10 2024-05-12T11:05:49.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.540+0000 7fd731d9b700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd7280b2880 0x7fd7280b4d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd73c078a10 tx=0x7fd72400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:49.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.544+0000 7fd733fff700 1 -- 172.21.15.86:0/2932423690 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd72c014030 con 0x7fd73c06bc10 2024-05-12T11:05:49.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:49 smithi086 ceph-mon[30110]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:49.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:49 smithi176 ceph-mon[34357]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:49.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.792+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd73c19ade0 con 0x7fd73c06bc10 2024-05-12T11:05:49.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.793+0000 7fd733fff700 1 -- 172.21.15.86:0/2932423690 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9656 (secure 0 0 0) 0x7fd73c19ade0 con 0x7fd73c06bc10 2024-05-12T11:05:49.784 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:49.785 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24422,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24436,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.795+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd7280b2880 msgr2=0x7fd7280b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.795+0000 7fd740e52700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd7280b2880 0x7fd7280b4d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd73c078a10 tx=0x7fd72400b3c0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.795+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06bc10 msgr2=0x7fd73c19f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.795+0000 7fd740e52700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06bc10 0x7fd73c19f6c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd72c00c9b0 tx=0x7fd72c00ccc0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.796+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 shutdown_connections 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.796+0000 7fd740e52700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd7280b2880 0x7fd7280b4d40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.796+0000 7fd740e52700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73c109540 0x7fd73c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.796+0000 7fd740e52700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd73c06bc10 0x7fd73c19f6c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.796+0000 7fd740e52700 1 --2- 172.21.15.86:0/2932423690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd73c06c5d0 0x7fd73c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.796+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 >> 172.21.15.86:0/2932423690 conn(0x7fd73c078410 msgr2=0x7fd73c101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:49.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.796+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 shutdown_connections 2024-05-12T11:05:49.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:49.796+0000 7fd740e52700 1 -- 172.21.15.86:0/2932423690 wait complete. 2024-05-12T11:05:49.788 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 12 2024-05-12T11:05:49.844 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:49 smithi172 ceph-mon[34517]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:49.845 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 podman[64755]: 2024-05-12 11:05:49.489039308 +0000 UTC m=+0.018215182 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:05:49.845 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 podman[64755]: 2024-05-12 11:05:49.600928487 +0000 UTC m=+0.130104403 container create d5ccd53698889b5c11dcf9053d2b0f3d81bd9f3d9d479f95552b2b90364d92e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-12T11:05:50.223 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 podman[64755]: 2024-05-12 11:05:49.854541628 +0000 UTC m=+0.383717483 container init d5ccd53698889b5c11dcf9053d2b0f3d81bd9f3d9d479f95552b2b90364d92e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux ) 2024-05-12T11:05:50.223 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 podman[64755]: 2024-05-12 11:05:49.857386448 +0000 UTC m=+0.386562308 container start d5ccd53698889b5c11dcf9053d2b0f3d81bd9f3d9d479f95552b2b90364d92e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:05:50.223 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 ceph-mds[64775]: -- 172.21.15.172:0/2059529789 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cbd6bb3a40 con 0x55cbd6b87000 2024-05-12T11:05:50.223 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b[64771]: starting mds.b at 2024-05-12T11:05:50.223 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 bash[64755]: d5ccd53698889b5c11dcf9053d2b0f3d81bd9f3d9d479f95552b2b90364d92e1 2024-05-12T11:05:50.223 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:05:49 smithi172 systemd[1]: Started Ceph mds.b for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:05:50.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:50 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2932423690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:50.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:50 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:50.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:50 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2932423690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:50.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:50 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:50.988 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:50 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2932423690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:50.988 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.988 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.988 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.988 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.988 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:50.989 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:50 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:51.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:51 smithi086 ceph-mon[30110]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:51.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:51 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] up:boot 2024-05-12T11:05:51.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:51 smithi086 ceph-mon[30110]: fsmap 12 up:standby 2024-05-12T11:05:51.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:51 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:05:51.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:51 smithi172 ceph-mon[34517]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:51.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:51 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] up:boot 2024-05-12T11:05:51.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:51 smithi172 ceph-mon[34517]: fsmap 12 up:standby 2024-05-12T11:05:51.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:51 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:05:52.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:51 smithi176 ceph-mon[34357]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:52.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:51 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] up:boot 2024-05-12T11:05:52.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:51 smithi176 ceph-mon[34357]: fsmap 12 up:standby 2024-05-12T11:05:52.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:51 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:05:52.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:05:52.757 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:53.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:53.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:53.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:52 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:53.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:52 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:53.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:53.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:53.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:53.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:52 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:05:54.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:53 smithi086 ceph-mon[30110]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:54.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:53 smithi172 ceph-mon[34517]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:54.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:53 smithi176 ceph-mon[34357]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.513+0000 7f5dbc629700 1 -- 172.21.15.86:0/2435099972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 msgr2=0x7f5db4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.513+0000 7f5dbc629700 1 --2- 172.21.15.86:0/2435099972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 0x7f5db4110330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00b0a0 tx=0x7f5dac00b3b0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 -- 172.21.15.86:0/2435099972 shutdown_connections 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 --2- 172.21.15.86:0/2435099972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 0x7f5db4110330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 --2- 172.21.15.86:0/2435099972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db4109510 0x7f5db41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 --2- 172.21.15.86:0/2435099972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db406b180 0x7f5db406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 -- 172.21.15.86:0/2435099972 >> 172.21.15.86:0/2435099972 conn(0x7f5db4079350 msgr2=0x7f5db4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 -- 172.21.15.86:0/2435099972 shutdown_connections 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 -- 172.21.15.86:0/2435099972 wait complete. 2024-05-12T11:05:54.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 Processor -- start 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 -- start start 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db406b180 0x7f5db419f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 0x7f5db419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db4109510 0x7f5db4199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4113760 con 0x7f5db406bb40 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5db41135e0 con 0x7f5db4109510 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.514+0000 7f5dbc629700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5db41138e0 con 0x7f5db406b180 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 0x7f5db419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 0x7f5db419fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56236/0 (socket says 172.21.15.86:56236) 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 -- 172.21.15.86:0/1354931489 learned_addr learned my addr 172.21.15.86:0/1354931489 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:54.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5dba3c5700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db406b180 0x7f5db419f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 -- 172.21.15.86:0/1354931489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db406b180 msgr2=0x7f5db419f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db406b180 0x7f5db419f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 -- 172.21.15.86:0/1354931489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db4109510 msgr2=0x7f5db4199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db4109510 0x7f5db4199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 -- 172.21.15.86:0/1354931489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db419a240 con 0x7f5db406bb40 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5db9bc4700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 0x7f5db419fe60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5da400b550 tx=0x7f5da400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5dab7fe700 1 -- 172.21.15.86:0/1354931489 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4015020 con 0x7f5db406bb40 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5dab7fe700 1 -- 172.21.15.86:0/1354931489 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5da4011ce0 con 0x7f5db406bb40 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db419a530 con 0x7f5db406bb40 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5dab7fe700 1 -- 172.21.15.86:0/1354931489 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4010d20 con 0x7f5db406bb40 2024-05-12T11:05:54.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.515+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db41a67f0 con 0x7f5db406bb40 2024-05-12T11:05:54.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.516+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db406a190 con 0x7f5db406bb40 2024-05-12T11:05:54.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.518+0000 7f5dab7fe700 1 -- 172.21.15.86:0/1354931489 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5da4018020 con 0x7f5db406bb40 2024-05-12T11:05:54.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.518+0000 7f5dab7fe700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5da00b2900 0x7f5da00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:54.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.518+0000 7f5dba3c5700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5da00b2900 0x7f5da00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:54.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.518+0000 7f5dab7fe700 1 -- 172.21.15.86:0/1354931489 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5da40e1b10 con 0x7f5db406bb40 2024-05-12T11:05:54.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.519+0000 7f5dba3c5700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5da00b2900 0x7f5da00b4dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5db000a850 tx=0x7f5db0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:54.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.522+0000 7f5dab7fe700 1 -- 172.21.15.86:0/1354931489 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5da401f020 con 0x7f5db406bb40 2024-05-12T11:05:54.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.781+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5db402e510 con 0x7f5db406bb40 2024-05-12T11:05:54.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.782+0000 7f5dab7fe700 1 -- 172.21.15.86:0/1354931489 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10485 (secure 0 0 0) 0x7f5da40a9cd0 con 0x7f5db406bb40 2024-05-12T11:05:54.773 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:54.773 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24398,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24422,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24436,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24443,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-12T11:05:54.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5da00b2900 msgr2=0x7f5da00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:54.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5da00b2900 0x7f5da00b4dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5db000a850 tx=0x7f5db0008040 comp rx=0 tx=0).stop 2024-05-12T11:05:54.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 msgr2=0x7f5db419fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:54.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 0x7f5db419fe60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5da400b550 tx=0x7f5da400b910 comp rx=0 tx=0).stop 2024-05-12T11:05:54.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 shutdown_connections 2024-05-12T11:05:54.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5da00b2900 0x7f5da00b4dc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db4109510 0x7f5db4199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db406b180 0x7f5db419f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 --2- 172.21.15.86:0/1354931489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5db406bb40 0x7f5db419fe60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:54.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 >> 172.21.15.86:0/1354931489 conn(0x7f5db4079350 msgr2=0x7f5db4101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:54.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 shutdown_connections 2024-05-12T11:05:54.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:54.786+0000 7f5dbc629700 1 -- 172.21.15.86:0/1354931489 wait complete. 2024-05-12T11:05:54.778 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 13 2024-05-12T11:05:55.431 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.431 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:55 smithi176 ceph-mon[34357]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:55.431 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.431 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.431 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.431 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:55 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.432 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:55 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1354931489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:55.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:55 smithi086 ceph-mon[30110]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:55.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:55 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:55 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1354931489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:55 smithi172 ceph-mon[34517]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:55 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:55 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1354931489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:05:55.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-12T11:05:55.957 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:57.383 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:57 smithi086 ceph-mon[30110]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:57.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:57 smithi172 ceph-mon[34517]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:57.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:57 smithi176 ceph-mon[34357]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:57.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.635+0000 7f3a0a208700 1 -- 172.21.15.86:0/852897132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04102d60 msgr2=0x7f3a0410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:57.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.635+0000 7f3a0a208700 1 --2- 172.21.15.86:0/852897132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04102d60 0x7f3a0410f250 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00b0a0 tx=0x7f39fc00b3b0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.636+0000 7f3a0a208700 1 -- 172.21.15.86:0/852897132 shutdown_connections 2024-05-12T11:05:57.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.636+0000 7f3a0a208700 1 --2- 172.21.15.86:0/852897132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04102d60 0x7f3a0410f250 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.636+0000 7f3a0a208700 1 --2- 172.21.15.86:0/852897132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a04108410 0x7f3a041087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.636+0000 7f3a0a208700 1 --2- 172.21.15.86:0/852897132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a041023a0 0x7f3a04102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.636+0000 7f3a0a208700 1 -- 172.21.15.86:0/852897132 >> 172.21.15.86:0/852897132 conn(0x7f3a04079350 msgr2=0x7f3a04079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:57.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.636+0000 7f3a0a208700 1 -- 172.21.15.86:0/852897132 shutdown_connections 2024-05-12T11:05:57.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.636+0000 7f3a0a208700 1 -- 172.21.15.86:0/852897132 wait complete. 2024-05-12T11:05:57.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.636+0000 7f3a0a208700 1 Processor -- start 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a0a208700 1 -- start start 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a0a208700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041023a0 0x7f3a0419e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a0a208700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a04102d60 0x7f3a0419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a0a208700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a04108410 0x7f3a041987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a0a208700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3a04112530 con 0x7f3a041023a0 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a0a208700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3a041123b0 con 0x7f3a04102d60 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a0a208700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a041126b0 con 0x7f3a04108410 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041023a0 0x7f3a0419e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041023a0 0x7f3a0419e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56252/0 (socket says 172.21.15.86:56252) 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 -- 172.21.15.86:0/1482725475 learned_addr learned my addr 172.21.15.86:0/1482725475 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:05:57.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a02ffd700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a04102d60 0x7f3a0419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a03fff700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a04108410 0x7f3a041987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 -- 172.21.15.86:0/1482725475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a04108410 msgr2=0x7f3a041987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a04108410 0x7f3a041987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 -- 172.21.15.86:0/1482725475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a04102d60 msgr2=0x7f3a0419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a04102d60 0x7f3a0419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 -- 172.21.15.86:0/1482725475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a04198fd0 con 0x7f3a041023a0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.637+0000 7f3a037fe700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041023a0 0x7f3a0419e670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f39f400d980 tx=0x7f39f400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.638+0000 7f3a00ff9700 1 -- 172.21.15.86:0/1482725475 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4017030 con 0x7f3a041023a0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.638+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a041992c0 con 0x7f3a041023a0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.638+0000 7f3a00ff9700 1 -- 172.21.15.86:0/1482725475 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f4009df0 con 0x7f3a041023a0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.638+0000 7f3a00ff9700 1 -- 172.21.15.86:0/1482725475 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4005350 con 0x7f3a041023a0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.638+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a041a54d0 con 0x7f3a041023a0 2024-05-12T11:05:57.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.639+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a04103ac0 con 0x7f3a041023a0 2024-05-12T11:05:57.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.640+0000 7f3a00ff9700 1 -- 172.21.15.86:0/1482725475 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f39f401a070 con 0x7f3a041023a0 2024-05-12T11:05:57.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.641+0000 7f3a00ff9700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f39ec0b2880 0x7f39ec0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:05:57.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.641+0000 7f3a02ffd700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f39ec0b2880 0x7f39ec0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:05:57.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.641+0000 7f3a00ff9700 1 -- 172.21.15.86:0/1482725475 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f39f40e1ef0 con 0x7f3a041023a0 2024-05-12T11:05:57.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.641+0000 7f3a02ffd700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f39ec0b2880 0x7f39ec0b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f39f8005fd0 tx=0x7f39f800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:05:57.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.645+0000 7f3a00ff9700 1 -- 172.21.15.86:0/1482725475 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f39f40aa090 con 0x7f3a041023a0 2024-05-12T11:05:57.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.874+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3a0402e510 con 0x7f3a041023a0 2024-05-12T11:05:57.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.874+0000 7f3a00ff9700 1 -- 172.21.15.86:0/1482725475 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f39f40a9990 con 0x7f3a041023a0 2024-05-12T11:05:57.868 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:05:57.868 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2024-05-12T11:05:57.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:05:57.868 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2024-05-12T11:05:57.868 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2024-05-12T11:05:57.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:05:57.868 INFO:teuthology.orchestra.run.smithi086.stdout:] 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f39ec0b2880 msgr2=0x7f39ec0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f39ec0b2880 0x7f39ec0b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f39f8005fd0 tx=0x7f39f800a560 comp rx=0 tx=0).stop 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041023a0 msgr2=0x7f3a0419e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041023a0 0x7f3a0419e670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f39f400d980 tx=0x7f39f400dd40 comp rx=0 tx=0).stop 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 shutdown_connections 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f39ec0b2880 0x7f39ec0b4d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a04108410 0x7f3a041987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041023a0 0x7f3a0419e670 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 --2- 172.21.15.86:0/1482725475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a04102d60 0x7f3a0419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:05:57.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 >> 172.21.15.86:0/1482725475 conn(0x7f3a04079350 msgr2=0x7f3a04100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:05:57.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 shutdown_connections 2024-05-12T11:05:57.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:05:57.877+0000 7f3a0a208700 1 -- 172.21.15.86:0/1482725475 wait complete. 2024-05-12T11:05:58.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:58 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1482725475' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-12T11:05:58.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:58.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:58.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:58 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1482725475' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-12T11:05:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:58 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1482725475' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-12T11:05:58.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:05:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:05:58.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:05:58.669 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-12T11:05:58.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-12T11:05:58.911 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:05:59.350 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:05:59 smithi086 ceph-mon[30110]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:59.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:05:59 smithi172 ceph-mon[34517]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:05:59.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:05:59 smithi176 ceph-mon[34357]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:00.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.545+0000 7fdf251db700 1 -- 172.21.15.86:0/2056672129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf201042f0 msgr2=0x7fdf201046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:00.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.545+0000 7fdf251db700 1 --2- 172.21.15.86:0/2056672129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf201042f0 0x7fdf201046d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009990 tx=0x7fdf10009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:00.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.546+0000 7fdf251db700 1 -- 172.21.15.86:0/2056672129 shutdown_connections 2024-05-12T11:06:00.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.546+0000 7fdf251db700 1 --2- 172.21.15.86:0/2056672129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf20102d90 0x7fdf2010f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:00.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.546+0000 7fdf251db700 1 --2- 172.21.15.86:0/2056672129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf201042f0 0x7fdf201046d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:00.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.546+0000 7fdf251db700 1 --2- 172.21.15.86:0/2056672129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201023d0 0x7fdf20102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:00.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.546+0000 7fdf251db700 1 -- 172.21.15.86:0/2056672129 >> 172.21.15.86:0/2056672129 conn(0x7fdf20078410 msgr2=0x7fdf20078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:00.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.546+0000 7fdf251db700 1 -- 172.21.15.86:0/2056672129 shutdown_connections 2024-05-12T11:06:00.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.546+0000 7fdf251db700 1 -- 172.21.15.86:0/2056672129 wait complete. 2024-05-12T11:06:00.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.546+0000 7fdf251db700 1 Processor -- start 2024-05-12T11:06:00.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf251db700 1 -- start start 2024-05-12T11:06:00.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf251db700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201023d0 0x7fdf2019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:00.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf251db700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf20102d90 0x7fdf2019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:00.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf251db700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf201042f0 0x7fdf20199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:00.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf251db700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20112630 con 0x7fdf20102d90 2024-05-12T11:06:00.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf251db700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201124b0 con 0x7fdf201023d0 2024-05-12T11:06:00.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf251db700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201127b0 con 0x7fdf201042f0 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf20102d90 0x7fdf2019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf20102d90 0x7fdf2019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56268/0 (socket says 172.21.15.86:56268) 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 -- 172.21.15.86:0/2944052765 learned_addr learned my addr 172.21.15.86:0/2944052765 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1f59e700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf201042f0 0x7fdf20199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1ed9d700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201023d0 0x7fdf2019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 -- 172.21.15.86:0/2944052765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf201042f0 msgr2=0x7fdf20199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf201042f0 0x7fdf20199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 -- 172.21.15.86:0/2944052765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201023d0 msgr2=0x7fdf2019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201023d0 0x7fdf2019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 -- 172.21.15.86:0/2944052765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2019a0b0 con 0x7fdf20102d90 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf1e59c700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf20102d90 0x7fdf2019fc80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c9b0 tx=0x7fdf1400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:00.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf07fff700 1 -- 172.21.15.86:0/2944052765 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14007b00 con 0x7fdf20102d90 2024-05-12T11:06:00.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2019a3a0 con 0x7fdf20102d90 2024-05-12T11:06:00.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.547+0000 7fdf07fff700 1 -- 172.21.15.86:0/2944052765 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf14007ca0 con 0x7fdf20102d90 2024-05-12T11:06:00.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.548+0000 7fdf07fff700 1 -- 172.21.15.86:0/2944052765 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14018730 con 0x7fdf20102d90 2024-05-12T11:06:00.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.548+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201a6610 con 0x7fdf20102d90 2024-05-12T11:06:00.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.549+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2006a190 con 0x7fdf20102d90 2024-05-12T11:06:00.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.550+0000 7fdf07fff700 1 -- 172.21.15.86:0/2944052765 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fdf1400f450 con 0x7fdf20102d90 2024-05-12T11:06:00.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.551+0000 7fdf07fff700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdf080b2880 0x7fdf080b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:00.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.551+0000 7fdf1ed9d700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdf080b2880 0x7fdf080b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:00.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.551+0000 7fdf07fff700 1 -- 172.21.15.86:0/2944052765 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdf140e1e40 con 0x7fdf20102d90 2024-05-12T11:06:00.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.551+0000 7fdf1ed9d700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdf080b2880 0x7fdf080b4d40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf10006010 tx=0x7fdf1000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.555+0000 7fdf07fff700 1 -- 172.21.15.86:0/2944052765 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdf14014030 con 0x7fdf20102d90 2024-05-12T11:06:00.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:00.757+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdf2002e510 con 0x7fdf20102d90 2024-05-12T11:06:01.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.127+0000 7fdf07fff700 1 -- 172.21.15.86:0/2944052765 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fdf140aa000 con 0x7fdf20102d90 2024-05-12T11:06:01.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdf080b2880 msgr2=0x7fdf080b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:01.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdf080b2880 0x7fdf080b4d40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf10006010 tx=0x7fdf1000b540 comp rx=0 tx=0).stop 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf20102d90 msgr2=0x7fdf2019fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf20102d90 0x7fdf2019fc80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c9b0 tx=0x7fdf1400cd70 comp rx=0 tx=0).stop 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 shutdown_connections 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fdf080b2880 0x7fdf080b4d40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf201042f0 0x7fdf20199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201023d0 0x7fdf2019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 --2- 172.21.15.86:0/2944052765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf20102d90 0x7fdf2019fc80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 >> 172.21.15.86:0/2944052765 conn(0x7fdf20078410 msgr2=0x7fdf2006bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 shutdown_connections 2024-05-12T11:06:01.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:01.131+0000 7fdf251db700 1 -- 172.21.15.86:0/2944052765 wait complete. 2024-05-12T11:06:01.125 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2024-05-12T11:06:01.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:01 smithi086 ceph-mon[30110]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:01.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:01 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2944052765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-12T11:06:01.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:01 smithi172 ceph-mon[34517]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:01.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:01 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2944052765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-12T11:06:01.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:01 smithi176 ceph-mon[34357]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:01.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:01 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2944052765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-12T11:06:01.858 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-12T11:06:02.100 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:02.129 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:02 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2944052765' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-12T11:06:02.129 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:02 smithi086 ceph-mon[30110]: osdmap e74: 12 total, 12 up, 12 in 2024-05-12T11:06:02.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:02 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2944052765' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-12T11:06:02.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:02 smithi172 ceph-mon[34517]: osdmap e74: 12 total, 12 up, 12 in 2024-05-12T11:06:02.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:02 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2944052765' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-12T11:06:02.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:02 smithi176 ceph-mon[34357]: osdmap e74: 12 total, 12 up, 12 in 2024-05-12T11:06:03.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:03 smithi086 ceph-mon[30110]: pgmap v283: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:03.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:03 smithi086 ceph-mon[30110]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-12T11:06:03.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:03 smithi086 ceph-mon[30110]: osdmap e75: 12 total, 12 up, 12 in 2024-05-12T11:06:03.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:03 smithi172 ceph-mon[34517]: pgmap v283: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:03.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:03 smithi172 ceph-mon[34517]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-12T11:06:03.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:03 smithi172 ceph-mon[34517]: osdmap e75: 12 total, 12 up, 12 in 2024-05-12T11:06:03.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:03 smithi176 ceph-mon[34357]: pgmap v283: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:03.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:03 smithi176 ceph-mon[34357]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-12T11:06:03.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:03 smithi176 ceph-mon[34357]: osdmap e75: 12 total, 12 up, 12 in 2024-05-12T11:06:03.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 -- 172.21.15.86:0/3344226410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 msgr2=0x7f14a8102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:03.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 --2- 172.21.15.86:0/3344226410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 0x7f14a8102820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009990 tx=0x7f14a4009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 -- 172.21.15.86:0/3344226410 shutdown_connections 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 --2- 172.21.15.86:0/3344226410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a8102d60 0x7f14a810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 --2- 172.21.15.86:0/3344226410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14a8108410 0x7f14a81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 --2- 172.21.15.86:0/3344226410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 0x7f14a8102820 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 -- 172.21.15.86:0/3344226410 >> 172.21.15.86:0/3344226410 conn(0x7f14a8079350 msgr2=0x7f14a8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 -- 172.21.15.86:0/3344226410 shutdown_connections 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.801+0000 7f14afed4700 1 -- 172.21.15.86:0/3344226410 wait complete. 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14afed4700 1 Processor -- start 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14afed4700 1 -- start start 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14afed4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 0x7f14a819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14afed4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a8102d60 0x7f14a819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14afed4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14a8108410 0x7f14a8199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:03.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14afed4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f14a81125b0 con 0x7f14a81023a0 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14afed4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14a8112430 con 0x7f14a8108410 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14afed4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f14a8112730 con 0x7f14a8102d60 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14adc70700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 0x7f14a819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14adc70700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 0x7f14a819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59058/0 (socket says 172.21.15.86:59058) 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14adc70700 1 -- 172.21.15.86:0/3671189323 learned_addr learned my addr 172.21.15.86:0/3671189323 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14ad46f700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a8102d60 0x7f14a819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14adc70700 1 -- 172.21.15.86:0/3671189323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a8102d60 msgr2=0x7f14a819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14adc70700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a8102d60 0x7f14a819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14adc70700 1 -- 172.21.15.86:0/3671189323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14a8108410 msgr2=0x7f14a8199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14ae471700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14a8108410 0x7f14a8199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.802+0000 7f14adc70700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14a8108410 0x7f14a8199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:03.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f14adc70700 1 -- 172.21.15.86:0/3671189323 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a819a090 con 0x7f14a81023a0 2024-05-12T11:06:03.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f14ae471700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14a8108410 0x7f14a8199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:06:03.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f14ad46f700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a8102d60 0x7f14a819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:06:03.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f14adc70700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 0x7f14a819f770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f149c00c9b0 tx=0x7f149c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:03.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f149affd700 1 -- 172.21.15.86:0/3671189323 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c007b00 con 0x7f14a81023a0 2024-05-12T11:06:03.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a819a380 con 0x7f14a81023a0 2024-05-12T11:06:03.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f149affd700 1 -- 172.21.15.86:0/3671189323 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f149c007ca0 con 0x7f14a81023a0 2024-05-12T11:06:03.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f149affd700 1 -- 172.21.15.86:0/3671189323 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c018730 con 0x7f14a81023a0 2024-05-12T11:06:03.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.803+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a81a6640 con 0x7f14a81023a0 2024-05-12T11:06:03.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.804+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a806a190 con 0x7f14a81023a0 2024-05-12T11:06:03.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.805+0000 7f149affd700 1 -- 172.21.15.86:0/3671189323 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f149c00f450 con 0x7f14a81023a0 2024-05-12T11:06:03.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.806+0000 7f149affd700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f14940b2880 0x7f14940b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:03.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.806+0000 7f14ad46f700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f14940b2880 0x7f14940b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:03.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.806+0000 7f149affd700 1 -- 172.21.15.86:0/3671189323 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7f149c0e2270 con 0x7f14a81023a0 2024-05-12T11:06:03.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.806+0000 7f14ad46f700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f14940b2880 0x7f14940b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14a400b5c0 tx=0x7f14a4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:03.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:03.810+0000 7f149affd700 1 -- 172.21.15.86:0/3671189323 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f149c014030 con 0x7f14a81023a0 2024-05-12T11:06:04.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.012+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f14a819ae60 con 0x7f14a81023a0 2024-05-12T11:06:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.146+0000 7f149affd700 1 -- 172.21.15.86:0/3671189323 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7f149c0aa350 con 0x7f14a81023a0 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f14940b2880 msgr2=0x7f14940b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f14940b2880 0x7f14940b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14a400b5c0 tx=0x7f14a4005fb0 comp rx=0 tx=0).stop 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 msgr2=0x7f14a819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 0x7f14a819f770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f149c00c9b0 tx=0x7f149c00cd70 comp rx=0 tx=0).stop 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 shutdown_connections 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f14940b2880 0x7f14940b4d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14a8108410 0x7f14a8199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a81023a0 0x7f14a819f770 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 --2- 172.21.15.86:0/3671189323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a8102d60 0x7f14a819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 >> 172.21.15.86:0/3671189323 conn(0x7f14a8079350 msgr2=0x7f14a8101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 shutdown_connections 2024-05-12T11:06:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:04.150+0000 7f14afed4700 1 -- 172.21.15.86:0/3671189323 wait complete. 2024-05-12T11:06:04.144 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2024-05-12T11:06:04.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:04 smithi086 ceph-mon[30110]: osdmap e76: 12 total, 12 up, 12 in 2024-05-12T11:06:04.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:04 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3671189323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-12T11:06:04.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:04 smithi172 ceph-mon[34517]: osdmap e76: 12 total, 12 up, 12 in 2024-05-12T11:06:04.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:04 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3671189323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-12T11:06:04.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:04 smithi176 ceph-mon[34357]: osdmap e76: 12 total, 12 up, 12 in 2024-05-12T11:06:04.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:04 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3671189323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-12T11:06:04.791 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-12T11:06:05.034 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:05.433 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:05 smithi086 ceph-mon[30110]: pgmap v286: 33 pgs: 13 active+clean, 1 creating+activating, 11 creating+peering, 8 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:05.433 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:05 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3671189323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-12T11:06:05.434 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:05 smithi086 ceph-mon[30110]: osdmap e77: 12 total, 12 up, 12 in 2024-05-12T11:06:05.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:05 smithi172 ceph-mon[34517]: pgmap v286: 33 pgs: 13 active+clean, 1 creating+activating, 11 creating+peering, 8 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:05.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:05 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3671189323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-12T11:06:05.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:05 smithi172 ceph-mon[34517]: osdmap e77: 12 total, 12 up, 12 in 2024-05-12T11:06:05.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:05 smithi176 ceph-mon[34357]: pgmap v286: 33 pgs: 13 active+clean, 1 creating+activating, 11 creating+peering, 8 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:05.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:05 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3671189323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-12T11:06:05.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:05 smithi176 ceph-mon[34357]: osdmap e77: 12 total, 12 up, 12 in 2024-05-12T11:06:06.415 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:06 smithi086 ceph-mon[30110]: osdmap e78: 12 total, 12 up, 12 in 2024-05-12T11:06:06.423 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:06 smithi176 ceph-mon[34357]: osdmap e78: 12 total, 12 up, 12 in 2024-05-12T11:06:06.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:06 smithi172 ceph-mon[34517]: osdmap e78: 12 total, 12 up, 12 in 2024-05-12T11:06:06.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.814+0000 7f7b4a36f700 1 -- 172.21.15.86:0/2239056371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 msgr2=0x7f7b441087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:06.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.814+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/2239056371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 0x7f7b441087f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009990 tx=0x7f7b34009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:06.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.814+0000 7f7b4a36f700 1 -- 172.21.15.86:0/2239056371 shutdown_connections 2024-05-12T11:06:06.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.814+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/2239056371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b44102d60 0x7f7b4410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:06.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.814+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/2239056371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 0x7f7b441087f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:06.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.814+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/2239056371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b441023a0 0x7f7b44102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:06.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.814+0000 7f7b4a36f700 1 -- 172.21.15.86:0/2239056371 >> 172.21.15.86:0/2239056371 conn(0x7f7b44079350 msgr2=0x7f7b44079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:06.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 -- 172.21.15.86:0/2239056371 shutdown_connections 2024-05-12T11:06:06.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 -- 172.21.15.86:0/2239056371 wait complete. 2024-05-12T11:06:06.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 Processor -- start 2024-05-12T11:06:06.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 -- start start 2024-05-12T11:06:06.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b441023a0 0x7f7b4419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:06.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b44102d60 0x7f7b4419ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 0x7f7b44199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b44113730 con 0x7f7b44108410 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441135b0 con 0x7f7b441023a0 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.815+0000 7f7b4a36f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441138b0 con 0x7f7b44102d60 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 0x7f7b44199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 0x7f7b44199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59076/0 (socket says 172.21.15.86:59076) 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 -- 172.21.15.86:0/190406465 learned_addr learned my addr 172.21.15.86:0/190406465 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b43fff700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b441023a0 0x7f7b4419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b3bfff700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b44102d60 0x7f7b4419ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 -- 172.21.15.86:0/190406465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b44102d60 msgr2=0x7f7b4419ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b44102d60 0x7f7b4419ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 -- 172.21.15.86:0/190406465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b441023a0 msgr2=0x7f7b4419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:06.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b441023a0 0x7f7b4419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:06.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 -- 172.21.15.86:0/190406465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4419a3f0 con 0x7f7b44108410 2024-05-12T11:06:06.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4890c700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 0x7f7b44199b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00b970 tx=0x7f7b3c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:06.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b41ffb700 1 -- 172.21.15.86:0/190406465 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c019070 con 0x7f7b44108410 2024-05-12T11:06:06.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4419a6e0 con 0x7f7b44108410 2024-05-12T11:06:06.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b41ffb700 1 -- 172.21.15.86:0/190406465 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b3c00cde0 con 0x7f7b44108410 2024-05-12T11:06:06.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b41ffb700 1 -- 172.21.15.86:0/190406465 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c007370 con 0x7f7b44108410 2024-05-12T11:06:06.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.816+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b441a69c0 con 0x7f7b44108410 2024-05-12T11:06:06.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.817+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b44103ac0 con 0x7f7b44108410 2024-05-12T11:06:06.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.819+0000 7f7b41ffb700 1 -- 172.21.15.86:0/190406465 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7b3c01c070 con 0x7f7b44108410 2024-05-12T11:06:06.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.819+0000 7f7b41ffb700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7b300b2880 0x7f7b300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:06.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.819+0000 7f7b43fff700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7b300b2880 0x7f7b300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:06.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.819+0000 7f7b41ffb700 1 -- 172.21.15.86:0/190406465 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f7b3c0e1c70 con 0x7f7b44108410 2024-05-12T11:06:06.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.820+0000 7f7b43fff700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7b300b2880 0x7f7b300b4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400b5c0 tx=0x7f7b34005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:06.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:06.823+0000 7f7b41ffb700 1 -- 172.21.15.86:0/190406465 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7b3c023070 con 0x7f7b44108410 2024-05-12T11:06:07.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.076+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7b4402e510 con 0x7f7b44108410 2024-05-12T11:06:07.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.165+0000 7f7b41ffb700 1 -- 172.21.15.86:0/190406465 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f7b3c0a9b40 con 0x7f7b44108410 2024-05-12T11:06:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7b300b2880 msgr2=0x7f7b300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7b300b2880 0x7f7b300b4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400b5c0 tx=0x7f7b34005960 comp rx=0 tx=0).stop 2024-05-12T11:06:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 msgr2=0x7f7b44199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 0x7f7b44199b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00b970 tx=0x7f7b3c00bc80 comp rx=0 tx=0).stop 2024-05-12T11:06:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 shutdown_connections 2024-05-12T11:06:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7b300b2880 0x7f7b300b4d40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b44108410 0x7f7b44199b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b441023a0 0x7f7b4419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 --2- 172.21.15.86:0/190406465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b44102d60 0x7f7b4419ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 >> 172.21.15.86:0/190406465 conn(0x7f7b44079350 msgr2=0x7f7b441012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 shutdown_connections 2024-05-12T11:06:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:07.168+0000 7f7b4a36f700 1 -- 172.21.15.86:0/190406465 wait complete. 2024-05-12T11:06:07.162 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 2 and data pool 3 2024-05-12T11:06:07.451 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:07 smithi086 ceph-mon[30110]: pgmap v289: 97 pgs: 25 active+clean, 1 creating+activating, 23 creating+peering, 48 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:07.451 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:07 smithi086 ceph-mon[30110]: osdmap e79: 12 total, 12 up, 12 in 2024-05-12T11:06:07.452 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:07 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/190406465' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-12T11:06:07.452 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:07 smithi086 ceph-mon[30110]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-05-12T11:06:07.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:07 smithi172 ceph-mon[34517]: pgmap v289: 97 pgs: 25 active+clean, 1 creating+activating, 23 creating+peering, 48 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:07.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:07 smithi172 ceph-mon[34517]: osdmap e79: 12 total, 12 up, 12 in 2024-05-12T11:06:07.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:07 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/190406465' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-12T11:06:07.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:07 smithi172 ceph-mon[34517]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-05-12T11:06:07.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:07 smithi176 ceph-mon[34357]: pgmap v289: 97 pgs: 25 active+clean, 1 creating+activating, 23 creating+peering, 48 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:06:07.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:07 smithi176 ceph-mon[34357]: osdmap e79: 12 total, 12 up, 12 in 2024-05-12T11:06:07.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:07 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/190406465' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-12T11:06:07.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:07 smithi176 ceph-mon[34357]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-05-12T11:06:07.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:06:08.151 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:08.423 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:08 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/190406465' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-12T11:06:08.423 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:08 smithi086 ceph-mon[30110]: osdmap e80: 12 total, 12 up, 12 in 2024-05-12T11:06:08.423 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:08 smithi086 ceph-mon[30110]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-05-12T11:06:08.423 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:08 smithi086 ceph-mon[30110]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-05-12T11:06:08.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:08 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/190406465' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-12T11:06:08.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:08 smithi172 ceph-mon[34517]: osdmap e80: 12 total, 12 up, 12 in 2024-05-12T11:06:08.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:08 smithi172 ceph-mon[34517]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-05-12T11:06:08.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:08 smithi172 ceph-mon[34517]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-05-12T11:06:08.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:08 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/190406465' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-12T11:06:08.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:08 smithi176 ceph-mon[34357]: osdmap e80: 12 total, 12 up, 12 in 2024-05-12T11:06:08.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:08 smithi176 ceph-mon[34357]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-05-12T11:06:08.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:08 smithi176 ceph-mon[34357]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-05-12T11:06:09.382 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:09 smithi086 ceph-mon[30110]: pgmap v292: 97 pgs: 83 active+clean, 12 creating+peering, 2 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-12T11:06:09.382 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:09 smithi086 ceph-mon[30110]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-12T11:06:09.382 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:09 smithi086 ceph-mon[30110]: Cluster is now healthy 2024-05-12T11:06:09.382 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:09 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] up:active 2024-05-12T11:06:09.383 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:09 smithi086 ceph-mon[30110]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:09.383 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:09 smithi086 ceph-mon[30110]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:09.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:09 smithi172 ceph-mon[34517]: pgmap v292: 97 pgs: 83 active+clean, 12 creating+peering, 2 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-12T11:06:09.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:09 smithi172 ceph-mon[34517]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-12T11:06:09.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:09 smithi172 ceph-mon[34517]: Cluster is now healthy 2024-05-12T11:06:09.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:09 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] up:active 2024-05-12T11:06:09.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:09 smithi172 ceph-mon[34517]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:09.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:09 smithi172 ceph-mon[34517]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:09.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:09 smithi176 ceph-mon[34357]: pgmap v292: 97 pgs: 83 active+clean, 12 creating+peering, 2 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-12T11:06:09.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:09 smithi176 ceph-mon[34357]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-12T11:06:09.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:09 smithi176 ceph-mon[34357]: Cluster is now healthy 2024-05-12T11:06:09.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:09 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] up:active 2024-05-12T11:06:09.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:09 smithi176 ceph-mon[34357]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:09.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:09 smithi176 ceph-mon[34357]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:09.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 -- 172.21.15.86:0/1468146247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac4102fe0 msgr2=0x7f6ac4106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:09.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 --2- 172.21.15.86:0/1468146247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac4102fe0 0x7f6ac4106fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00099c0 tx=0x7f6ab0009cd0 comp rx=0 tx=0).stop 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 -- 172.21.15.86:0/1468146247 shutdown_connections 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 --2- 172.21.15.86:0/1468146247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac41076c0 0x7f6ac410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 --2- 172.21.15.86:0/1468146247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac4102630 0x7f6ac4102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 --2- 172.21.15.86:0/1468146247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac4102fe0 0x7f6ac4106fe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 -- 172.21.15.86:0/1468146247 >> 172.21.15.86:0/1468146247 conn(0x7f6ac4079370 msgr2=0x7f6ac4079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 -- 172.21.15.86:0/1468146247 shutdown_connections 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 -- 172.21.15.86:0/1468146247 wait complete. 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.949+0000 7f6acafa5700 1 Processor -- start 2024-05-12T11:06:09.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6acafa5700 1 -- start start 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6acafa5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac4102630 0x7f6ac419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6acafa5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac4102fe0 0x7f6ac419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6acafa5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac41076c0 0x7f6ac4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6acafa5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41125b0 con 0x7f6ac41076c0 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6acafa5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4112430 con 0x7f6ac4102fe0 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6acafa5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4112730 con 0x7f6ac4102630 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac41076c0 0x7f6ac4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac41076c0 0x7f6ac4198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59092/0 (socket says 172.21.15.86:59092) 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 -- 172.21.15.86:0/3183973487 learned_addr learned my addr 172.21.15.86:0/3183973487 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac3fff700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac4102fe0 0x7f6ac419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac8d41700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac4102630 0x7f6ac419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 -- 172.21.15.86:0/3183973487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac4102630 msgr2=0x7f6ac419e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac4102630 0x7f6ac419e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 -- 172.21.15.86:0/3183973487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac4102fe0 msgr2=0x7f6ac419ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac4102fe0 0x7f6ac419ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 -- 172.21.15.86:0/3183973487 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac41990f0 con 0x7f6ac41076c0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac3fff700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac4102fe0 0x7f6ac419ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.950+0000 7f6ac9542700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac41076c0 0x7f6ac4198990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00b970 tx=0x7f6abc00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.951+0000 7f6ac1ffb700 1 -- 172.21.15.86:0/3183973487 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc019070 con 0x7f6ac41076c0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.951+0000 7f6ac1ffb700 1 -- 172.21.15.86:0/3183973487 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6abc014440 con 0x7f6ac41076c0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.951+0000 7f6ac1ffb700 1 -- 172.21.15.86:0/3183973487 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00ce60 con 0x7f6ac41076c0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.951+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac41993e0 con 0x7f6ac41076c0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.951+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac41a56a0 con 0x7f6ac41076c0 2024-05-12T11:06:09.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.952+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac406a190 con 0x7f6ac41076c0 2024-05-12T11:06:09.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.953+0000 7f6ac1ffb700 1 -- 172.21.15.86:0/3183973487 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6abc01c070 con 0x7f6ac41076c0 2024-05-12T11:06:09.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.954+0000 7f6ac1ffb700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6ab40b2880 0x7f6ab40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:09.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.954+0000 7f6ac8d41700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6ab40b2880 0x7f6ab40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:09.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.954+0000 7f6ac1ffb700 1 -- 172.21.15.86:0/3183973487 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f6abc0e1540 con 0x7f6ac41076c0 2024-05-12T11:06:09.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.954+0000 7f6ac8d41700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6ab40b2880 0x7f6ab40b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8005950 tx=0x7f6ab80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:09.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:09.958+0000 7f6ac1ffb700 1 -- 172.21.15.86:0/3183973487 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6abc0a93b0 con 0x7f6ac41076c0 2024-05-12T11:06:10.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.163+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ac4199ec0 con 0x7f6ac41076c0 2024-05-12T11:06:10.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.164+0000 7f6ac1ffb700 1 -- 172.21.15.86:0/3183973487 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22219 (secure 0 0 0) 0x7f6abc0a8cb0 con 0x7f6ac41076c0 2024-05-12T11:06:10.156 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:06:10.156 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":80,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:06:07.078187+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:06:10.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6ab40b2880 msgr2=0x7f6ab40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:10.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6ab40b2880 0x7f6ab40b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8005950 tx=0x7f6ab80058e0 comp rx=0 tx=0).stop 2024-05-12T11:06:10.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac41076c0 msgr2=0x7f6ac4198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:10.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac41076c0 0x7f6ac4198990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00b970 tx=0x7f6abc00bd30 comp rx=0 tx=0).stop 2024-05-12T11:06:10.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 shutdown_connections 2024-05-12T11:06:10.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6ab40b2880 0x7f6ab40b4d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:10.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ac41076c0 0x7f6ac4198990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:10.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac4102630 0x7f6ac419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:10.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 --2- 172.21.15.86:0/3183973487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac4102fe0 0x7f6ac419ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:10.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 >> 172.21.15.86:0/3183973487 conn(0x7f6ac4079370 msgr2=0x7f6ac41004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:10.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 shutdown_connections 2024-05-12T11:06:10.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:10.167+0000 7f6acafa5700 1 -- 172.21.15.86:0/3183973487 wait complete. 2024-05-12T11:06:10.174 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:06:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i[65906]: 2024-05-12T11:06:09.784+0000 7f0dfc045700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-12T11:06:10.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:10 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3183973487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:10.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:10 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3183973487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:10.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:10 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3183973487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:10.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:06:11.165 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:11.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:11 smithi086 ceph-mon[30110]: pgmap v293: 97 pgs: 89 active+clean, 8 creating+peering; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 864 B/s wr, 5 op/s 2024-05-12T11:06:11.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:11 smithi172 ceph-mon[34517]: pgmap v293: 97 pgs: 89 active+clean, 8 creating+peering; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 864 B/s wr, 5 op/s 2024-05-12T11:06:11.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:11 smithi176 ceph-mon[34357]: pgmap v293: 97 pgs: 89 active+clean, 8 creating+peering; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 864 B/s wr, 5 op/s 2024-05-12T11:06:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.779+0000 7fd8c8b35700 1 -- 172.21.15.86:0/3679121926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 msgr2=0x7fd8c4106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.779+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/3679121926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 0x7fd8c4106810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800aaa0 tx=0x7fd8b800adb0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.780+0000 7fd8c8b35700 1 -- 172.21.15.86:0/3679121926 shutdown_connections 2024-05-12T11:06:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.780+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/3679121926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c4106f40 0x7fd8c410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.780+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/3679121926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c41020a0 0x7fd8c4102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.780+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/3679121926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 0x7fd8c4106810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.780+0000 7fd8c8b35700 1 -- 172.21.15.86:0/3679121926 >> 172.21.15.86:0/3679121926 conn(0x7fd8c40776c0 msgr2=0x7fd8c4077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:12.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.780+0000 7fd8c8b35700 1 -- 172.21.15.86:0/3679121926 shutdown_connections 2024-05-12T11:06:12.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.780+0000 7fd8c8b35700 1 -- 172.21.15.86:0/3679121926 wait complete. 2024-05-12T11:06:12.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.780+0000 7fd8c8b35700 1 Processor -- start 2024-05-12T11:06:12.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c8b35700 1 -- start start 2024-05-12T11:06:12.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c8b35700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c41020a0 0x7fd8c419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:12.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c8b35700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 0x7fd8c419dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c8b35700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c4106f40 0x7fd8c41978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c8b35700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c4111560 con 0x7fd8c4102a50 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c8b35700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c41113e0 con 0x7fd8c4106f40 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c8b35700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c41116e0 con 0x7fd8c41020a0 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 0x7fd8c419dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 0x7fd8c419dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60008/0 (socket says 172.21.15.86:60008) 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 -- 172.21.15.86:0/2577744976 learned_addr learned my addr 172.21.15.86:0/2577744976 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c259c700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c41020a0 0x7fd8c419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c2d9d700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c4106f40 0x7fd8c41978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 -- 172.21.15.86:0/2577744976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c41020a0 msgr2=0x7fd8c419d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c41020a0 0x7fd8c419d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 -- 172.21.15.86:0/2577744976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c4106f40 msgr2=0x7fd8c41978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c4106f40 0x7fd8c41978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 -- 172.21.15.86:0/2577744976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c4198020 con 0x7fd8c4102a50 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.781+0000 7fd8c1d9b700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 0x7fd8c419dc40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8000c00 tx=0x7fd8b8003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.782+0000 7fd8b37fe700 1 -- 172.21.15.86:0/2577744976 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8024020 con 0x7fd8c4102a50 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.782+0000 7fd8b37fe700 1 -- 172.21.15.86:0/2577744976 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8b8004130 con 0x7fd8c4102a50 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.782+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c41982b0 con 0x7fd8c4102a50 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.782+0000 7fd8b37fe700 1 -- 172.21.15.86:0/2577744976 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b801b040 con 0x7fd8c4102a50 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.782+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c41a45d0 con 0x7fd8c4102a50 2024-05-12T11:06:12.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.783+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c410a0d0 con 0x7fd8c4102a50 2024-05-12T11:06:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.785+0000 7fd8b37fe700 1 -- 172.21.15.86:0/2577744976 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd8b8027020 con 0x7fd8c4102a50 2024-05-12T11:06:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.785+0000 7fd8b37fe700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd8ac0b2880 0x7fd8ac0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.785+0000 7fd8c259c700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd8ac0b2880 0x7fd8ac0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.786+0000 7fd8b37fe700 1 -- 172.21.15.86:0/2577744976 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd8b80e4e20 con 0x7fd8c4102a50 2024-05-12T11:06:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.786+0000 7fd8c259c700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd8ac0b2880 0x7fd8ac0b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4198a00 tx=0x7fd8b4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:12.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.789+0000 7fd8b37fe700 1 -- 172.21.15.86:0/2577744976 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd8b802e020 con 0x7fd8c4102a50 2024-05-12T11:06:12.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.998+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8c4198df0 con 0x7fd8c4102a50 2024-05-12T11:06:12.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:12.999+0000 7fd8b37fe700 1 -- 172.21.15.86:0/2577744976 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22219 (secure 0 0 0) 0x7fd8b80acd20 con 0x7fd8c4102a50 2024-05-12T11:06:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:06:12.991 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":80,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:06:07.078187+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd8ac0b2880 msgr2=0x7fd8ac0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd8ac0b2880 0x7fd8ac0b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4198a00 tx=0x7fd8b4009190 comp rx=0 tx=0).stop 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 msgr2=0x7fd8c419dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 0x7fd8c419dc40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8000c00 tx=0x7fd8b8003bf0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 shutdown_connections 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd8ac0b2880 0x7fd8ac0b4d40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c4106f40 0x7fd8c41978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c41020a0 0x7fd8c419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 --2- 172.21.15.86:0/2577744976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c4102a50 0x7fd8c419dc40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:12.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 >> 172.21.15.86:0/2577744976 conn(0x7fd8c40776c0 msgr2=0x7fd8c41000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:12.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 shutdown_connections 2024-05-12T11:06:12.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:13.002+0000 7fd8c8b35700 1 -- 172.21.15.86:0/2577744976 wait complete. 2024-05-12T11:06:13.316 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:13 smithi086 ceph-mon[30110]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-05-12T11:06:13.316 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:13 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2577744976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:13.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:13 smithi172 ceph-mon[34517]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-05-12T11:06:13.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:13 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2577744976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:13.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:13 smithi176 ceph-mon[34357]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-05-12T11:06:13.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:13 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2577744976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:13.757 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-12T11:06:14.003 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:15.446 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:15 smithi086 ceph-mon[30110]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-12T11:06:15.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:15 smithi172 ceph-mon[34517]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-12T11:06:15.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:15 smithi176 ceph-mon[34357]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-12T11:06:15.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 -- 172.21.15.86:0/3324919470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102fe0 msgr2=0x7fed0c106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:15.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 --2- 172.21.15.86:0/3324919470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102fe0 0x7fed0c106fe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed000099c0 tx=0x7fed00009cd0 comp rx=0 tx=0).stop 2024-05-12T11:06:15.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 -- 172.21.15.86:0/3324919470 shutdown_connections 2024-05-12T11:06:15.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 --2- 172.21.15.86:0/3324919470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0c1076c0 0x7fed0c10f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:15.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 --2- 172.21.15.86:0/3324919470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c102630 0x7fed0c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:15.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 --2- 172.21.15.86:0/3324919470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102fe0 0x7fed0c106fe0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:15.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 -- 172.21.15.86:0/3324919470 >> 172.21.15.86:0/3324919470 conn(0x7fed0c079350 msgr2=0x7fed0c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:15.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 -- 172.21.15.86:0/3324919470 shutdown_connections 2024-05-12T11:06:15.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.685+0000 7fed13df0700 1 -- 172.21.15.86:0/3324919470 wait complete. 2024-05-12T11:06:15.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed13df0700 1 Processor -- start 2024-05-12T11:06:15.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed13df0700 1 -- start start 2024-05-12T11:06:15.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed13df0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102630 0x7fed0c10fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:15.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed13df0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c102fe0 0x7fed0c10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed13df0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0c1076c0 0x7fed0c1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed13df0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c1136b0 con 0x7fed0c102630 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed13df0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c113530 con 0x7fed0c1076c0 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed13df0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c113830 con 0x7fed0c102fe0 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed11b8c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102630 0x7fed0c10fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed11b8c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102630 0x7fed0c10fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60024/0 (socket says 172.21.15.86:60024) 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.686+0000 7fed11b8c700 1 -- 172.21.15.86:0/3842694890 learned_addr learned my addr 172.21.15.86:0/3842694890 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed1238d700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0c1076c0 0x7fed0c1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed11b8c700 1 -- 172.21.15.86:0/3842694890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c102fe0 msgr2=0x7fed0c10ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed11b8c700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c102fe0 0x7fed0c10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed11b8c700 1 -- 172.21.15.86:0/3842694890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0c1076c0 msgr2=0x7fed0c1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed11b8c700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0c1076c0 0x7fed0c1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed11b8c700 1 -- 172.21.15.86:0/3842694890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c1a80b0 con 0x7fed0c102630 2024-05-12T11:06:15.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed1238d700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0c1076c0 0x7fed0c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:06:15.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed11b8c700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102630 0x7fed0c10fa70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fecfc007e20 tx=0x7fecfc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:15.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed0affd700 1 -- 172.21.15.86:0/3842694890 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc016020 con 0x7fed0c102630 2024-05-12T11:06:15.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed0affd700 1 -- 172.21.15.86:0/3842694890 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecfc00ae00 con 0x7fed0c102630 2024-05-12T11:06:15.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0c1a83a0 con 0x7fed0c102630 2024-05-12T11:06:15.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed0affd700 1 -- 172.21.15.86:0/3842694890 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011700 con 0x7fed0c102630 2024-05-12T11:06:15.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.687+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0c1a8930 con 0x7fed0c102630 2024-05-12T11:06:15.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.688+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed0c06a190 con 0x7fed0c102630 2024-05-12T11:06:15.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.689+0000 7fed0affd700 1 -- 172.21.15.86:0/3842694890 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fecfc019020 con 0x7fed0c102630 2024-05-12T11:06:15.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.690+0000 7fed0affd700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fecf40b2900 0x7fecf40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:15.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.690+0000 7fed1138b700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fecf40b2900 0x7fecf40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:15.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.690+0000 7fed0affd700 1 -- 172.21.15.86:0/3842694890 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fecfc0e2200 con 0x7fed0c102630 2024-05-12T11:06:15.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.690+0000 7fed1138b700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fecf40b2900 0x7fecf40b4dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fed000098e0 tx=0x7fed00000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:15.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.693+0000 7fed0affd700 1 -- 172.21.15.86:0/3842694890 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fecfc0aa070 con 0x7fed0c102630 2024-05-12T11:06:15.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:15.949+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fed0c02e510 con 0x7fed0c102630 2024-05-12T11:06:16.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.203+0000 7fed0affd700 1 -- 172.21.15.86:0/3842694890 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fecfc0a9970 con 0x7fed0c102630 2024-05-12T11:06:16.195 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:16 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3842694890' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-12T11:06:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fecf40b2900 msgr2=0x7fecf40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fecf40b2900 0x7fecf40b4dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fed000098e0 tx=0x7fed00000bc0 comp rx=0 tx=0).stop 2024-05-12T11:06:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102630 msgr2=0x7fed0c10fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102630 0x7fed0c10fa70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fecfc007e20 tx=0x7fecfc00a340 comp rx=0 tx=0).stop 2024-05-12T11:06:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 shutdown_connections 2024-05-12T11:06:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fecf40b2900 0x7fecf40b4dc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0c1076c0 0x7fed0c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed0c102630 0x7fed0c10fa70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 --2- 172.21.15.86:0/3842694890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c102fe0 0x7fed0c10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 >> 172.21.15.86:0/3842694890 conn(0x7fed0c079350 msgr2=0x7fed0c100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 shutdown_connections 2024-05-12T11:06:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:16.206+0000 7fed13df0700 1 -- 172.21.15.86:0/3842694890 wait complete. 2024-05-12T11:06:16.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:16 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3842694890' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-12T11:06:16.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:16 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3842694890' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-12T11:06:16.827 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-05-12T11:06:16.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-12T11:06:17.068 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:17.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:17 smithi086 ceph-mon[30110]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-12T11:06:17.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:17 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3842694890' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-12T11:06:17.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:17 smithi086 ceph-mon[30110]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:17.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:17 smithi172 ceph-mon[34517]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-12T11:06:17.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:17 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3842694890' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-12T11:06:17.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:17 smithi172 ceph-mon[34517]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:17.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:17 smithi176 ceph-mon[34357]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-12T11:06:17.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:17 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3842694890' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-12T11:06:17.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:17 smithi176 ceph-mon[34357]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:18.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 -- 172.21.15.86:0/2848846927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03581042f0 msgr2=0x7f03581046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:18.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 --2- 172.21.15.86:0/2848846927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03581042f0 0x7f03581046d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0348009990 tx=0x7f0348009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:18.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 -- 172.21.15.86:0/2848846927 shutdown_connections 2024-05-12T11:06:18.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 --2- 172.21.15.86:0/2848846927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0358102d90 0x7f035810f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:18.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 --2- 172.21.15.86:0/2848846927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03581042f0 0x7f03581046d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:18.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 --2- 172.21.15.86:0/2848846927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03581023d0 0x7f0358102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:18.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 -- 172.21.15.86:0/2848846927 >> 172.21.15.86:0/2848846927 conn(0x7f0358078410 msgr2=0x7f0358078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:18.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 -- 172.21.15.86:0/2848846927 shutdown_connections 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 -- 172.21.15.86:0/2848846927 wait complete. 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.734+0000 7f035e719700 1 Processor -- start 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f035e719700 1 -- start start 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f035e719700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03581023d0 0x7f035819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f035e719700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0358102d90 0x7f035819fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f035e719700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03581042f0 0x7f0358199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f035e719700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0358112730 con 0x7f0358102d90 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f035e719700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03581125b0 con 0x7f03581042f0 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f035e719700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f03581128b0 con 0x7f03581023d0 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0358102d90 0x7f035819fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0358102d90 0x7f035819fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60040/0 (socket says 172.21.15.86:60040) 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 -- 172.21.15.86:0/3396655117 learned_addr learned my addr 172.21.15.86:0/3396655117 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f0357fff700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03581023d0 0x7f035819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:18.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 -- 172.21.15.86:0/3396655117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03581023d0 msgr2=0x7f035819f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03581023d0 0x7f035819f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 -- 172.21.15.86:0/3396655117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03581042f0 msgr2=0x7f0358199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03581042f0 0x7f0358199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 -- 172.21.15.86:0/3396655117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035819a250 con 0x7f0358102d90 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f034ffff700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0358102d90 0x7f035819fe70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f034000b530 tx=0x7f034000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.735+0000 7f0355ffb700 1 -- 172.21.15.86:0/3396655117 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340015020 con 0x7f0358102d90 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.736+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035819a540 con 0x7f0358102d90 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.736+0000 7f0355ffb700 1 -- 172.21.15.86:0/3396655117 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0340011ce0 con 0x7f0358102d90 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.736+0000 7f0355ffb700 1 -- 172.21.15.86:0/3396655117 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340010d20 con 0x7f0358102d90 2024-05-12T11:06:18.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.736+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03581a6880 con 0x7f0358102d90 2024-05-12T11:06:18.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.737+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035806a190 con 0x7f0358102d90 2024-05-12T11:06:18.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.739+0000 7f0355ffb700 1 -- 172.21.15.86:0/3396655117 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0340018020 con 0x7f0358102d90 2024-05-12T11:06:18.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.740+0000 7f0355ffb700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f03440b2880 0x7f03440b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:18.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.740+0000 7f0357fff700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f03440b2880 0x7f03440b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:18.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.740+0000 7f0355ffb700 1 -- 172.21.15.86:0/3396655117 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f03400e1e70 con 0x7f0358102d90 2024-05-12T11:06:18.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.740+0000 7f0357fff700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f03440b2880 0x7f03440b4d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0348005cd0 tx=0x7f0348005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:18.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.743+0000 7f0355ffb700 1 -- 172.21.15.86:0/3396655117 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f034001f020 con 0x7f0358102d90 2024-05-12T11:06:18.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:18.993+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f035819afe0 con 0x7f0358102d90 2024-05-12T11:06:19.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.207+0000 7f0355ffb700 1 -- 172.21.15.86:0/3396655117 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f03400a9ce0 con 0x7f0358102d90 2024-05-12T11:06:19.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f03440b2880 msgr2=0x7f03440b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:19.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f03440b2880 0x7f03440b4d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0348005cd0 tx=0x7f0348005c40 comp rx=0 tx=0).stop 2024-05-12T11:06:19.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0358102d90 msgr2=0x7f035819fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:19.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0358102d90 0x7f035819fe70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f034000b530 tx=0x7f034000b8f0 comp rx=0 tx=0).stop 2024-05-12T11:06:19.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 shutdown_connections 2024-05-12T11:06:19.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f03440b2880 0x7f03440b4d40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:19.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03581042f0 0x7f0358199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:19.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03581023d0 0x7f035819f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:19.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 --2- 172.21.15.86:0/3396655117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0358102d90 0x7f035819fe70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:19.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 >> 172.21.15.86:0/3396655117 conn(0x7f0358078410 msgr2=0x7f035806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:19.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 shutdown_connections 2024-05-12T11:06:19.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:19.210+0000 7f035e719700 1 -- 172.21.15.86:0/3396655117 wait complete. 2024-05-12T11:06:19.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:19 smithi086 ceph-mon[30110]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-12T11:06:19.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:19 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3396655117' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-12T11:06:19.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:19 smithi172 ceph-mon[34517]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-12T11:06:19.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:19 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3396655117' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-12T11:06:19.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:19 smithi176 ceph-mon[34357]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-12T11:06:19.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:19 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3396655117' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-12T11:06:19.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-12T11:06:20.197 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:20.459 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:20 smithi086 ceph-mon[30110]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-12T11:06:20.460 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:20 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3396655117' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-12T11:06:20.460 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:20 smithi086 ceph-mon[30110]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-12T11:06:20.460 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:20 smithi086 ceph-mon[30110]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:20.460 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:20 smithi086 ceph-mon[30110]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-05-12T11:06:20.460 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:20 smithi086 ceph-mon[30110]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-12T11:06:20.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:20 smithi172 ceph-mon[34517]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-12T11:06:20.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:20 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3396655117' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-12T11:06:20.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:20 smithi172 ceph-mon[34517]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-12T11:06:20.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:20 smithi172 ceph-mon[34517]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:20.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:20 smithi172 ceph-mon[34517]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-05-12T11:06:20.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:20 smithi172 ceph-mon[34517]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-12T11:06:20.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:20 smithi176 ceph-mon[34357]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-12T11:06:20.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:20 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3396655117' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-12T11:06:20.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:20 smithi176 ceph-mon[34357]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-12T11:06:20.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:20 smithi176 ceph-mon[34357]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-12T11:06:20.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:20 smithi176 ceph-mon[34357]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-05-12T11:06:20.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:20 smithi176 ceph-mon[34357]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-12T11:06:21.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:21 smithi086 ceph-mon[30110]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-05-12T11:06:21.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:21 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] up:active 2024-05-12T11:06:21.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:21 smithi086 ceph-mon[30110]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-12T11:06:21.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:21 smithi086 ceph-mon[30110]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-05-12T11:06:21.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:21 smithi086 ceph-mon[30110]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-05-12T11:06:21.427 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:21 smithi086 ceph-mon[30110]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-12T11:06:21.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:21 smithi172 ceph-mon[34517]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-05-12T11:06:21.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:21 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] up:active 2024-05-12T11:06:21.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:21 smithi172 ceph-mon[34517]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-12T11:06:21.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:21 smithi172 ceph-mon[34517]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-05-12T11:06:21.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:21 smithi172 ceph-mon[34517]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-05-12T11:06:21.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:21 smithi172 ceph-mon[34517]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-12T11:06:21.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:21 smithi176 ceph-mon[34357]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-05-12T11:06:21.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:21 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] up:active 2024-05-12T11:06:21.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:21 smithi176 ceph-mon[34357]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-12T11:06:21.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:21 smithi176 ceph-mon[34357]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-05-12T11:06:21.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:21 smithi176 ceph-mon[34357]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-05-12T11:06:21.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:21 smithi176 ceph-mon[34357]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 -- 172.21.15.86:0/3266585480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8108460 msgr2=0x7f96d8108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3266585480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8108460 0x7f96d8108840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96d400b0a0 tx=0x7f96d400b3b0 comp rx=0 tx=0).stop 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 -- 172.21.15.86:0/3266585480 shutdown_connections 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3266585480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96d8103ef0 0x7f96d81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3266585480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8108460 0x7f96d8108840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3266585480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d8103550 0x7f96d81039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 -- 172.21.15.86:0/3266585480 >> 172.21.15.86:0/3266585480 conn(0x7f96d807a600 msgr2=0x7f96d807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 -- 172.21.15.86:0/3266585480 shutdown_connections 2024-05-12T11:06:21.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.928+0000 7f96dfa60700 1 -- 172.21.15.86:0/3266585480 wait complete. 2024-05-12T11:06:21.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dfa60700 1 Processor -- start 2024-05-12T11:06:21.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dfa60700 1 -- start start 2024-05-12T11:06:21.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dfa60700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d8103550 0x7f96d819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:21.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dfa60700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8103ef0 0x7f96d819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:21.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dfa60700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96d8108460 0x7f96d81999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dfa60700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f96d81136a0 con 0x7f96d8103ef0 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dfa60700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96d8113520 con 0x7f96d8108460 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dfa60700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96d8113820 con 0x7f96d8103550 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.929+0000 7f96dcffb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8103ef0 0x7f96d819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dd7fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d8103550 0x7f96d819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dcffb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8103ef0 0x7f96d819fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58974/0 (socket says 172.21.15.86:58974) 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dcffb700 1 -- 172.21.15.86:0/3921737434 learned_addr learned my addr 172.21.15.86:0/3921737434 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96ddffd700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96d8108460 0x7f96d81999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dcffb700 1 -- 172.21.15.86:0/3921737434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d8103550 msgr2=0x7f96d819f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dcffb700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d8103550 0x7f96d819f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dcffb700 1 -- 172.21.15.86:0/3921737434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96d8108460 msgr2=0x7f96d81999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dcffb700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96d8108460 0x7f96d81999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dcffb700 1 -- 172.21.15.86:0/3921737434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d819a140 con 0x7f96d8103ef0 2024-05-12T11:06:21.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dd7fc700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d8103550 0x7f96d819f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:06:21.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96ddffd700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96d8108460 0x7f96d81999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:06:21.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dcffb700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8103ef0 0x7f96d819fd10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f96c800e9c0 tx=0x7f96c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:21.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96ce7fc700 1 -- 172.21.15.86:0/3921737434 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c800cbd0 con 0x7f96d8103ef0 2024-05-12T11:06:21.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96ce7fc700 1 -- 172.21.15.86:0/3921737434 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96c800cd70 con 0x7f96d8103ef0 2024-05-12T11:06:21.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d819a430 con 0x7f96d8103ef0 2024-05-12T11:06:21.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96ce7fc700 1 -- 172.21.15.86:0/3921737434 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8005610 con 0x7f96d8103ef0 2024-05-12T11:06:21.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.930+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d81a66a0 con 0x7f96d8103ef0 2024-05-12T11:06:21.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.931+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d806a190 con 0x7f96d8103ef0 2024-05-12T11:06:21.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.932+0000 7f96ce7fc700 1 -- 172.21.15.86:0/3921737434 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f96c8004750 con 0x7f96d8103ef0 2024-05-12T11:06:21.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.933+0000 7f96ce7fc700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f96c40b2900 0x7f96c40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:21.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.933+0000 7f96dd7fc700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f96c40b2900 0x7f96c40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:21.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.933+0000 7f96ce7fc700 1 -- 172.21.15.86:0/3921737434 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f96c80e23b0 con 0x7f96d8103ef0 2024-05-12T11:06:21.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.934+0000 7f96dd7fc700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f96c40b2900 0x7f96c40b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f96d8109c00 tx=0x7f96d400b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:21.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:21.938+0000 7f96ce7fc700 1 -- 172.21.15.86:0/3921737434 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f96c80aa220 con 0x7f96d8103ef0 2024-05-12T11:06:22.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.185+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f96d810ba90 con 0x7f96d8103ef0 2024-05-12T11:06:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.234+0000 7f96ce7fc700 1 -- 172.21.15.86:0/3921737434 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f96c80a9b20 con 0x7f96d8103ef0 2024-05-12T11:06:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f96c40b2900 msgr2=0x7f96c40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f96c40b2900 0x7f96c40b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f96d8109c00 tx=0x7f96d400b700 comp rx=0 tx=0).stop 2024-05-12T11:06:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8103ef0 msgr2=0x7f96d819fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8103ef0 0x7f96d819fd10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f96c800e9c0 tx=0x7f96c800ecd0 comp rx=0 tx=0).stop 2024-05-12T11:06:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 shutdown_connections 2024-05-12T11:06:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f96c40b2900 0x7f96c40b4dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96d8108460 0x7f96d81999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d8103550 0x7f96d819f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:22.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 --2- 172.21.15.86:0/3921737434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96d8103ef0 0x7f96d819fd10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:22.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 >> 172.21.15.86:0/3921737434 conn(0x7f96d807a600 msgr2=0x7f96d8101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:22.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 shutdown_connections 2024-05-12T11:06:22.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:22.238+0000 7f96dfa60700 1 -- 172.21.15.86:0/3921737434 wait complete. 2024-05-12T11:06:22.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:22 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] up:active 2024-05-12T11:06:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:22 smithi086 ceph-mon[30110]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-12T11:06:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:22 smithi086 ceph-mon[30110]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-05-12T11:06:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:22 smithi086 ceph-mon[30110]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-05-12T11:06:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:22 smithi086 ceph-mon[30110]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-05-12T11:06:22.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:22 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3921737434' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-12T11:06:22.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:22 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] up:active 2024-05-12T11:06:22.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:22 smithi172 ceph-mon[34517]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-12T11:06:22.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:22 smithi172 ceph-mon[34517]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-05-12T11:06:22.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:22 smithi172 ceph-mon[34517]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-05-12T11:06:22.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:22 smithi172 ceph-mon[34517]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-05-12T11:06:22.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:22 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3921737434' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-12T11:06:22.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:22 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] up:active 2024-05-12T11:06:22.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:22 smithi176 ceph-mon[34357]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-12T11:06:22.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:22 smithi176 ceph-mon[34357]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-05-12T11:06:22.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:22 smithi176 ceph-mon[34357]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-05-12T11:06:22.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:22 smithi176 ceph-mon[34357]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-05-12T11:06:22.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:22 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3921737434' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-12T11:06:23.001 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-12T11:06:23.250 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:23.503 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: pgmap v299: 97 pgs: 97 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 5 op/s 2024-05-12T11:06:23.503 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3921737434' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-12T11:06:23.503 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] up:active 2024-05-12T11:06:23.503 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-12T11:06:23.503 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-12T11:06:23.504 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: Cluster is now healthy 2024-05-12T11:06:23.504 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-05-12T11:06:23.504 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-12T11:06:23.504 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:23 smithi086 ceph-mon[30110]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: pgmap v299: 97 pgs: 97 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 5 op/s 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3921737434' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] up:active 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: Cluster is now healthy 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-12T11:06:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:23 smithi176 ceph-mon[34357]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-05-12T11:06:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: pgmap v299: 97 pgs: 97 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 5 op/s 2024-05-12T11:06:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3921737434' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-12T11:06:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] up:active 2024-05-12T11:06:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-12T11:06:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-12T11:06:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: Cluster is now healthy 2024-05-12T11:06:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-05-12T11:06:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-12T11:06:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:23 smithi172 ceph-mon[34517]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-05-12T11:06:24.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:24 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] up:active 2024-05-12T11:06:24.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:24 smithi086 ceph-mon[30110]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-12T11:06:24.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:24 smithi086 ceph-mon[30110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:06:24.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:24 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] up:active 2024-05-12T11:06:24.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:24 smithi176 ceph-mon[34357]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-12T11:06:24.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:24 smithi176 ceph-mon[34357]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:06:24.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:24 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] up:active 2024-05-12T11:06:24.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:24 smithi172 ceph-mon[34517]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-12T11:06:24.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:24 smithi172 ceph-mon[34517]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:06:25.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 -- 172.21.15.86:0/3655192273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103f20 msgr2=0x7f382c110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 --2- 172.21.15.86:0/3655192273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103f20 0x7f382c110310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f382400b0d0 tx=0x7f382400b3e0 comp rx=0 tx=0).stop 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 -- 172.21.15.86:0/3655192273 shutdown_connections 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 --2- 172.21.15.86:0/3655192273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103f20 0x7f382c110310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 --2- 172.21.15.86:0/3655192273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f382c109540 0x7f382c109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 --2- 172.21.15.86:0/3655192273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c103560 0x7f382c1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 -- 172.21.15.86:0/3655192273 >> 172.21.15.86:0/3655192273 conn(0x7f382c07a660 msgr2=0x7f382c07aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 -- 172.21.15.86:0/3655192273 shutdown_connections 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 -- 172.21.15.86:0/3655192273 wait complete. 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.055+0000 7f383183a700 1 Processor -- start 2024-05-12T11:06:25.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f383183a700 1 -- start start 2024-05-12T11:06:25.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f383183a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103560 0x7f382c19f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:25.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f383183a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f382c103f20 0x7f382c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:25.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f383183a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c109540 0x7f382c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:25.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f383183a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f382c1136a0 con 0x7f382c103560 2024-05-12T11:06:25.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f383183a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f382c113520 con 0x7f382c103f20 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f383183a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f382c113820 con 0x7f382c109540 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103560 0x7f382c19f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103560 0x7f382c19f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58994/0 (socket says 172.21.15.86:58994) 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 -- 172.21.15.86:0/4235356700 learned_addr learned my addr 172.21.15.86:0/4235356700 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f38227fc700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f382c103f20 0x7f382c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 -- 172.21.15.86:0/4235356700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c109540 msgr2=0x7f382c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c109540 0x7f382c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 -- 172.21.15.86:0/4235356700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f382c103f20 msgr2=0x7f382c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f382c103f20 0x7f382c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 -- 172.21.15.86:0/4235356700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c19a040 con 0x7f382c103560 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f38227fc700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f382c103f20 0x7f382c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:06:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.056+0000 7f382affd700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103560 0x7f382c19f720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f381c00c920 tx=0x7f381c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.057+0000 7f3830838700 1 -- 172.21.15.86:0/4235356700 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c007b00 con 0x7f382c103560 2024-05-12T11:06:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.057+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c19a330 con 0x7f382c103560 2024-05-12T11:06:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.057+0000 7f3830838700 1 -- 172.21.15.86:0/4235356700 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f381c004ce0 con 0x7f382c103560 2024-05-12T11:06:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.057+0000 7f3830838700 1 -- 172.21.15.86:0/4235356700 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c005650 con 0x7f382c103560 2024-05-12T11:06:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.057+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c1a65f0 con 0x7f382c103560 2024-05-12T11:06:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.058+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382c06a190 con 0x7f382c103560 2024-05-12T11:06:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.060+0000 7f3830838700 1 -- 172.21.15.86:0/4235356700 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f381c004750 con 0x7f382c103560 2024-05-12T11:06:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.061+0000 7f3830838700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f38180b2880 0x7f38180b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.061+0000 7f38227fc700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f38180b2880 0x7f38180b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.061+0000 7f3830838700 1 -- 172.21.15.86:0/4235356700 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f381c0e2110 con 0x7f382c103560 2024-05-12T11:06:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.061+0000 7f38227fc700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f38180b2880 0x7f38180b4d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f382c07ac60 tx=0x7f3814008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.064+0000 7f3830838700 1 -- 172.21.15.86:0/4235356700 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f381c014030 con 0x7f382c103560 2024-05-12T11:06:25.243 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:06:24 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i[65906]: 2024-05-12T11:06:24.786+0000 7f0dfc045700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-12T11:06:25.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:25.319+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f382c02e730 con 0x7f382c103560 2024-05-12T11:06:25.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:25 smithi176 ceph-mon[34357]: pgmap v300: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 3.1 KiB/s wr, 10 op/s 2024-05-12T11:06:25.624 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:25 smithi172 ceph-mon[34517]: pgmap v300: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 3.1 KiB/s wr, 10 op/s 2024-05-12T11:06:25.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:25 smithi086 ceph-mon[30110]: pgmap v300: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 3.1 KiB/s wr, 10 op/s 2024-05-12T11:06:26.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.258+0000 7f3830838700 1 -- 172.21.15.86:0/4235356700 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f381c0a9f80 con 0x7f382c103560 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.261+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f38180b2880 msgr2=0x7f38180b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.261+0000 7f383183a700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f38180b2880 0x7f38180b4d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f382c07ac60 tx=0x7f3814008040 comp rx=0 tx=0).stop 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.261+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103560 msgr2=0x7f382c19f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.261+0000 7f383183a700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103560 0x7f382c19f720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f381c00c920 tx=0x7f381c00cce0 comp rx=0 tx=0).stop 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.262+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 shutdown_connections 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.262+0000 7f383183a700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f38180b2880 0x7f38180b4d40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.262+0000 7f383183a700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c109540 0x7f382c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.262+0000 7f383183a700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f382c103560 0x7f382c19f720 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.262+0000 7f383183a700 1 --2- 172.21.15.86:0/4235356700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f382c103f20 0x7f382c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.262+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 >> 172.21.15.86:0/4235356700 conn(0x7f382c07a660 msgr2=0x7f382c1021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:26.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.262+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 shutdown_connections 2024-05-12T11:06:26.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:26.262+0000 7f383183a700 1 -- 172.21.15.86:0/4235356700 wait complete. 2024-05-12T11:06:26.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:26 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4235356700' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-12T11:06:26.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:26 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4235356700' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-12T11:06:26.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:26 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4235356700' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-12T11:06:27.061 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-05-12T11:06:27.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-12T11:06:27.310 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:27.432 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:27 smithi086 ceph-mon[30110]: pgmap v301: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-05-12T11:06:27.432 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:27 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4235356700' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-12T11:06:27.432 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:27 smithi086 ceph-mon[30110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:06:27.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:27 smithi176 ceph-mon[34357]: pgmap v301: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-05-12T11:06:27.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:27 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4235356700' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-12T11:06:27.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:27 smithi176 ceph-mon[34357]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:06:27.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:27 smithi172 ceph-mon[34517]: pgmap v301: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-05-12T11:06:27.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:27 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4235356700' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-12T11:06:27.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:27 smithi172 ceph-mon[34517]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:06:29.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 -- 172.21.15.86:0/1331878451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06b180 msgr2=0x7eff9c06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:29.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 --2- 172.21.15.86:0/1331878451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06b180 0x7eff9c06b600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009990 tx=0x7eff8c009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 -- 172.21.15.86:0/1331878451 shutdown_connections 2024-05-12T11:06:29.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 --2- 172.21.15.86:0/1331878451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9c06bb40 0x7eff9c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 --2- 172.21.15.86:0/1331878451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff9c109510 0x7eff9c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 --2- 172.21.15.86:0/1331878451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06b180 0x7eff9c06b600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 -- 172.21.15.86:0/1331878451 >> 172.21.15.86:0/1331878451 conn(0x7eff9c079350 msgr2=0x7eff9c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:29.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 -- 172.21.15.86:0/1331878451 shutdown_connections 2024-05-12T11:06:29.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.101+0000 7effa39e6700 1 -- 172.21.15.86:0/1331878451 wait complete. 2024-05-12T11:06:29.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa39e6700 1 Processor -- start 2024-05-12T11:06:29.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa39e6700 1 -- start start 2024-05-12T11:06:29.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa39e6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9c06b180 0x7eff9c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:29.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa39e6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06bb40 0x7eff9c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:29.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa39e6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff9c109510 0x7eff9c199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:29.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa39e6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c1136a0 con 0x7eff9c06bb40 2024-05-12T11:06:29.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa39e6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c113520 con 0x7eff9c06b180 2024-05-12T11:06:29.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa39e6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c113820 con 0x7eff9c109510 2024-05-12T11:06:29.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.102+0000 7effa0f81700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06bb40 0x7eff9c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:29.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa0f81700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06bb40 0x7eff9c19fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59018/0 (socket says 172.21.15.86:59018) 2024-05-12T11:06:29.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa0f81700 1 -- 172.21.15.86:0/1248259524 learned_addr learned my addr 172.21.15.86:0/1248259524 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:29.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa1782700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9c06b180 0x7eff9c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:29.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa1f83700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff9c109510 0x7eff9c199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:29.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa0f81700 1 -- 172.21.15.86:0/1248259524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff9c109510 msgr2=0x7eff9c199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:29.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa0f81700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff9c109510 0x7eff9c199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa0f81700 1 -- 172.21.15.86:0/1248259524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9c06b180 msgr2=0x7eff9c19f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:29.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa0f81700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9c06b180 0x7eff9c19f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa0f81700 1 -- 172.21.15.86:0/1248259524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c19a160 con 0x7eff9c06bb40 2024-05-12T11:06:29.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa0f81700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06bb40 0x7eff9c19fd80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7eff8c000c00 tx=0x7eff8c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:29.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7eff927fc700 1 -- 172.21.15.86:0/1248259524 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c027070 con 0x7eff9c06bb40 2024-05-12T11:06:29.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7eff927fc700 1 -- 172.21.15.86:0/1248259524 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8c0041d0 con 0x7eff9c06bb40 2024-05-12T11:06:29.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7eff927fc700 1 -- 172.21.15.86:0/1248259524 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00f460 con 0x7eff9c06bb40 2024-05-12T11:06:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9c19a3f0 con 0x7eff9c06bb40 2024-05-12T11:06:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.103+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9c1a6710 con 0x7eff9c06bb40 2024-05-12T11:06:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.105+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9c10b9f0 con 0x7eff9c06bb40 2024-05-12T11:06:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.106+0000 7eff927fc700 1 -- 172.21.15.86:0/1248259524 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7eff8c02a070 con 0x7eff9c06bb40 2024-05-12T11:06:29.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.106+0000 7eff927fc700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7eff880b2900 0x7eff880b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:29.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.107+0000 7effa1782700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7eff880b2900 0x7eff880b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:29.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.107+0000 7eff927fc700 1 -- 172.21.15.86:0/1248259524 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7eff8c0e3040 con 0x7eff9c06bb40 2024-05-12T11:06:29.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.107+0000 7effa1782700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7eff880b2900 0x7eff880b4dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff98006fd0 tx=0x7eff98008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:29.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.111+0000 7eff927fc700 1 -- 172.21.15.86:0/1248259524 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7eff8c05fdf0 con 0x7eff9c06bb40 2024-05-12T11:06:29.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.351+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7eff9c19af30 con 0x7eff880b2900 2024-05-12T11:06:29.347 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:29 smithi086 ceph-mon[30110]: pgmap v302: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-12T11:06:29.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.376+0000 7eff927fc700 1 -- 172.21.15.86:0/1248259524 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7eff9c19af30 con 0x7eff880b2900 2024-05-12T11:06:29.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7eff880b2900 msgr2=0x7eff880b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:29.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7eff880b2900 0x7eff880b4dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff98006fd0 tx=0x7eff98008040 comp rx=0 tx=0).stop 2024-05-12T11:06:29.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06bb40 msgr2=0x7eff9c19fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:29.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06bb40 0x7eff9c19fd80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7eff8c000c00 tx=0x7eff8c0047b0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 shutdown_connections 2024-05-12T11:06:29.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7eff880b2900 0x7eff880b4dc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff9c109510 0x7eff9c199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9c06b180 0x7eff9c19f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 --2- 172.21.15.86:0/1248259524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9c06bb40 0x7eff9c19fd80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:29.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 >> 172.21.15.86:0/1248259524 conn(0x7eff9c079350 msgr2=0x7eff9c101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:29.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 shutdown_connections 2024-05-12T11:06:29.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:29.378+0000 7effa39e6700 1 -- 172.21.15.86:0/1248259524 wait complete. 2024-05-12T11:06:29.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:29 smithi176 ceph-mon[34357]: pgmap v302: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-12T11:06:29.712 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:06:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:06:29.355+0000 7f375ebe5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:06:29.712 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:06:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:06:29.355+0000 7f375ebe5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:06:29.712 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:06:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:06:29.355+0000 7f375ebe5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:06:29.713 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:06:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:06:29.355+0000 7f375ebe5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:06:29.713 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:06:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:06:29.355+0000 7f375ebe5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:06:29.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:29 smithi172 ceph-mon[34517]: pgmap v302: 97 pgs: 97 active+clean; 584 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-12T11:06:30.212 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-12T11:06:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:30.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:30 smithi086 ceph-mon[30110]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:30.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:30 smithi176 ceph-mon[34357]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:30.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:30 smithi172 ceph-mon[34517]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:31.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:31 smithi176 ceph-mon[34357]: pgmap v303: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 KiB/s wr, 20 op/s 2024-05-12T11:06:31.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:31 smithi176 ceph-mon[34357]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-12T11:06:31.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:31 smithi086 ceph-mon[30110]: pgmap v303: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 KiB/s wr, 20 op/s 2024-05-12T11:06:31.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:31 smithi086 ceph-mon[30110]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-12T11:06:31.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:31 smithi172 ceph-mon[34517]: pgmap v303: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 KiB/s wr, 20 op/s 2024-05-12T11:06:31.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:31 smithi172 ceph-mon[34517]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-12T11:06:32.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3371900684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 msgr2=0x7f5c741098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:32.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3371900684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 0x7f5c741098f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009990 tx=0x7f5c64009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3371900684 shutdown_connections 2024-05-12T11:06:32.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3371900684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c7406c5b0 0x7f5c74110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3371900684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 0x7f5c741098f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3371900684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7406bbf0 0x7f5c7406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3371900684 >> 172.21.15.86:0/3371900684 conn(0x7f5c74079370 msgr2=0x7f5c74079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:32.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3371900684 shutdown_connections 2024-05-12T11:06:32.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.324+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3371900684 wait complete. 2024-05-12T11:06:32.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c7a92f700 1 Processor -- start 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c7a92f700 1 -- start start 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c7a92f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c7406bbf0 0x7f5c7419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c7a92f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7406c5b0 0x7f5c7419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c7a92f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 0x7f5c74199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c7a92f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5c741136c0 con 0x7f5c74109510 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c7a92f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74113540 con 0x7f5c7406c5b0 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c7a92f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74113840 con 0x7f5c7406bbf0 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c78ecc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 0x7f5c74199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c78ecc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 0x7f5c74199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55776/0 (socket says 172.21.15.86:55776) 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c78ecc700 1 -- 172.21.15.86:0/3647780887 learned_addr learned my addr 172.21.15.86:0/3647780887 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c73fff700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c7406bbf0 0x7f5c7419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c78ecc700 1 -- 172.21.15.86:0/3647780887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c7406bbf0 msgr2=0x7f5c7419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:32.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c78ecc700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c7406bbf0 0x7f5c7419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c78ecc700 1 -- 172.21.15.86:0/3647780887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7406c5b0 msgr2=0x7f5c7419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.325+0000 7f5c78ecc700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7406c5b0 0x7f5c7419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.326+0000 7f5c78ecc700 1 -- 172.21.15.86:0/3647780887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7419a1a0 con 0x7f5c74109510 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.326+0000 7f5c73fff700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c7406bbf0 0x7f5c7419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.326+0000 7f5c78ecc700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 0x7f5c74199a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c007ee0 tx=0x7f5c6c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.326+0000 7f5c71ffb700 1 -- 172.21.15.86:0/3647780887 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00dbd0 con 0x7f5c74109510 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.326+0000 7f5c71ffb700 1 -- 172.21.15.86:0/3647780887 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c6c00dd70 con 0x7f5c74109510 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.326+0000 7f5c71ffb700 1 -- 172.21.15.86:0/3647780887 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c005990 con 0x7f5c74109510 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.326+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7419a490 con 0x7f5c74109510 2024-05-12T11:06:32.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.326+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c741a6750 con 0x7f5c74109510 2024-05-12T11:06:32.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.327+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7410b9f0 con 0x7f5c74109510 2024-05-12T11:06:32.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.328+0000 7f5c71ffb700 1 -- 172.21.15.86:0/3647780887 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5c6c01a020 con 0x7f5c74109510 2024-05-12T11:06:32.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.329+0000 7f5c71ffb700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5c600b2990 0x7f5c600b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:32.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.329+0000 7f5c73fff700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5c600b2990 0x7f5c600b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:32.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.329+0000 7f5c71ffb700 1 -- 172.21.15.86:0/3647780887 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5c6c0e1a10 con 0x7f5c74109510 2024-05-12T11:06:32.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.329+0000 7f5c73fff700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5c600b2990 0x7f5c600b4e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006010 tx=0x7f5c6400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:32.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.333+0000 7f5c71ffb700 1 -- 172.21.15.86:0/3647780887 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5c6c010070 con 0x7f5c74109510 2024-05-12T11:06:32.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.565+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5c740638e0 con 0x7f5c600b2990 2024-05-12T11:06:32.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.594+0000 7f5c71ffb700 1 -- 172.21.15.86:0/3647780887 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5c740638e0 con 0x7f5c600b2990 2024-05-12T11:06:32.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5c600b2990 msgr2=0x7f5c600b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:32.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5c600b2990 0x7f5c600b4e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006010 tx=0x7f5c6400b540 comp rx=0 tx=0).stop 2024-05-12T11:06:32.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 msgr2=0x7f5c74199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:32.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 0x7f5c74199a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c007ee0 tx=0x7f5c6c00d3b0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 shutdown_connections 2024-05-12T11:06:32.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5c600b2990 0x7f5c600b4e50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c74109510 0x7f5c74199a40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c7406bbf0 0x7f5c7419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 --2- 172.21.15.86:0/3647780887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7406c5b0 0x7f5c7419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:32.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 >> 172.21.15.86:0/3647780887 conn(0x7f5c74079370 msgr2=0x7f5c74101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:32.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 shutdown_connections 2024-05-12T11:06:32.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:32.596+0000 7f5c7a92f700 1 -- 172.21.15.86:0/3647780887 wait complete. 2024-05-12T11:06:33.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-12T11:06:33.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:33 smithi176 ceph-mon[34357]: pgmap v304: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 22 op/s 2024-05-12T11:06:33.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:33 smithi176 ceph-mon[34357]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:33.565 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:33.688 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:33 smithi086 ceph-mon[30110]: pgmap v304: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 22 op/s 2024-05-12T11:06:33.688 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:33 smithi086 ceph-mon[30110]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:33.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:33 smithi172 ceph-mon[34517]: pgmap v304: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 22 op/s 2024-05-12T11:06:33.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:33 smithi172 ceph-mon[34517]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:35.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 -- 172.21.15.86:0/3486001614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1281029e0 msgr2=0x7fb128102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3486001614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1281029e0 0x7fb128102dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb1180099c0 tx=0x7fb118009cd0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 -- 172.21.15.86:0/3486001614 shutdown_connections 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3486001614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb128107730 0x7fb12810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3486001614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1281029e0 0x7fb128102dc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3486001614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb128103390 0x7fb128107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 -- 172.21.15.86:0/3486001614 >> 172.21.15.86:0/3486001614 conn(0x7fb128079350 msgr2=0x7fb128079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 -- 172.21.15.86:0/3486001614 shutdown_connections 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.262+0000 7fb12cc85700 1 -- 172.21.15.86:0/3486001614 wait complete. 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12cc85700 1 Processor -- start 2024-05-12T11:06:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12cc85700 1 -- start start 2024-05-12T11:06:35.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12cc85700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1281029e0 0x7fb12819f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:35.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12cc85700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb128103390 0x7fb12819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:35.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12cc85700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb128107730 0x7fb128199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:35.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12cc85700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb128112640 con 0x7fb128103390 2024-05-12T11:06:35.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12cc85700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281124c0 con 0x7fb1281029e0 2024-05-12T11:06:35.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12cc85700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281127c0 con 0x7fb128107730 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb128103390 0x7fb12819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb128103390 0x7fb12819fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55796/0 (socket says 172.21.15.86:55796) 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb11dd9b700 1 -- 172.21.15.86:0/3118274868 learned_addr learned my addr 172.21.15.86:0/3118274868 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12659c700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1281029e0 0x7fb12819f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb126d9d700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb128107730 0x7fb128199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb11dd9b700 1 -- 172.21.15.86:0/3118274868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb128107730 msgr2=0x7fb128199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb11dd9b700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb128107730 0x7fb128199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb11dd9b700 1 -- 172.21.15.86:0/3118274868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1281029e0 msgr2=0x7fb12819f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb11dd9b700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1281029e0 0x7fb12819f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb11dd9b700 1 -- 172.21.15.86:0/3118274868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12819a270 con 0x7fb128103390 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.263+0000 7fb12659c700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1281029e0 0x7fb12819f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.264+0000 7fb11dd9b700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb128103390 0x7fb12819fe40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb11000b4d0 tx=0x7fb11000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.264+0000 7fb11ffff700 1 -- 172.21.15.86:0/3118274868 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110015020 con 0x7fb128103390 2024-05-12T11:06:35.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.264+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12819a560 con 0x7fb128103390 2024-05-12T11:06:35.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.264+0000 7fb11ffff700 1 -- 172.21.15.86:0/3118274868 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb110011ce0 con 0x7fb128103390 2024-05-12T11:06:35.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.264+0000 7fb11ffff700 1 -- 172.21.15.86:0/3118274868 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110010cd0 con 0x7fb128103390 2024-05-12T11:06:35.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.264+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1281a67d0 con 0x7fb128103390 2024-05-12T11:06:35.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.265+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb128103ae0 con 0x7fb128103390 2024-05-12T11:06:35.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.266+0000 7fb11ffff700 1 -- 172.21.15.86:0/3118274868 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb110018020 con 0x7fb128103390 2024-05-12T11:06:35.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.267+0000 7fb11ffff700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb1140b2910 0x7fb1140b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:35.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.267+0000 7fb12659c700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb1140b2910 0x7fb1140b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:35.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.267+0000 7fb11ffff700 1 -- 172.21.15.86:0/3118274868 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb1100e1ed0 con 0x7fb128103390 2024-05-12T11:06:35.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.267+0000 7fb12659c700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb1140b2910 0x7fb1140b4dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb118009990 tx=0x7fb118005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:35.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.271+0000 7fb11ffff700 1 -- 172.21.15.86:0/3118274868 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb11001f020 con 0x7fb128103390 2024-05-12T11:06:35.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:35 smithi086 ceph-mon[30110]: pgmap v305: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 19 op/s 2024-05-12T11:06:35.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.509+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fb1280638e0 con 0x7fb1140b2910 2024-05-12T11:06:35.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.514+0000 7fb11ffff700 1 -- 172.21.15.86:0/3118274868 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb1280638e0 con 0x7fb1140b2910 2024-05-12T11:06:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/volumes/qa/sv_0/9efd0378-cc4a-4a25-b8d2-17948a0d6354 2024-05-12T11:06:35.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb1140b2910 msgr2=0x7fb1140b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:35.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb1140b2910 0x7fb1140b4dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb118009990 tx=0x7fb118005ab0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb128103390 msgr2=0x7fb12819fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb128103390 0x7fb12819fe40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb11000b4d0 tx=0x7fb11000b890 comp rx=0 tx=0).stop 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 shutdown_connections 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb1140b2910 0x7fb1140b4dd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb128107730 0x7fb128199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1281029e0 0x7fb12819f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 --2- 172.21.15.86:0/3118274868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb128103390 0x7fb12819fe40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.516+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 >> 172.21.15.86:0/3118274868 conn(0x7fb128079350 msgr2=0x7fb12806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.517+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 shutdown_connections 2024-05-12T11:06:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:35.517+0000 7fb12cc85700 1 -- 172.21.15.86:0/3118274868 wait complete. 2024-05-12T11:06:35.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:35 smithi176 ceph-mon[34357]: pgmap v305: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 19 op/s 2024-05-12T11:06:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:35 smithi172 ceph-mon[34517]: pgmap v305: 97 pgs: 97 active+clean; 591 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 19 op/s 2024-05-12T11:06:36.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-12T11:06:36.392 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:36.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:36 smithi086 ceph-mon[30110]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:36.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:36 smithi172 ceph-mon[34517]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:36.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:36 smithi176 ceph-mon[34357]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:37.536 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:37 smithi086 ceph-mon[30110]: pgmap v306: 97 pgs: 97 active+clean; 611 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-05-12T11:06:37.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:37 smithi172 ceph-mon[34517]: pgmap v306: 97 pgs: 97 active+clean; 611 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-05-12T11:06:37.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:37 smithi176 ceph-mon[34357]: pgmap v306: 97 pgs: 97 active+clean; 611 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-05-12T11:06:38.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 -- 172.21.15.86:0/718289771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 msgr2=0x7f8f0c10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:38.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 --2- 172.21.15.86:0/718289771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 0x7f8f0c10f250 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009990 tx=0x7f8f04009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 -- 172.21.15.86:0/718289771 shutdown_connections 2024-05-12T11:06:38.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 --2- 172.21.15.86:0/718289771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 0x7f8f0c10f250 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 --2- 172.21.15.86:0/718289771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f0c108410 0x7f8f0c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 --2- 172.21.15.86:0/718289771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f0c1023a0 0x7f8f0c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 -- 172.21.15.86:0/718289771 >> 172.21.15.86:0/718289771 conn(0x7f8f0c079350 msgr2=0x7f8f0c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:38.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 -- 172.21.15.86:0/718289771 shutdown_connections 2024-05-12T11:06:38.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.099+0000 7f8f13623700 1 -- 172.21.15.86:0/718289771 wait complete. 2024-05-12T11:06:38.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f13623700 1 Processor -- start 2024-05-12T11:06:38.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f13623700 1 -- start start 2024-05-12T11:06:38.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f13623700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f0c1023a0 0x7f8f0c19a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:38.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f13623700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 0x7f8f0c19add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:38.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f13623700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f0c108410 0x7f8f0c1a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:38.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f13623700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c112530 con 0x7f8f0c102d60 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f13623700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c1123b0 con 0x7f8f0c1023a0 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f13623700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c1126b0 con 0x7f8f0c108410 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f10bbe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 0x7f8f0c19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f10bbe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 0x7f8f0c19add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55820/0 (socket says 172.21.15.86:55820) 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.100+0000 7f8f10bbe700 1 -- 172.21.15.86:0/1351663339 learned_addr learned my addr 172.21.15.86:0/1351663339 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f113bf700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f0c1023a0 0x7f8f0c19a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f11bc0700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f0c108410 0x7f8f0c1a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f10bbe700 1 -- 172.21.15.86:0/1351663339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f0c108410 msgr2=0x7f8f0c1a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f10bbe700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f0c108410 0x7f8f0c1a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f10bbe700 1 -- 172.21.15.86:0/1351663339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f0c1023a0 msgr2=0x7f8f0c19a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f10bbe700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f0c1023a0 0x7f8f0c19a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f10bbe700 1 -- 172.21.15.86:0/1351663339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c1a5e50 con 0x7f8f0c102d60 2024-05-12T11:06:38.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f11bc0700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f0c108410 0x7f8f0c1a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:06:38.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f10bbe700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 0x7f8f0c19add0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00d950 tx=0x7f8efc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:38.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f027fc700 1 -- 172.21.15.86:0/1351663339 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc016070 con 0x7f8f0c102d60 2024-05-12T11:06:38.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c1a6080 con 0x7f8f0c102d60 2024-05-12T11:06:38.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f027fc700 1 -- 172.21.15.86:0/1351663339 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8efc009df0 con 0x7f8f0c102d60 2024-05-12T11:06:38.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f027fc700 1 -- 172.21.15.86:0/1351663339 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00f3c0 con 0x7f8f0c102d60 2024-05-12T11:06:38.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.101+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c1a6610 con 0x7f8f0c102d60 2024-05-12T11:06:38.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.102+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0c06a190 con 0x7f8f0c102d60 2024-05-12T11:06:38.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.103+0000 7f8f027fc700 1 -- 172.21.15.86:0/1351663339 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8efc019070 con 0x7f8f0c102d60 2024-05-12T11:06:38.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.104+0000 7f8f027fc700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8ef80b2910 0x7f8ef80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:38.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.104+0000 7f8f113bf700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8ef80b2910 0x7f8ef80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:38.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.104+0000 7f8f027fc700 1 -- 172.21.15.86:0/1351663339 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8efc0e1de0 con 0x7f8f0c102d60 2024-05-12T11:06:38.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.104+0000 7f8f113bf700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8ef80b2910 0x7f8ef80b4dd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f08007fd0 tx=0x7f8f080079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:38.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.107+0000 7f8f027fc700 1 -- 172.21.15.86:0/1351663339 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8efc0a9b50 con 0x7f8f0c102d60 2024-05-12T11:06:38.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.345+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8f0c0638e0 con 0x7f8ef80b2910 2024-05-12T11:06:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.373+0000 7f8f027fc700 1 -- 172.21.15.86:0/1351663339 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8f0c0638e0 con 0x7f8ef80b2910 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8ef80b2910 msgr2=0x7f8ef80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8ef80b2910 0x7f8ef80b4dd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f08007fd0 tx=0x7f8f080079e0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 msgr2=0x7f8f0c19add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 0x7f8f0c19add0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00d950 tx=0x7f8efc00dc60 comp rx=0 tx=0).stop 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 shutdown_connections 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8ef80b2910 0x7f8ef80b4dd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f0c108410 0x7f8f0c1a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f0c1023a0 0x7f8f0c19a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 --2- 172.21.15.86:0/1351663339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f0c102d60 0x7f8f0c19add0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 >> 172.21.15.86:0/1351663339 conn(0x7f8f0c079350 msgr2=0x7f8f0c100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 shutdown_connections 2024-05-12T11:06:38.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:38.376+0000 7f8f13623700 1 -- 172.21.15.86:0/1351663339 wait complete. 2024-05-12T11:06:39.041 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-12T11:06:39.274 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:39 smithi086 ceph-mon[30110]: pgmap v307: 97 pgs: 97 active+clean; 611 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-05-12T11:06:39.274 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:39 smithi086 ceph-mon[30110]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:39.296 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:39.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:39 smithi172 ceph-mon[34517]: pgmap v307: 97 pgs: 97 active+clean; 611 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-05-12T11:06:39.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:39 smithi172 ceph-mon[34517]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:39.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:39 smithi176 ceph-mon[34357]: pgmap v307: 97 pgs: 97 active+clean; 611 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-05-12T11:06:39.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:39 smithi176 ceph-mon[34357]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:41.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 -- 172.21.15.86:0/1263364918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4241037b0 msgr2=0x7fe424103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 --2- 172.21.15.86:0/1263364918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4241037b0 0x7fe424103b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe4140099c0 tx=0x7fe414009cd0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 -- 172.21.15.86:0/1263364918 shutdown_connections 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 --2- 172.21.15.86:0/1263364918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe424108880 0x7fe424110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 --2- 172.21.15.86:0/1263364918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4241037b0 0x7fe424103b90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 --2- 172.21.15.86:0/1263364918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe424104160 0x7fe424108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 -- 172.21.15.86:0/1263364918 >> 172.21.15.86:0/1263364918 conn(0x7fe42407a530 msgr2=0x7fe42407a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 -- 172.21.15.86:0/1263364918 shutdown_connections 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.041+0000 7fe42a689700 1 -- 172.21.15.86:0/1263364918 wait complete. 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe42a689700 1 Processor -- start 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe42a689700 1 -- start start 2024-05-12T11:06:41.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe42a689700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4241037b0 0x7fe42419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe42a689700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe424104160 0x7fe42419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe42a689700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe424108880 0x7fe4241998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe42a689700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe424113670 con 0x7fe424108880 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe42a689700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241134f0 con 0x7fe4241037b0 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe42a689700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241137f0 con 0x7fe424104160 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe428c26700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe424108880 0x7fe4241998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe428c26700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe424108880 0x7fe4241998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55840/0 (socket says 172.21.15.86:55840) 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe428c26700 1 -- 172.21.15.86:0/2749504098 learned_addr learned my addr 172.21.15.86:0/2749504098 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.042+0000 7fe423fff700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4241037b0 0x7fe42419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe41bfff700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe424104160 0x7fe42419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe428c26700 1 -- 172.21.15.86:0/2749504098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe424104160 msgr2=0x7fe42419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe428c26700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe424104160 0x7fe42419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe428c26700 1 -- 172.21.15.86:0/2749504098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4241037b0 msgr2=0x7fe42419f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:41.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe428c26700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4241037b0 0x7fe42419f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe428c26700 1 -- 172.21.15.86:0/2749504098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42419a030 con 0x7fe424108880 2024-05-12T11:06:41.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe428c26700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe424108880 0x7fe4241998d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007ee0 tx=0x7fe41c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:41.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe421ffb700 1 -- 172.21.15.86:0/2749504098 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00dd20 con 0x7fe424108880 2024-05-12T11:06:41.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe421ffb700 1 -- 172.21.15.86:0/2749504098 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe41c004020 con 0x7fe424108880 2024-05-12T11:06:41.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42419a320 con 0x7fe424108880 2024-05-12T11:06:41.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4241a65e0 con 0x7fe424108880 2024-05-12T11:06:41.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.043+0000 7fe421ffb700 1 -- 172.21.15.86:0/2749504098 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c015660 con 0x7fe424108880 2024-05-12T11:06:41.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.044+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42410bac0 con 0x7fe424108880 2024-05-12T11:06:41.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.045+0000 7fe421ffb700 1 -- 172.21.15.86:0/2749504098 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe41c0041d0 con 0x7fe424108880 2024-05-12T11:06:41.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.046+0000 7fe421ffb700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe4100b2910 0x7fe4100b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:41.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.046+0000 7fe423fff700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe4100b2910 0x7fe4100b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:41.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.046+0000 7fe421ffb700 1 -- 172.21.15.86:0/2749504098 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe41c0e1bf0 con 0x7fe424108880 2024-05-12T11:06:41.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.046+0000 7fe423fff700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe4100b2910 0x7fe4100b4dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe42419aa10 tx=0x7fe414005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:41.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.051+0000 7fe421ffb700 1 -- 172.21.15.86:0/2749504098 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe41c010070 con 0x7fe424108880 2024-05-12T11:06:41.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.291+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fe42419ae00 con 0x7fe4100b2910 2024-05-12T11:06:41.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.296+0000 7fe421ffb700 1 -- 172.21.15.86:0/2749504098 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe42419ae00 con 0x7fe4100b2910 2024-05-12T11:06:41.287 INFO:teuthology.orchestra.run.smithi086.stdout:/volumes/qa/sv_1/e6561063-68f8-4dc8-9ff1-e27e8a490917 2024-05-12T11:06:41.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe4100b2910 msgr2=0x7fe4100b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:41.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe4100b2910 0x7fe4100b4dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe42419aa10 tx=0x7fe414005c40 comp rx=0 tx=0).stop 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe424108880 msgr2=0x7fe4241998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe424108880 0x7fe4241998d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007ee0 tx=0x7fe41c00d3b0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 shutdown_connections 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe4100b2910 0x7fe4100b4dd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe424108880 0x7fe4241998d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4241037b0 0x7fe42419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 --2- 172.21.15.86:0/2749504098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe424104160 0x7fe42419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 >> 172.21.15.86:0/2749504098 conn(0x7fe42407a530 msgr2=0x7fe4241016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 shutdown_connections 2024-05-12T11:06:41.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:41.298+0000 7fe42a689700 1 -- 172.21.15.86:0/2749504098 wait complete. 2024-05-12T11:06:41.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:41 smithi086 ceph-mon[30110]: pgmap v308: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-05-12T11:06:41.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:41 smithi172 ceph-mon[34517]: pgmap v308: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-05-12T11:06:41.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:41 smithi176 ceph-mon[34357]: pgmap v308: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-05-12T11:06:41.968 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:06:42.215 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:42.557 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:42 smithi086 ceph-mon[30110]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:42.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:42 smithi172 ceph-mon[34517]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:42.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:42 smithi176 ceph-mon[34357]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:06:43.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:43 smithi086 ceph-mon[30110]: pgmap v309: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-05-12T11:06:43.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:43 smithi172 ceph-mon[34517]: pgmap v309: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-05-12T11:06:43.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:43 smithi176 ceph-mon[34357]: pgmap v309: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-05-12T11:06:43.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 -- 172.21.15.86:0/1606715757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 msgr2=0x7f3cd4105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:43.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/1606715757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 0x7f3cd4105500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0099c0 tx=0x7f3cbc009cd0 comp rx=0 tx=0).stop 2024-05-12T11:06:43.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 -- 172.21.15.86:0/1606715757 shutdown_connections 2024-05-12T11:06:43.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/1606715757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cd4105a40 0x7f3cd4110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:43.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/1606715757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cd406bf90 0x7f3cd406c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:43.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/1606715757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 0x7f3cd4105500 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:43.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 -- 172.21.15.86:0/1606715757 >> 172.21.15.86:0/1606715757 conn(0x7f3cd4078410 msgr2=0x7f3cd4078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 -- 172.21.15.86:0/1606715757 shutdown_connections 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.876+0000 7f3cda8dc700 1 -- 172.21.15.86:0/1606715757 wait complete. 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cda8dc700 1 Processor -- start 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cda8dc700 1 -- start start 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cda8dc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cd406bf90 0x7f3cd419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cda8dc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 0x7f3cd419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cda8dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cd4105a40 0x7f3cd4199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cda8dc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd41137b0 con 0x7f3cd4105080 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cda8dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4113630 con 0x7f3cd4105a40 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cda8dc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4113930 con 0x7f3cd406bf90 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3ccbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 0x7f3cd419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3ccbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 0x7f3cd419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39022/0 (socket says 172.21.15.86:39022) 2024-05-12T11:06:43.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3ccbfff700 1 -- 172.21.15.86:0/2001805172 learned_addr learned my addr 172.21.15.86:0/2001805172 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:43.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cd3fff700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cd406bf90 0x7f3cd419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:43.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cd8e79700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cd4105a40 0x7f3cd4199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:43.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3ccbfff700 1 -- 172.21.15.86:0/2001805172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cd406bf90 msgr2=0x7f3cd419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:43.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3ccbfff700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cd406bf90 0x7f3cd419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:43.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3ccbfff700 1 -- 172.21.15.86:0/2001805172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cd4105a40 msgr2=0x7f3cd4199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:43.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3ccbfff700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cd4105a40 0x7f3cd4199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:43.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3ccbfff700 1 -- 172.21.15.86:0/2001805172 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd419a190 con 0x7f3cd4105080 2024-05-12T11:06:43.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.877+0000 7f3cd8e79700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cd4105a40 0x7f3cd4199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:06:43.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.878+0000 7f3ccbfff700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 0x7f3cd419fd60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00b580 tx=0x7f3cbc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:43.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.878+0000 7f3cd1ffb700 1 -- 172.21.15.86:0/2001805172 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc027070 con 0x7f3cd4105080 2024-05-12T11:06:43.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.878+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd419a420 con 0x7f3cd4105080 2024-05-12T11:06:43.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.878+0000 7f3cd1ffb700 1 -- 172.21.15.86:0/2001805172 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cbc003f20 con 0x7f3cd4105080 2024-05-12T11:06:43.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.878+0000 7f3cd1ffb700 1 -- 172.21.15.86:0/2001805172 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc022d70 con 0x7f3cd4105080 2024-05-12T11:06:43.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.878+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd41a66f0 con 0x7f3cd4105080 2024-05-12T11:06:43.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.879+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd4104c00 con 0x7f3cd4105080 2024-05-12T11:06:43.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.880+0000 7f3cd1ffb700 1 -- 172.21.15.86:0/2001805172 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3cbc022500 con 0x7f3cd4105080 2024-05-12T11:06:43.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.881+0000 7f3cd1ffb700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3cc00b2910 0x7f3cc00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:43.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.881+0000 7f3cd3fff700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3cc00b2910 0x7f3cc00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:43.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.881+0000 7f3cd1ffb700 1 -- 172.21.15.86:0/2001805172 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f3cbc0e32e0 con 0x7f3cd4105080 2024-05-12T11:06:43.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.881+0000 7f3cd3fff700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3cc00b2910 0x7f3cc00b4dd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4100aa0 tx=0x7f3cc400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:43.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:43.884+0000 7f3cd1ffb700 1 -- 172.21.15.86:0/2001805172 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3cbc013070 con 0x7f3cd4105080 2024-05-12T11:06:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.133+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cd419af10 con 0x7f3cd4105080 2024-05-12T11:06:44.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.134+0000 7f3cd1ffb700 1 -- 172.21.15.86:0/2001805172 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11935 (secure 0 0 0) 0x7f3cbc0ab0e0 con 0x7f3cd4105080 2024-05-12T11:06:44.125 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:06:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:06:25.320260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24422,24436,24443,24442,24466]},"id":1}]} 2024-05-12T11:06:44.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3cc00b2910 msgr2=0x7f3cc00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3cc00b2910 0x7f3cc00b4dd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4100aa0 tx=0x7f3cc400a380 comp rx=0 tx=0).stop 2024-05-12T11:06:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 msgr2=0x7f3cd419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 0x7f3cd419fd60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00b580 tx=0x7f3cbc0047b0 comp rx=0 tx=0).stop 2024-05-12T11:06:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 shutdown_connections 2024-05-12T11:06:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3cc00b2910 0x7f3cc00b4dd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cd4105a40 0x7f3cd4199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cd406bf90 0x7f3cd419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 --2- 172.21.15.86:0/2001805172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cd4105080 0x7f3cd419fd60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:44.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.136+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 >> 172.21.15.86:0/2001805172 conn(0x7f3cd4078410 msgr2=0x7f3cd4101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:44.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.137+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 shutdown_connections 2024-05-12T11:06:44.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:44.137+0000 7f3cda8dc700 1 -- 172.21.15.86:0/2001805172 wait complete. 2024-05-12T11:06:44.129 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 28 2024-05-12T11:06:44.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-12T11:06:44.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-05-12T11:06:44.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-05-12T11:06:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-05-12T11:06:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-05-12T11:06:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-12T11:06:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-05-12T11:06:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-05-12T11:06:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-12T11:06:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-05-12T11:06:44.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:44 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2001805172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:06:44.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-12T11:06:44.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-05-12T11:06:44.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-05-12T11:06:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-05-12T11:06:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-05-12T11:06:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-12T11:06:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-05-12T11:06:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-05-12T11:06:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-12T11:06:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-05-12T11:06:44.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:44 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2001805172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:06:44.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-12T11:06:44.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-05-12T11:06:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-05-12T11:06:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-05-12T11:06:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-05-12T11:06:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-12T11:06:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-05-12T11:06:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-05-12T11:06:44.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-12T11:06:44.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-05-12T11:06:44.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:44 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2001805172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:06:44.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:06:45.069 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:45.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: pgmap v310: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-05-12T11:06:45.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:45 smithi086 ceph-mon[30110]: osdmap e81: 12 total, 12 up, 12 in 2024-05-12T11:06:45.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: pgmap v310: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-05-12T11:06:45.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-05-12T11:06:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:45 smithi172 ceph-mon[34517]: osdmap e81: 12 total, 12 up, 12 in 2024-05-12T11:06:45.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: pgmap v310: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-05-12T11:06:45.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-12T11:06:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-05-12T11:06:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-05-12T11:06:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-05-12T11:06:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-05-12T11:06:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-12T11:06:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-05-12T11:06:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-05-12T11:06:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-12T11:06:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-05-12T11:06:45.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:45 smithi176 ceph-mon[34357]: osdmap e81: 12 total, 12 up, 12 in 2024-05-12T11:06:46.542 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:46 smithi086 ceph-mon[30110]: osdmap e82: 12 total, 12 up, 12 in 2024-05-12T11:06:46.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:46 smithi172 ceph-mon[34517]: osdmap e82: 12 total, 12 up, 12 in 2024-05-12T11:06:46.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:46 smithi176 ceph-mon[34357]: osdmap e82: 12 total, 12 up, 12 in 2024-05-12T11:06:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.860+0000 7fe6653e1700 1 -- 172.21.15.86:0/642679542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 msgr2=0x7fe66006c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.860+0000 7fe6653e1700 1 --2- 172.21.15.86:0/642679542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 0x7fe66006c090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe654009990 tx=0x7fe654009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.860+0000 7fe6653e1700 1 -- 172.21.15.86:0/642679542 shutdown_connections 2024-05-12T11:06:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.860+0000 7fe6653e1700 1 --2- 172.21.15.86:0/642679542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe66006c5d0 0x7fe660110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.860+0000 7fe6653e1700 1 --2- 172.21.15.86:0/642679542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe660109580 0x7fe660109960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.860+0000 7fe6653e1700 1 --2- 172.21.15.86:0/642679542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 0x7fe66006c090 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.860+0000 7fe6653e1700 1 -- 172.21.15.86:0/642679542 >> 172.21.15.86:0/642679542 conn(0x7fe6600783f0 msgr2=0x7fe660078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.861+0000 7fe6653e1700 1 -- 172.21.15.86:0/642679542 shutdown_connections 2024-05-12T11:06:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.861+0000 7fe6653e1700 1 -- 172.21.15.86:0/642679542 wait complete. 2024-05-12T11:06:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.861+0000 7fe6653e1700 1 Processor -- start 2024-05-12T11:06:46.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.861+0000 7fe6653e1700 1 -- start start 2024-05-12T11:06:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.861+0000 7fe6653e1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 0x7fe66019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.861+0000 7fe6653e1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66006c5d0 0x7fe66019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe6653e1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660109580 0x7fe6601998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe6653e1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601136d0 con 0x7fe66006bc10 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe6653e1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe660113550 con 0x7fe66006c5d0 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe6653e1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe660113850 con 0x7fe660109580 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 0x7fe66019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 0x7fe66019f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39040/0 (socket says 172.21.15.86:39040) 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 -- 172.21.15.86:0/3485451394 learned_addr learned my addr 172.21.15.86:0/3485451394 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65e7fc700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66006c5d0 0x7fe66019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65f7fe700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660109580 0x7fe6601998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 -- 172.21.15.86:0/3485451394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660109580 msgr2=0x7fe6601998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660109580 0x7fe6601998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 -- 172.21.15.86:0/3485451394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66006c5d0 msgr2=0x7fe66019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66006c5d0 0x7fe66019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:46.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 -- 172.21.15.86:0/3485451394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66019a030 con 0x7fe66006bc10 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65f7fe700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660109580 0x7fe6601998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe65effd700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 0x7fe66019f710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c9b0 tx=0x7fe65000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe647fff700 1 -- 172.21.15.86:0/3485451394 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650007b00 con 0x7fe66006bc10 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66019a320 con 0x7fe66006bc10 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe647fff700 1 -- 172.21.15.86:0/3485451394 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe650007ca0 con 0x7fe66006bc10 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe647fff700 1 -- 172.21.15.86:0/3485451394 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650018660 con 0x7fe66006bc10 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.862+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6601a6660 con 0x7fe66006bc10 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.863+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66006a190 con 0x7fe66006bc10 2024-05-12T11:06:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.865+0000 7fe647fff700 1 -- 172.21.15.86:0/3485451394 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe65000f450 con 0x7fe66006bc10 2024-05-12T11:06:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.865+0000 7fe647fff700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe6480b2910 0x7fe6480b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.865+0000 7fe65e7fc700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe6480b2910 0x7fe6480b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.865+0000 7fe647fff700 1 -- 172.21.15.86:0/3485451394 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe6500e2660 con 0x7fe66006bc10 2024-05-12T11:06:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.866+0000 7fe65e7fc700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe6480b2910 0x7fe6480b4dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe65400b5c0 tx=0x7fe654005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:46.869+0000 7fe647fff700 1 -- 172.21.15.86:0/3485451394 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe650014030 con 0x7fe66006bc10 2024-05-12T11:06:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.075+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe66019ae00 con 0x7fe66006bc10 2024-05-12T11:06:47.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.077+0000 7fe647fff700 1 -- 172.21.15.86:0/3485451394 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22746 (secure 0 0 0) 0x7fe6500aa290 con 0x7fe66006bc10 2024-05-12T11:06:47.070 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:06:47.070 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:06:45.299850+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:06:47.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe6480b2910 msgr2=0x7fe6480b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:47.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe6480b2910 0x7fe6480b4dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe65400b5c0 tx=0x7fe654005960 comp rx=0 tx=0).stop 2024-05-12T11:06:47.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 msgr2=0x7fe66019f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:47.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 0x7fe66019f710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c9b0 tx=0x7fe65000ccc0 comp rx=0 tx=0).stop 2024-05-12T11:06:47.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 shutdown_connections 2024-05-12T11:06:47.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fe6480b2910 0x7fe6480b4dd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:47.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660109580 0x7fe6601998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:47.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66006bc10 0x7fe66019f710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:47.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 --2- 172.21.15.86:0/3485451394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66006c5d0 0x7fe66019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:47.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 >> 172.21.15.86:0/3485451394 conn(0x7fe6600783f0 msgr2=0x7fe6601011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:47.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 shutdown_connections 2024-05-12T11:06:47.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:47.080+0000 7fe6653e1700 1 -- 172.21.15.86:0/3485451394 wait complete. 2024-05-12T11:06:47.505 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:47 smithi086 ceph-mon[30110]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-05-12T11:06:47.505 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:47 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3485451394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:47.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:47 smithi172 ceph-mon[34517]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-05-12T11:06:47.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:47 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3485451394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:47 smithi176 ceph-mon[34357]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-05-12T11:06:47.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:47 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3485451394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:06:47.812 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-12T11:06:47.813 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-12T11:06:48.056 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:49.460 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:49 smithi086 ceph-mon[30110]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:49.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.670+0000 7f947f273700 1 -- 172.21.15.86:0/56961527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478109520 msgr2=0x7f9478109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:49.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.670+0000 7f947f273700 1 --2- 172.21.15.86:0/56961527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478109520 0x7f9478109900 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9474009990 tx=0x7f9474009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.670+0000 7f947f273700 1 -- 172.21.15.86:0/56961527 shutdown_connections 2024-05-12T11:06:49.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.670+0000 7f947f273700 1 --2- 172.21.15.86:0/56961527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9478102450 0x7f9478110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.670+0000 7f947f273700 1 --2- 172.21.15.86:0/56961527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478109520 0x7f9478109900 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.670+0000 7f947f273700 1 --2- 172.21.15.86:0/56961527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9478101a90 0x7f9478101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.670+0000 7f947f273700 1 -- 172.21.15.86:0/56961527 >> 172.21.15.86:0/56961527 conn(0x7f9478078a10 msgr2=0x7f94780ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:49.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 -- 172.21.15.86:0/56961527 shutdown_connections 2024-05-12T11:06:49.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 -- 172.21.15.86:0/56961527 wait complete. 2024-05-12T11:06:49.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 Processor -- start 2024-05-12T11:06:49.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 -- start start 2024-05-12T11:06:49.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9478101a90 0x7f9478102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:49.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478102450 0x7f94781031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:49.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9478109520 0x7f94781036f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:49.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9478113730 con 0x7f9478102450 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f94781135b0 con 0x7f9478109520 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.671+0000 7f947f273700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94781138b0 con 0x7f9478101a90 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478102450 0x7f94781031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478102450 0x7f94781031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39062/0 (socket says 172.21.15.86:39062) 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 -- 172.21.15.86:0/2541610201 learned_addr learned my addr 172.21.15.86:0/2541610201 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947d810700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9478109520 0x7f94781036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947d00f700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9478101a90 0x7f9478102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 -- 172.21.15.86:0/2541610201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9478101a90 msgr2=0x7f9478102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9478101a90 0x7f9478102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 -- 172.21.15.86:0/2541610201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9478109520 msgr2=0x7f94781036f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:49.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9478109520 0x7f94781036f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 -- 172.21.15.86:0/2541610201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94781a81d0 con 0x7f9478102450 2024-05-12T11:06:49.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947c80e700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478102450 0x7f94781031b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f946800b530 tx=0x7f946800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:49.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f946e7fc700 1 -- 172.21.15.86:0/2541610201 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468015020 con 0x7f9478102450 2024-05-12T11:06:49.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f946e7fc700 1 -- 172.21.15.86:0/2541610201 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9468011ce0 con 0x7f9478102450 2024-05-12T11:06:49.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94781a84c0 con 0x7f9478102450 2024-05-12T11:06:49.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f946e7fc700 1 -- 172.21.15.86:0/2541610201 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468010dd0 con 0x7f9478102450 2024-05-12T11:06:49.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.672+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94781a8a00 con 0x7f9478102450 2024-05-12T11:06:49.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.673+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f947810ba00 con 0x7f9478102450 2024-05-12T11:06:49.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.675+0000 7f946e7fc700 1 -- 172.21.15.86:0/2541610201 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9468018020 con 0x7f9478102450 2024-05-12T11:06:49.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.676+0000 7f946e7fc700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94640b2910 0x7f94640b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:49.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.676+0000 7f947d00f700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94640b2910 0x7f94640b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:49.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.676+0000 7f946e7fc700 1 -- 172.21.15.86:0/2541610201 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f94680e1f50 con 0x7f9478102450 2024-05-12T11:06:49.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.676+0000 7f947d00f700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94640b2910 0x7f94640b4dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f947400b5c0 tx=0x7f9474005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:49.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.680+0000 7f946e7fc700 1 -- 172.21.15.86:0/2541610201 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f946801f020 con 0x7f9478102450 2024-05-12T11:06:49.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:49 smithi172 ceph-mon[34517]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:49.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:49 smithi176 ceph-mon[34357]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:49.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.884+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94780638e0 con 0x7f94640b2910 2024-05-12T11:06:49.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.892+0000 7f946e7fc700 1 -- 172.21.15.86:0/2541610201 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258997 (secure 0 0 0) 0x7f94780638e0 con 0x7f94640b2910 2024-05-12T11:06:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:06:49.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94640b2910 msgr2=0x7f94640b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:49.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94640b2910 0x7f94640b4dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f947400b5c0 tx=0x7f9474005960 comp rx=0 tx=0).stop 2024-05-12T11:06:49.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478102450 msgr2=0x7f94781031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:49.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478102450 0x7f94781031b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f946800b530 tx=0x7f946800b840 comp rx=0 tx=0).stop 2024-05-12T11:06:49.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 shutdown_connections 2024-05-12T11:06:49.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94640b2910 0x7f94640b4dd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9478109520 0x7f94781036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9478101a90 0x7f9478102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 --2- 172.21.15.86:0/2541610201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9478102450 0x7f94781031b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:49.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 >> 172.21.15.86:0/2541610201 conn(0x7f9478078a10 msgr2=0x7f9478100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:49.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 shutdown_connections 2024-05-12T11:06:49.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:49.896+0000 7f947f273700 1 -- 172.21.15.86:0/2541610201 wait complete. 2024-05-12T11:06:49.891 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-05-12T11:06:50.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:50 smithi086 ceph-mon[30110]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:06:50.577 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-05-12T11:06:48.079681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652996,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":347,"num_read_kb":261,"num_write":364,"num_write_kb":2281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":2952534,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372640,"kb_used_data":10960,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569184,"statfs":{"total":1151940427776,"available":1151558844416,"internally_reserved":0,"allocated":11223040,"data_stored":7089387,"data_compressed":158783,"data_compressed_allocated":208896,"data_compressed_original":1916928,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5512,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":37,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001921"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304104+0000","last_change":"2024-05-12T11:06:05.173542+0000","last_active":"2024-05-12T11:06:45.304104+0000","last_peered":"2024-05-12T11:06:45.304104+0000","last_clean":"2024-05-12T11:06:45.304104+0000","last_became_active":"2024-05-12T11:06:05.173221+0000","last_became_peered":"2024-05-12T11:06:05.173221+0000","last_unstale":"2024-05-12T11:06:45.304104+0000","last_undegraded":"2024-05-12T11:06:45.304104+0000","last_fullsized":"2024-05-12T11:06:45.304104+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310246+0000","last_change":"2024-05-12T11:06:05.178626+0000","last_active":"2024-05-12T11:06:45.310246+0000","last_peered":"2024-05-12T11:06:45.310246+0000","last_clean":"2024-05-12T11:06:45.310246+0000","last_became_active":"2024-05-12T11:06:05.178313+0000","last_became_peered":"2024-05-12T11:06:05.178313+0000","last_unstale":"2024-05-12T11:06:45.310246+0000","last_undegraded":"2024-05-12T11:06:45.310246+0000","last_fullsized":"2024-05-12T11:06:45.310246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:45:25.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309717+0000","last_change":"2024-05-12T11:06:05.175396+0000","last_active":"2024-05-12T11:06:45.309717+0000","last_peered":"2024-05-12T11:06:45.309717+0000","last_clean":"2024-05-12T11:06:45.309717+0000","last_became_active":"2024-05-12T11:06:05.175060+0000","last_became_peered":"2024-05-12T11:06:05.175060+0000","last_unstale":"2024-05-12T11:06:45.309717+0000","last_undegraded":"2024-05-12T11:06:45.309717+0000","last_fullsized":"2024-05-12T11:06:45.309717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:55:08.180220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498372+0000","last_change":"2024-05-12T11:06:05.172900+0000","last_active":"2024-05-12T11:06:45.498372+0000","last_peered":"2024-05-12T11:06:45.498372+0000","last_clean":"2024-05-12T11:06:45.498372+0000","last_became_active":"2024-05-12T11:06:05.172549+0000","last_became_peered":"2024-05-12T11:06:05.172549+0000","last_unstale":"2024-05-12T11:06:45.498372+0000","last_undegraded":"2024-05-12T11:06:45.498372+0000","last_fullsized":"2024-05-12T11:06:45.498372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:07:39.683046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307613+0000","last_change":"2024-05-12T11:06:05.168126+0000","last_active":"2024-05-12T11:06:45.307613+0000","last_peered":"2024-05-12T11:06:45.307613+0000","last_clean":"2024-05-12T11:06:45.307613+0000","last_became_active":"2024-05-12T11:06:05.167729+0000","last_became_peered":"2024-05-12T11:06:05.167729+0000","last_unstale":"2024-05-12T11:06:45.307613+0000","last_undegraded":"2024-05-12T11:06:45.307613+0000","last_fullsized":"2024-05-12T11:06:45.307613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:38.996242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.302718+0000","last_change":"2024-05-12T11:06:05.180165+0000","last_active":"2024-05-12T11:06:44.302718+0000","last_peered":"2024-05-12T11:06:44.302718+0000","last_clean":"2024-05-12T11:06:44.302718+0000","last_became_active":"2024-05-12T11:06:05.179589+0000","last_became_peered":"2024-05-12T11:06:05.179589+0000","last_unstale":"2024-05-12T11:06:44.302718+0000","last_undegraded":"2024-05-12T11:06:44.302718+0000","last_fullsized":"2024-05-12T11:06:44.302718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:51:53.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.350979+0000","last_change":"2024-05-12T11:06:05.176052+0000","last_active":"2024-05-12T11:06:45.350979+0000","last_peered":"2024-05-12T11:06:45.350979+0000","last_clean":"2024-05-12T11:06:45.350979+0000","last_became_active":"2024-05-12T11:06:05.175703+0000","last_became_peered":"2024-05-12T11:06:05.175703+0000","last_unstale":"2024-05-12T11:06:45.350979+0000","last_undegraded":"2024-05-12T11:06:45.350979+0000","last_fullsized":"2024-05-12T11:06:45.350979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:51:11.008516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.306540+0000","last_change":"2024-05-12T11:06:05.179144+0000","last_active":"2024-05-12T11:06:44.306540+0000","last_peered":"2024-05-12T11:06:44.306540+0000","last_clean":"2024-05-12T11:06:44.306540+0000","last_became_active":"2024-05-12T11:06:05.177854+0000","last_became_peered":"2024-05-12T11:06:05.177854+0000","last_unstale":"2024-05-12T11:06:44.306540+0000","last_undegraded":"2024-05-12T11:06:44.306540+0000","last_fullsized":"2024-05-12T11:06:44.306540+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:12.231086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-12T11:06:07.170752+0000","last_change":"2024-05-12T11:06:05.181629+0000","last_active":"2024-05-12T11:06:07.170752+0000","last_peered":"2024-05-12T11:06:07.170752+0000","last_clean":"2024-05-12T11:06:07.170752+0000","last_became_active":"2024-05-12T11:06:05.181206+0000","last_became_peered":"2024-05-12T11:06:05.181206+0000","last_unstale":"2024-05-12T11:06:07.170752+0000","last_undegraded":"2024-05-12T11:06:07.170752+0000","last_fullsized":"2024-05-12T11:06:07.170752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:26:46.025249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.303168+0000","last_change":"2024-05-12T11:06:05.176196+0000","last_active":"2024-05-12T11:06:44.303168+0000","last_peered":"2024-05-12T11:06:44.303168+0000","last_clean":"2024-05-12T11:06:44.303168+0000","last_became_active":"2024-05-12T11:06:05.175863+0000","last_became_peered":"2024-05-12T11:06:05.175863+0000","last_unstale":"2024-05-12T11:06:44.303168+0000","last_undegraded":"2024-05-12T11:06:44.303168+0000","last_fullsized":"2024-05-12T11:06:44.303168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:26:41.815661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351350+0000","last_change":"2024-05-12T11:06:05.175901+0000","last_active":"2024-05-12T11:06:45.351350+0000","last_peered":"2024-05-12T11:06:45.351350+0000","last_clean":"2024-05-12T11:06:45.351350+0000","last_became_active":"2024-05-12T11:06:05.175514+0000","last_became_peered":"2024-05-12T11:06:05.175514+0000","last_unstale":"2024-05-12T11:06:45.351350+0000","last_undegraded":"2024-05-12T11:06:45.351350+0000","last_fullsized":"2024-05-12T11:06:45.351350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:11.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498283+0000","last_change":"2024-05-12T11:06:05.175474+0000","last_active":"2024-05-12T11:06:45.498283+0000","last_peered":"2024-05-12T11:06:45.498283+0000","last_clean":"2024-05-12T11:06:45.498283+0000","last_became_active":"2024-05-12T11:06:05.175082+0000","last_became_peered":"2024-05-12T11:06:05.175082+0000","last_unstale":"2024-05-12T11:06:45.498283+0000","last_undegraded":"2024-05-12T11:06:45.498283+0000","last_fullsized":"2024-05-12T11:06:45.498283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:10:53.548758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306267+0000","last_change":"2024-05-12T11:06:05.170426+0000","last_active":"2024-05-12T11:06:45.306267+0000","last_peered":"2024-05-12T11:06:45.306267+0000","last_clean":"2024-05-12T11:06:45.306267+0000","last_became_active":"2024-05-12T11:06:05.170111+0000","last_became_peered":"2024-05-12T11:06:05.170111+0000","last_unstale":"2024-05-12T11:06:45.306267+0000","last_undegraded":"2024-05-12T11:06:45.306267+0000","last_fullsized":"2024-05-12T11:06:45.306267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:50.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309078+0000","last_change":"2024-05-12T11:06:05.178939+0000","last_active":"2024-05-12T11:06:45.309078+0000","last_peered":"2024-05-12T11:06:45.309078+0000","last_clean":"2024-05-12T11:06:45.309078+0000","last_became_active":"2024-05-12T11:06:05.178604+0000","last_became_peered":"2024-05-12T11:06:05.178604+0000","last_unstale":"2024-05-12T11:06:45.309078+0000","last_undegraded":"2024-05-12T11:06:45.309078+0000","last_fullsized":"2024-05-12T11:06:45.309078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:36.222841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.312800+0000","last_change":"2024-05-12T11:06:45.312800+0000","last_active":"2024-05-12T11:06:45.312800+0000","last_peered":"2024-05-12T11:06:45.312800+0000","last_clean":"2024-05-12T11:06:45.312800+0000","last_became_active":"2024-05-12T11:06:45.312567+0000","last_became_peered":"2024-05-12T11:06:45.312567+0000","last_unstale":"2024-05-12T11:06:45.312800+0000","last_undegraded":"2024-05-12T11:06:45.312800+0000","last_fullsized":"2024-05-12T11:06:45.312800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:30:21.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305748+0000","last_change":"2024-05-12T11:06:05.170481+0000","last_active":"2024-05-12T11:06:45.305748+0000","last_peered":"2024-05-12T11:06:45.305748+0000","last_clean":"2024-05-12T11:06:45.305748+0000","last_became_active":"2024-05-12T11:06:05.170173+0000","last_became_peered":"2024-05-12T11:06:05.170173+0000","last_unstale":"2024-05-12T11:06:45.305748+0000","last_undegraded":"2024-05-12T11:06:45.305748+0000","last_fullsized":"2024-05-12T11:06:45.305748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:01:37.775287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304227+0000","last_change":"2024-05-12T11:06:05.172942+0000","last_active":"2024-05-12T11:06:45.304227+0000","last_peered":"2024-05-12T11:06:45.304227+0000","last_clean":"2024-05-12T11:06:45.304227+0000","last_became_active":"2024-05-12T11:06:05.172612+0000","last_became_peered":"2024-05-12T11:06:05.172612+0000","last_unstale":"2024-05-12T11:06:45.304227+0000","last_undegraded":"2024-05-12T11:06:45.304227+0000","last_fullsized":"2024-05-12T11:06:45.304227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:26:51.548027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-12T11:06:07.175738+0000","last_change":"2024-05-12T11:06:05.175400+0000","last_active":"2024-05-12T11:06:07.175738+0000","last_peered":"2024-05-12T11:06:07.175738+0000","last_clean":"2024-05-12T11:06:07.175738+0000","last_became_active":"2024-05-12T11:06:05.174871+0000","last_became_peered":"2024-05-12T11:06:05.174871+0000","last_unstale":"2024-05-12T11:06:07.175738+0000","last_undegraded":"2024-05-12T11:06:07.175738+0000","last_fullsized":"2024-05-12T11:06:07.175738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:48:12.566540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308040+0000","last_change":"2024-05-12T11:06:05.172584+0000","last_active":"2024-05-12T11:06:45.308040+0000","last_peered":"2024-05-12T11:06:45.308040+0000","last_clean":"2024-05-12T11:06:45.308040+0000","last_became_active":"2024-05-12T11:06:05.171545+0000","last_became_peered":"2024-05-12T11:06:05.171545+0000","last_unstale":"2024-05-12T11:06:45.308040+0000","last_undegraded":"2024-05-12T11:06:45.308040+0000","last_fullsized":"2024-05-12T11:06:45.308040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:34:45.950231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":57,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-12T11:06:42.278242+0000","last_change":"2024-05-12T11:06:02.148890+0000","last_active":"2024-05-12T11:06:42.278242+0000","last_peered":"2024-05-12T11:06:42.278242+0000","last_clean":"2024-05-12T11:06:42.278242+0000","last_became_active":"2024-05-12T11:06:02.148544+0000","last_became_peered":"2024-05-12T11:06:02.148544+0000","last_unstale":"2024-05-12T11:06:42.278242+0000","last_undegraded":"2024-05-12T11:06:42.278242+0000","last_fullsized":"2024-05-12T11:06:42.278242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:34.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.307017+0000","last_change":"2024-05-12T11:06:05.175214+0000","last_active":"2024-05-12T11:06:44.307017+0000","last_peered":"2024-05-12T11:06:44.307017+0000","last_clean":"2024-05-12T11:06:44.307017+0000","last_became_active":"2024-05-12T11:06:05.174920+0000","last_became_peered":"2024-05-12T11:06:05.174920+0000","last_unstale":"2024-05-12T11:06:44.307017+0000","last_undegraded":"2024-05-12T11:06:44.307017+0000","last_fullsized":"2024-05-12T11:06:44.307017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:30:36.277975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.307355+0000","last_change":"2024-05-12T11:06:02.246073+0000","last_active":"2024-05-12T11:06:44.307355+0000","last_peered":"2024-05-12T11:06:44.307355+0000","last_clean":"2024-05-12T11:06:44.307355+0000","last_became_active":"2024-05-12T11:06:02.245728+0000","last_became_peered":"2024-05-12T11:06:02.245728+0000","last_unstale":"2024-05-12T11:06:44.307355+0000","last_undegraded":"2024-05-12T11:06:44.307355+0000","last_fullsized":"2024-05-12T11:06:44.307355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:43:03.273179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309614+0000","last_change":"2024-05-12T11:06:05.170448+0000","last_active":"2024-05-12T11:06:45.309614+0000","last_peered":"2024-05-12T11:06:45.309614+0000","last_clean":"2024-05-12T11:06:45.309614+0000","last_became_active":"2024-05-12T11:06:05.170133+0000","last_became_peered":"2024-05-12T11:06:05.170133+0000","last_unstale":"2024-05-12T11:06:45.309614+0000","last_undegraded":"2024-05-12T11:06:45.309614+0000","last_fullsized":"2024-05-12T11:06:45.309614+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:17:30.669009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307324+0000","last_change":"2024-05-12T11:06:02.155137+0000","last_active":"2024-05-12T11:06:45.307324+0000","last_peered":"2024-05-12T11:06:45.307324+0000","last_clean":"2024-05-12T11:06:45.307324+0000","last_became_active":"2024-05-12T11:06:02.154467+0000","last_became_peered":"2024-05-12T11:06:02.154467+0000","last_unstale":"2024-05-12T11:06:45.307324+0000","last_undegraded":"2024-05-12T11:06:45.307324+0000","last_fullsized":"2024-05-12T11:06:45.307324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:38.708094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306120+0000","last_change":"2024-05-12T11:06:05.180903+0000","last_active":"2024-05-12T11:06:45.306120+0000","last_peered":"2024-05-12T11:06:45.306120+0000","last_clean":"2024-05-12T11:06:45.306120+0000","last_became_active":"2024-05-12T11:06:05.180519+0000","last_became_peered":"2024-05-12T11:06:05.180519+0000","last_unstale":"2024-05-12T11:06:45.306120+0000","last_undegraded":"2024-05-12T11:06:45.306120+0000","last_fullsized":"2024-05-12T11:06:45.306120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:57:47.535714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.325802+0000","last_change":"2024-05-12T11:06:45.325333+0000","last_active":"2024-05-12T11:06:45.325802+0000","last_peered":"2024-05-12T11:06:45.325802+0000","last_clean":"2024-05-12T11:06:45.325802+0000","last_became_active":"2024-05-12T11:06:45.312552+0000","last_became_peered":"2024-05-12T11:06:45.312552+0000","last_unstale":"2024-05-12T11:06:45.325802+0000","last_undegraded":"2024-05-12T11:06:45.325802+0000","last_fullsized":"2024-05-12T11:06:45.325802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:45.862620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310285+0000","last_change":"2024-05-12T11:06:05.167052+0000","last_active":"2024-05-12T11:06:45.310285+0000","last_peered":"2024-05-12T11:06:45.310285+0000","last_clean":"2024-05-12T11:06:45.310285+0000","last_became_active":"2024-05-12T11:06:05.166689+0000","last_became_peered":"2024-05-12T11:06:05.166689+0000","last_unstale":"2024-05-12T11:06:45.310285+0000","last_undegraded":"2024-05-12T11:06:45.310285+0000","last_fullsized":"2024-05-12T11:06:45.310285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:34:05.008336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308494+0000","last_change":"2024-05-12T11:06:02.154630+0000","last_active":"2024-05-12T11:06:45.308494+0000","last_peered":"2024-05-12T11:06:45.308494+0000","last_clean":"2024-05-12T11:06:45.308494+0000","last_became_active":"2024-05-12T11:06:02.154254+0000","last_became_peered":"2024-05-12T11:06:02.154254+0000","last_unstale":"2024-05-12T11:06:45.308494+0000","last_undegraded":"2024-05-12T11:06:45.308494+0000","last_fullsized":"2024-05-12T11:06:45.308494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:54.294058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308547+0000","last_change":"2024-05-12T11:06:05.176582+0000","last_active":"2024-05-12T11:06:45.308547+0000","last_peered":"2024-05-12T11:06:45.308547+0000","last_clean":"2024-05-12T11:06:45.308547+0000","last_became_active":"2024-05-12T11:06:05.176241+0000","last_became_peered":"2024-05-12T11:06:05.176241+0000","last_unstale":"2024-05-12T11:06:45.308547+0000","last_undegraded":"2024-05-12T11:06:45.308547+0000","last_fullsized":"2024-05-12T11:06:45.308547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:09:00.020166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.302716+0000","last_change":"2024-05-12T11:06:02.148534+0000","last_active":"2024-05-12T11:06:44.302716+0000","last_peered":"2024-05-12T11:06:44.302716+0000","last_clean":"2024-05-12T11:06:44.302716+0000","last_became_active":"2024-05-12T11:06:02.148155+0000","last_became_peered":"2024-05-12T11:06:02.148155+0000","last_unstale":"2024-05-12T11:06:44.302716+0000","last_undegraded":"2024-05-12T11:06:44.302716+0000","last_fullsized":"2024-05-12T11:06:44.302716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:52:21.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308560+0000","last_change":"2024-05-12T11:06:05.169944+0000","last_active":"2024-05-12T11:06:45.308560+0000","last_peered":"2024-05-12T11:06:45.308560+0000","last_clean":"2024-05-12T11:06:45.308560+0000","last_became_active":"2024-05-12T11:06:05.169597+0000","last_became_peered":"2024-05-12T11:06:05.169597+0000","last_unstale":"2024-05-12T11:06:45.308560+0000","last_undegraded":"2024-05-12T11:06:45.308560+0000","last_fullsized":"2024-05-12T11:06:45.308560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:05:17.724037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305926+0000","last_change":"2024-05-12T11:06:02.154539+0000","last_active":"2024-05-12T11:06:45.305926+0000","last_peered":"2024-05-12T11:06:45.305926+0000","last_clean":"2024-05-12T11:06:45.305926+0000","last_became_active":"2024-05-12T11:06:02.154040+0000","last_became_peered":"2024-05-12T11:06:02.154040+0000","last_unstale":"2024-05-12T11:06:45.305926+0000","last_undegraded":"2024-05-12T11:06:45.305926+0000","last_fullsized":"2024-05-12T11:06:45.305926+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:10:23.875273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-12T11:06:07.169356+0000","last_change":"2024-05-12T11:06:05.163709+0000","last_active":"2024-05-12T11:06:07.169356+0000","last_peered":"2024-05-12T11:06:07.169356+0000","last_clean":"2024-05-12T11:06:07.169356+0000","last_became_active":"2024-05-12T11:06:05.163412+0000","last_became_peered":"2024-05-12T11:06:05.163412+0000","last_unstale":"2024-05-12T11:06:07.169356+0000","last_undegraded":"2024-05-12T11:06:07.169356+0000","last_fullsized":"2024-05-12T11:06:07.169356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:01:15.365920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306812+0000","last_change":"2024-05-12T11:06:02.151341+0000","last_active":"2024-05-12T11:06:45.306812+0000","last_peered":"2024-05-12T11:06:45.306812+0000","last_clean":"2024-05-12T11:06:45.306812+0000","last_became_active":"2024-05-12T11:06:02.150949+0000","last_became_peered":"2024-05-12T11:06:02.150949+0000","last_unstale":"2024-05-12T11:06:45.306812+0000","last_undegraded":"2024-05-12T11:06:45.306812+0000","last_fullsized":"2024-05-12T11:06:45.306812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:07:26.699269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-12T11:06:07.175356+0000","last_change":"2024-05-12T11:06:05.173060+0000","last_active":"2024-05-12T11:06:07.175356+0000","last_peered":"2024-05-12T11:06:07.175356+0000","last_clean":"2024-05-12T11:06:07.175356+0000","last_became_active":"2024-05-12T11:06:05.172756+0000","last_became_peered":"2024-05-12T11:06:05.172756+0000","last_unstale":"2024-05-12T11:06:07.175356+0000","last_undegraded":"2024-05-12T11:06:07.175356+0000","last_fullsized":"2024-05-12T11:06:07.175356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:15:12.797466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.303027+0000","last_change":"2024-05-12T11:06:02.152219+0000","last_active":"2024-05-12T11:06:44.303027+0000","last_peered":"2024-05-12T11:06:44.303027+0000","last_clean":"2024-05-12T11:06:44.303027+0000","last_became_active":"2024-05-12T11:06:02.151707+0000","last_became_peered":"2024-05-12T11:06:02.151707+0000","last_unstale":"2024-05-12T11:06:44.303027+0000","last_undegraded":"2024-05-12T11:06:44.303027+0000","last_fullsized":"2024-05-12T11:06:44.303027+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:43.047957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306140+0000","last_change":"2024-05-12T11:06:05.173436+0000","last_active":"2024-05-12T11:06:45.306140+0000","last_peered":"2024-05-12T11:06:45.306140+0000","last_clean":"2024-05-12T11:06:45.306140+0000","last_became_active":"2024-05-12T11:06:05.173057+0000","last_became_peered":"2024-05-12T11:06:05.173057+0000","last_unstale":"2024-05-12T11:06:45.306140+0000","last_undegraded":"2024-05-12T11:06:45.306140+0000","last_fullsized":"2024-05-12T11:06:45.306140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.408017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351515+0000","last_change":"2024-05-12T11:06:02.155037+0000","last_active":"2024-05-12T11:06:45.351515+0000","last_peered":"2024-05-12T11:06:45.351515+0000","last_clean":"2024-05-12T11:06:45.351515+0000","last_became_active":"2024-05-12T11:06:02.154658+0000","last_became_peered":"2024-05-12T11:06:02.154658+0000","last_unstale":"2024-05-12T11:06:45.351515+0000","last_undegraded":"2024-05-12T11:06:45.351515+0000","last_fullsized":"2024-05-12T11:06:45.351515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:58:16.633636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309518+0000","last_change":"2024-05-12T11:06:05.176100+0000","last_active":"2024-05-12T11:06:45.309518+0000","last_peered":"2024-05-12T11:06:45.309518+0000","last_clean":"2024-05-12T11:06:45.309518+0000","last_became_active":"2024-05-12T11:06:05.175385+0000","last_became_peered":"2024-05-12T11:06:05.175385+0000","last_unstale":"2024-05-12T11:06:45.309518+0000","last_undegraded":"2024-05-12T11:06:45.309518+0000","last_fullsized":"2024-05-12T11:06:45.309518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:10.627583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310308+0000","last_change":"2024-05-12T11:06:02.246427+0000","last_active":"2024-05-12T11:06:45.310308+0000","last_peered":"2024-05-12T11:06:45.310308+0000","last_clean":"2024-05-12T11:06:45.310308+0000","last_became_active":"2024-05-12T11:06:02.246068+0000","last_became_peered":"2024-05-12T11:06:02.246068+0000","last_unstale":"2024-05-12T11:06:45.310308+0000","last_undegraded":"2024-05-12T11:06:45.310308+0000","last_fullsized":"2024-05-12T11:06:45.310308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:40:25.533391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310358+0000","last_change":"2024-05-12T11:06:45.310358+0000","last_active":"2024-05-12T11:06:45.310358+0000","last_peered":"2024-05-12T11:06:45.310358+0000","last_clean":"2024-05-12T11:06:45.310358+0000","last_became_active":"2024-05-12T11:06:45.309960+0000","last_became_peered":"2024-05-12T11:06:45.309960+0000","last_unstale":"2024-05-12T11:06:45.310358+0000","last_undegraded":"2024-05-12T11:06:45.310358+0000","last_fullsized":"2024-05-12T11:06:45.310358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:28.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'30","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.569835+0000","last_change":"2024-05-12T11:06:02.151099+0000","last_active":"2024-05-12T11:06:44.569835+0000","last_peered":"2024-05-12T11:06:44.569835+0000","last_clean":"2024-05-12T11:06:44.569835+0000","last_became_active":"2024-05-12T11:06:02.150702+0000","last_became_peered":"2024-05-12T11:06:02.150702+0000","last_unstale":"2024-05-12T11:06:44.569835+0000","last_undegraded":"2024-05-12T11:06:44.569835+0000","last_fullsized":"2024-05-12T11:06:44.569835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:14:00.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55581,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":73,"num_write":32,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306585+0000","last_change":"2024-05-12T11:06:05.171016+0000","last_active":"2024-05-12T11:06:45.306585+0000","last_peered":"2024-05-12T11:06:45.306585+0000","last_clean":"2024-05-12T11:06:45.306585+0000","last_became_active":"2024-05-12T11:06:05.170659+0000","last_became_peered":"2024-05-12T11:06:05.170659+0000","last_unstale":"2024-05-12T11:06:45.306585+0000","last_undegraded":"2024-05-12T11:06:45.306585+0000","last_fullsized":"2024-05-12T11:06:45.306585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:13:00.756621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306762+0000","last_change":"2024-05-12T11:06:02.153854+0000","last_active":"2024-05-12T11:06:45.306762+0000","last_peered":"2024-05-12T11:06:45.306762+0000","last_clean":"2024-05-12T11:06:45.306762+0000","last_became_active":"2024-05-12T11:06:02.153501+0000","last_became_peered":"2024-05-12T11:06:02.153501+0000","last_unstale":"2024-05-12T11:06:45.306762+0000","last_undegraded":"2024-05-12T11:06:45.306762+0000","last_fullsized":"2024-05-12T11:06:45.306762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:42:37.608641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305589+0000","last_change":"2024-05-12T11:06:05.169348+0000","last_active":"2024-05-12T11:06:45.305589+0000","last_peered":"2024-05-12T11:06:45.305589+0000","last_clean":"2024-05-12T11:06:45.305589+0000","last_became_active":"2024-05-12T11:06:05.169031+0000","last_became_peered":"2024-05-12T11:06:05.169031+0000","last_unstale":"2024-05-12T11:06:45.305589+0000","last_undegraded":"2024-05-12T11:06:45.305589+0000","last_fullsized":"2024-05-12T11:06:45.305589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:07:13.104465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308102+0000","last_change":"2024-05-12T11:06:02.152482+0000","last_active":"2024-05-12T11:06:45.308102+0000","last_peered":"2024-05-12T11:06:45.308102+0000","last_clean":"2024-05-12T11:06:45.308102+0000","last_became_active":"2024-05-12T11:06:02.152077+0000","last_became_peered":"2024-05-12T11:06:02.152077+0000","last_unstale":"2024-05-12T11:06:45.308102+0000","last_undegraded":"2024-05-12T11:06:45.308102+0000","last_fullsized":"2024-05-12T11:06:45.308102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:42.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351348+0000","last_change":"2024-05-12T11:06:05.175228+0000","last_active":"2024-05-12T11:06:45.351348+0000","last_peered":"2024-05-12T11:06:45.351348+0000","last_clean":"2024-05-12T11:06:45.351348+0000","last_became_active":"2024-05-12T11:06:05.174892+0000","last_became_peered":"2024-05-12T11:06:05.174892+0000","last_unstale":"2024-05-12T11:06:45.351348+0000","last_undegraded":"2024-05-12T11:06:45.351348+0000","last_fullsized":"2024-05-12T11:06:45.351348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:34.581296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498066+0000","last_change":"2024-05-12T11:06:02.149923+0000","last_active":"2024-05-12T11:06:45.498066+0000","last_peered":"2024-05-12T11:06:45.498066+0000","last_clean":"2024-05-12T11:06:45.498066+0000","last_became_active":"2024-05-12T11:06:02.149571+0000","last_became_peered":"2024-05-12T11:06:02.149571+0000","last_unstale":"2024-05-12T11:06:45.498066+0000","last_undegraded":"2024-05-12T11:06:45.498066+0000","last_fullsized":"2024-05-12T11:06:45.498066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:23:36.118502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.350918+0000","last_change":"2024-05-12T11:06:05.178843+0000","last_active":"2024-05-12T11:06:45.350918+0000","last_peered":"2024-05-12T11:06:45.350918+0000","last_clean":"2024-05-12T11:06:45.350918+0000","last_became_active":"2024-05-12T11:06:05.178526+0000","last_became_peered":"2024-05-12T11:06:05.178526+0000","last_unstale":"2024-05-12T11:06:45.350918+0000","last_undegraded":"2024-05-12T11:06:45.350918+0000","last_fullsized":"2024-05-12T11:06:45.350918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:57.760329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.512231+0000","last_change":"2024-05-12T11:06:45.512231+0000","last_active":"2024-05-12T11:06:45.512231+0000","last_peered":"2024-05-12T11:06:45.512231+0000","last_clean":"2024-05-12T11:06:45.512231+0000","last_became_active":"2024-05-12T11:06:45.499482+0000","last_became_peered":"2024-05-12T11:06:45.499482+0000","last_unstale":"2024-05-12T11:06:45.512231+0000","last_undegraded":"2024-05-12T11:06:45.512231+0000","last_fullsized":"2024-05-12T11:06:45.512231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:34:43.986131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308676+0000","last_change":"2024-05-12T11:06:05.168307+0000","last_active":"2024-05-12T11:06:45.308676+0000","last_peered":"2024-05-12T11:06:45.308676+0000","last_clean":"2024-05-12T11:06:45.308676+0000","last_became_active":"2024-05-12T11:06:05.167606+0000","last_became_peered":"2024-05-12T11:06:05.167606+0000","last_unstale":"2024-05-12T11:06:45.308676+0000","last_undegraded":"2024-05-12T11:06:45.308676+0000","last_fullsized":"2024-05-12T11:06:45.308676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:25:09.384425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308010+0000","last_change":"2024-05-12T11:06:02.156201+0000","last_active":"2024-05-12T11:06:45.308010+0000","last_peered":"2024-05-12T11:06:45.308010+0000","last_clean":"2024-05-12T11:06:45.308010+0000","last_became_active":"2024-05-12T11:06:02.155398+0000","last_became_peered":"2024-05-12T11:06:02.155398+0000","last_unstale":"2024-05-12T11:06:45.308010+0000","last_undegraded":"2024-05-12T11:06:45.308010+0000","last_fullsized":"2024-05-12T11:06:45.308010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:23:01.157554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304115+0000","last_change":"2024-05-12T11:06:05.176837+0000","last_active":"2024-05-12T11:06:45.304115+0000","last_peered":"2024-05-12T11:06:45.304115+0000","last_clean":"2024-05-12T11:06:45.304115+0000","last_became_active":"2024-05-12T11:06:05.176450+0000","last_became_peered":"2024-05-12T11:06:05.176450+0000","last_unstale":"2024-05-12T11:06:45.304115+0000","last_undegraded":"2024-05-12T11:06:45.304115+0000","last_fullsized":"2024-05-12T11:06:45.304115+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:36:17.654259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-12T11:06:07.175492+0000","last_change":"2024-05-12T11:06:02.246999+0000","last_active":"2024-05-12T11:06:07.175492+0000","last_peered":"2024-05-12T11:06:07.175492+0000","last_clean":"2024-05-12T11:06:07.175492+0000","last_became_active":"2024-05-12T11:06:02.246063+0000","last_became_peered":"2024-05-12T11:06:02.246063+0000","last_unstale":"2024-05-12T11:06:07.175492+0000","last_undegraded":"2024-05-12T11:06:07.175492+0000","last_fullsized":"2024-05-12T11:06:07.175492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:39.303069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.302904+0000","last_change":"2024-05-12T11:06:05.175333+0000","last_active":"2024-05-12T11:06:44.302904+0000","last_peered":"2024-05-12T11:06:44.302904+0000","last_clean":"2024-05-12T11:06:44.302904+0000","last_became_active":"2024-05-12T11:06:05.175011+0000","last_became_peered":"2024-05-12T11:06:05.175011+0000","last_unstale":"2024-05-12T11:06:44.302904+0000","last_undegraded":"2024-05-12T11:06:44.302904+0000","last_fullsized":"2024-05-12T11:06:44.302904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:51:57.025941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:46.283471+0000","last_change":"2024-05-12T11:06:02.151044+0000","last_active":"2024-05-12T11:06:46.283471+0000","last_peered":"2024-05-12T11:06:46.283471+0000","last_clean":"2024-05-12T11:06:46.283471+0000","last_became_active":"2024-05-12T11:06:02.150011+0000","last_became_peered":"2024-05-12T11:06:02.150011+0000","last_unstale":"2024-05-12T11:06:46.283471+0000","last_undegraded":"2024-05-12T11:06:46.283471+0000","last_fullsized":"2024-05-12T11:06:46.283471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:16:14.058893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.302746+0000","last_change":"2024-05-12T11:06:05.179210+0000","last_active":"2024-05-12T11:06:44.302746+0000","last_peered":"2024-05-12T11:06:44.302746+0000","last_clean":"2024-05-12T11:06:44.302746+0000","last_became_active":"2024-05-12T11:06:05.178853+0000","last_became_peered":"2024-05-12T11:06:05.178853+0000","last_unstale":"2024-05-12T11:06:44.302746+0000","last_undegraded":"2024-05-12T11:06:44.302746+0000","last_fullsized":"2024-05-12T11:06:44.302746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:50:05.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307278+0000","last_change":"2024-05-12T11:06:05.170860+0000","last_active":"2024-05-12T11:06:45.307278+0000","last_peered":"2024-05-12T11:06:45.307278+0000","last_clean":"2024-05-12T11:06:45.307278+0000","last_became_active":"2024-05-12T11:06:05.170502+0000","last_became_peered":"2024-05-12T11:06:05.170502+0000","last_unstale":"2024-05-12T11:06:45.307278+0000","last_undegraded":"2024-05-12T11:06:45.307278+0000","last_fullsized":"2024-05-12T11:06:45.307278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:26:46.495176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305875+0000","last_change":"2024-05-12T11:06:02.245996+0000","last_active":"2024-05-12T11:06:45.305875+0000","last_peered":"2024-05-12T11:06:45.305875+0000","last_clean":"2024-05-12T11:06:45.305875+0000","last_became_active":"2024-05-12T11:06:02.245629+0000","last_became_peered":"2024-05-12T11:06:02.245629+0000","last_unstale":"2024-05-12T11:06:45.305875+0000","last_undegraded":"2024-05-12T11:06:45.305875+0000","last_fullsized":"2024-05-12T11:06:45.305875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:02:54.794852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.306403+0000","last_change":"2024-05-12T11:06:05.174731+0000","last_active":"2024-05-12T11:06:44.306403+0000","last_peered":"2024-05-12T11:06:44.306403+0000","last_clean":"2024-05-12T11:06:44.306403+0000","last_became_active":"2024-05-12T11:06:05.174396+0000","last_became_peered":"2024-05-12T11:06:05.174396+0000","last_unstale":"2024-05-12T11:06:44.306403+0000","last_undegraded":"2024-05-12T11:06:44.306403+0000","last_fullsized":"2024-05-12T11:06:44.306403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:30:48.352011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498237+0000","last_change":"2024-05-12T11:06:02.153635+0000","last_active":"2024-05-12T11:06:45.498237+0000","last_peered":"2024-05-12T11:06:45.498237+0000","last_clean":"2024-05-12T11:06:45.498237+0000","last_became_active":"2024-05-12T11:06:02.153268+0000","last_became_peered":"2024-05-12T11:06:02.153268+0000","last_unstale":"2024-05-12T11:06:45.498237+0000","last_undegraded":"2024-05-12T11:06:45.498237+0000","last_fullsized":"2024-05-12T11:06:45.498237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:55.245138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351059+0000","last_change":"2024-05-12T11:04:37.106045+0000","last_active":"2024-05-12T11:06:45.351059+0000","last_peered":"2024-05-12T11:06:45.351059+0000","last_clean":"2024-05-12T11:06:45.351059+0000","last_became_active":"2024-05-12T11:04:37.101364+0000","last_became_peered":"2024-05-12T11:04:37.101364+0000","last_unstale":"2024-05-12T11:06:45.351059+0000","last_undegraded":"2024-05-12T11:06:45.351059+0000","last_fullsized":"2024-05-12T11:06:45.351059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_clean_scrub_stamp":"2024-05-12T11:01:12.632157+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:53:22.531168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305728+0000","last_change":"2024-05-12T11:06:05.163927+0000","last_active":"2024-05-12T11:06:45.305728+0000","last_peered":"2024-05-12T11:06:45.305728+0000","last_clean":"2024-05-12T11:06:45.305728+0000","last_became_active":"2024-05-12T11:06:05.163610+0000","last_became_peered":"2024-05-12T11:06:05.163610+0000","last_unstale":"2024-05-12T11:06:45.305728+0000","last_undegraded":"2024-05-12T11:06:45.305728+0000","last_fullsized":"2024-05-12T11:06:45.305728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:58:31.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351125+0000","last_change":"2024-05-12T11:06:02.152658+0000","last_active":"2024-05-12T11:06:45.351125+0000","last_peered":"2024-05-12T11:06:45.351125+0000","last_clean":"2024-05-12T11:06:45.351125+0000","last_became_active":"2024-05-12T11:06:02.151770+0000","last_became_peered":"2024-05-12T11:06:02.151770+0000","last_unstale":"2024-05-12T11:06:45.351125+0000","last_undegraded":"2024-05-12T11:06:45.351125+0000","last_fullsized":"2024-05-12T11:06:45.351125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:18.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307050+0000","last_change":"2024-05-12T11:06:02.246421+0000","last_active":"2024-05-12T11:06:45.307050+0000","last_peered":"2024-05-12T11:06:45.307050+0000","last_clean":"2024-05-12T11:06:45.307050+0000","last_became_active":"2024-05-12T11:06:02.246065+0000","last_became_peered":"2024-05-12T11:06:02.246065+0000","last_unstale":"2024-05-12T11:06:45.307050+0000","last_undegraded":"2024-05-12T11:06:45.307050+0000","last_fullsized":"2024-05-12T11:06:45.307050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:34:28.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305785+0000","last_change":"2024-05-12T11:06:05.166916+0000","last_active":"2024-05-12T11:06:45.305785+0000","last_peered":"2024-05-12T11:06:45.305785+0000","last_clean":"2024-05-12T11:06:45.305785+0000","last_became_active":"2024-05-12T11:06:05.165877+0000","last_became_peered":"2024-05-12T11:06:05.165877+0000","last_unstale":"2024-05-12T11:06:45.305785+0000","last_undegraded":"2024-05-12T11:06:45.305785+0000","last_fullsized":"2024-05-12T11:06:45.305785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:46:47.935159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'13","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-12T11:06:40.178469+0000","last_change":"2024-05-12T11:06:02.151339+0000","last_active":"2024-05-12T11:06:40.178469+0000","last_peered":"2024-05-12T11:06:40.178469+0000","last_clean":"2024-05-12T11:06:40.178469+0000","last_became_active":"2024-05-12T11:06:02.150968+0000","last_became_peered":"2024-05-12T11:06:02.150968+0000","last_unstale":"2024-05-12T11:06:40.178469+0000","last_undegraded":"2024-05-12T11:06:40.178469+0000","last_fullsized":"2024-05-12T11:06:40.178469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:22:39.625972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.307372+0000","last_change":"2024-05-12T11:06:05.165277+0000","last_active":"2024-05-12T11:06:44.307372+0000","last_peered":"2024-05-12T11:06:44.307372+0000","last_clean":"2024-05-12T11:06:44.307372+0000","last_became_active":"2024-05-12T11:06:05.164992+0000","last_became_peered":"2024-05-12T11:06:05.164992+0000","last_unstale":"2024-05-12T11:06:44.307372+0000","last_undegraded":"2024-05-12T11:06:44.307372+0000","last_fullsized":"2024-05-12T11:06:44.307372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:18.193170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498226+0000","last_change":"2024-05-12T11:06:02.151167+0000","last_active":"2024-05-12T11:06:45.498226+0000","last_peered":"2024-05-12T11:06:45.498226+0000","last_clean":"2024-05-12T11:06:45.498226+0000","last_became_active":"2024-05-12T11:06:02.150815+0000","last_became_peered":"2024-05-12T11:06:02.150815+0000","last_unstale":"2024-05-12T11:06:45.498226+0000","last_undegraded":"2024-05-12T11:06:45.498226+0000","last_fullsized":"2024-05-12T11:06:45.498226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:50.811297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.352790+0000","last_change":"2024-05-12T11:06:45.352790+0000","last_active":"2024-05-12T11:06:45.352790+0000","last_peered":"2024-05-12T11:06:45.352790+0000","last_clean":"2024-05-12T11:06:45.352790+0000","last_became_active":"2024-05-12T11:06:45.352409+0000","last_became_peered":"2024-05-12T11:06:45.352409+0000","last_unstale":"2024-05-12T11:06:45.352790+0000","last_undegraded":"2024-05-12T11:06:45.352790+0000","last_fullsized":"2024-05-12T11:06:45.352790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:16.535709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305794+0000","last_change":"2024-05-12T11:06:02.246676+0000","last_active":"2024-05-12T11:06:45.305794+0000","last_peered":"2024-05-12T11:06:45.305794+0000","last_clean":"2024-05-12T11:06:45.305794+0000","last_became_active":"2024-05-12T11:06:02.246344+0000","last_became_peered":"2024-05-12T11:06:02.246344+0000","last_unstale":"2024-05-12T11:06:45.305794+0000","last_undegraded":"2024-05-12T11:06:45.305794+0000","last_fullsized":"2024-05-12T11:06:45.305794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:17.805058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307475+0000","last_change":"2024-05-12T11:06:05.175597+0000","last_active":"2024-05-12T11:06:45.307475+0000","last_peered":"2024-05-12T11:06:45.307475+0000","last_clean":"2024-05-12T11:06:45.307475+0000","last_became_active":"2024-05-12T11:06:05.175237+0000","last_became_peered":"2024-05-12T11:06:05.175237+0000","last_unstale":"2024-05-12T11:06:45.307475+0000","last_undegraded":"2024-05-12T11:06:45.307475+0000","last_fullsized":"2024-05-12T11:06:45.307475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:50:12.872570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.306239+0000","last_change":"2024-05-12T11:06:02.148706+0000","last_active":"2024-05-12T11:06:44.306239+0000","last_peered":"2024-05-12T11:06:44.306239+0000","last_clean":"2024-05-12T11:06:44.306239+0000","last_became_active":"2024-05-12T11:06:02.148437+0000","last_became_peered":"2024-05-12T11:06:02.148437+0000","last_unstale":"2024-05-12T11:06:44.306239+0000","last_undegraded":"2024-05-12T11:06:44.306239+0000","last_fullsized":"2024-05-12T11:06:44.306239+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:54:39.969677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.303571+0000","last_change":"2024-05-12T11:06:05.174248+0000","last_active":"2024-05-12T11:06:45.303571+0000","last_peered":"2024-05-12T11:06:45.303571+0000","last_clean":"2024-05-12T11:06:45.303571+0000","last_became_active":"2024-05-12T11:06:05.173934+0000","last_became_peered":"2024-05-12T11:06:05.173934+0000","last_unstale":"2024-05-12T11:06:45.303571+0000","last_undegraded":"2024-05-12T11:06:45.303571+0000","last_fullsized":"2024-05-12T11:06:45.303571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:04:58.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.316925+0000","last_change":"2024-05-12T11:06:45.316406+0000","last_active":"2024-05-12T11:06:45.316925+0000","last_peered":"2024-05-12T11:06:45.316925+0000","last_clean":"2024-05-12T11:06:45.316925+0000","last_became_active":"2024-05-12T11:06:45.310351+0000","last_became_peered":"2024-05-12T11:06:45.310351+0000","last_unstale":"2024-05-12T11:06:45.316925+0000","last_undegraded":"2024-05-12T11:06:45.316925+0000","last_fullsized":"2024-05-12T11:06:45.316925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:11.687974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.306878+0000","last_change":"2024-05-12T11:06:05.177548+0000","last_active":"2024-05-12T11:06:44.306878+0000","last_peered":"2024-05-12T11:06:44.306878+0000","last_clean":"2024-05-12T11:06:44.306878+0000","last_became_active":"2024-05-12T11:06:05.176871+0000","last_became_peered":"2024-05-12T11:06:05.176871+0000","last_unstale":"2024-05-12T11:06:44.306878+0000","last_undegraded":"2024-05-12T11:06:44.306878+0000","last_fullsized":"2024-05-12T11:06:44.306878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:38:08.347801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307748+0000","last_change":"2024-05-12T11:06:02.155096+0000","last_active":"2024-05-12T11:06:45.307748+0000","last_peered":"2024-05-12T11:06:45.307748+0000","last_clean":"2024-05-12T11:06:45.307748+0000","last_became_active":"2024-05-12T11:06:02.154721+0000","last_became_peered":"2024-05-12T11:06:02.154721+0000","last_unstale":"2024-05-12T11:06:45.307748+0000","last_undegraded":"2024-05-12T11:06:45.307748+0000","last_fullsized":"2024-05-12T11:06:45.307748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:01.407453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351244+0000","last_change":"2024-05-12T11:06:05.170305+0000","last_active":"2024-05-12T11:06:45.351244+0000","last_peered":"2024-05-12T11:06:45.351244+0000","last_clean":"2024-05-12T11:06:45.351244+0000","last_became_active":"2024-05-12T11:06:05.169970+0000","last_became_peered":"2024-05-12T11:06:05.169970+0000","last_unstale":"2024-05-12T11:06:45.351244+0000","last_undegraded":"2024-05-12T11:06:45.351244+0000","last_fullsized":"2024-05-12T11:06:45.351244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:48:11.680873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307125+0000","last_change":"2024-05-12T11:06:02.246541+0000","last_active":"2024-05-12T11:06:45.307125+0000","last_peered":"2024-05-12T11:06:45.307125+0000","last_clean":"2024-05-12T11:06:45.307125+0000","last_became_active":"2024-05-12T11:06:02.246071+0000","last_became_peered":"2024-05-12T11:06:02.246071+0000","last_unstale":"2024-05-12T11:06:45.307125+0000","last_undegraded":"2024-05-12T11:06:45.307125+0000","last_fullsized":"2024-05-12T11:06:45.307125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:27:16.649146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351417+0000","last_change":"2024-05-12T11:06:05.170566+0000","last_active":"2024-05-12T11:06:45.351417+0000","last_peered":"2024-05-12T11:06:45.351417+0000","last_clean":"2024-05-12T11:06:45.351417+0000","last_became_active":"2024-05-12T11:06:05.170225+0000","last_became_peered":"2024-05-12T11:06:05.170225+0000","last_unstale":"2024-05-12T11:06:45.351417+0000","last_undegraded":"2024-05-12T11:06:45.351417+0000","last_fullsized":"2024-05-12T11:06:45.351417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:42.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310170+0000","last_change":"2024-05-12T11:06:02.151920+0000","last_active":"2024-05-12T11:06:45.310170+0000","last_peered":"2024-05-12T11:06:45.310170+0000","last_clean":"2024-05-12T11:06:45.310170+0000","last_became_active":"2024-05-12T11:06:02.151551+0000","last_became_peered":"2024-05-12T11:06:02.151551+0000","last_unstale":"2024-05-12T11:06:45.310170+0000","last_undegraded":"2024-05-12T11:06:45.310170+0000","last_fullsized":"2024-05-12T11:06:45.310170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:11:10.230956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351219+0000","last_change":"2024-05-12T11:06:05.174964+0000","last_active":"2024-05-12T11:06:45.351219+0000","last_peered":"2024-05-12T11:06:45.351219+0000","last_clean":"2024-05-12T11:06:45.351219+0000","last_became_active":"2024-05-12T11:06:05.174562+0000","last_became_peered":"2024-05-12T11:06:05.174562+0000","last_unstale":"2024-05-12T11:06:45.351219+0000","last_undegraded":"2024-05-12T11:06:45.351219+0000","last_fullsized":"2024-05-12T11:06:45.351219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:37:22.252200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.319312+0000","last_change":"2024-05-12T11:06:45.319312+0000","last_active":"2024-05-12T11:06:45.319312+0000","last_peered":"2024-05-12T11:06:45.319312+0000","last_clean":"2024-05-12T11:06:45.319312+0000","last_became_active":"2024-05-12T11:06:45.310683+0000","last_became_peered":"2024-05-12T11:06:45.310683+0000","last_unstale":"2024-05-12T11:06:45.319312+0000","last_undegraded":"2024-05-12T11:06:45.319312+0000","last_fullsized":"2024-05-12T11:06:45.319312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:24:21.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351597+0000","last_change":"2024-05-12T11:06:05.176798+0000","last_active":"2024-05-12T11:06:45.351597+0000","last_peered":"2024-05-12T11:06:45.351597+0000","last_clean":"2024-05-12T11:06:45.351597+0000","last_became_active":"2024-05-12T11:06:05.176476+0000","last_became_peered":"2024-05-12T11:06:05.176476+0000","last_unstale":"2024-05-12T11:06:45.351597+0000","last_undegraded":"2024-05-12T11:06:45.351597+0000","last_fullsized":"2024-05-12T11:06:45.351597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:16.111038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.303794+0000","last_change":"2024-05-12T11:06:05.180278+0000","last_active":"2024-05-12T11:06:45.303794+0000","last_peered":"2024-05-12T11:06:45.303794+0000","last_clean":"2024-05-12T11:06:45.303794+0000","last_became_active":"2024-05-12T11:06:05.179863+0000","last_became_peered":"2024-05-12T11:06:05.179863+0000","last_unstale":"2024-05-12T11:06:45.303794+0000","last_undegraded":"2024-05-12T11:06:45.303794+0000","last_fullsized":"2024-05-12T11:06:45.303794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:13:32.588753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.499552+0000","last_change":"2024-05-12T11:06:45.499552+0000","last_active":"2024-05-12T11:06:45.499552+0000","last_peered":"2024-05-12T11:06:45.499552+0000","last_clean":"2024-05-12T11:06:45.499552+0000","last_became_active":"2024-05-12T11:06:45.499078+0000","last_became_peered":"2024-05-12T11:06:45.499078+0000","last_unstale":"2024-05-12T11:06:45.499552+0000","last_undegraded":"2024-05-12T11:06:45.499552+0000","last_fullsized":"2024-05-12T11:06:45.499552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:41:37.019535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306699+0000","last_change":"2024-05-12T11:06:05.172282+0000","last_active":"2024-05-12T11:06:45.306699+0000","last_peered":"2024-05-12T11:06:45.306699+0000","last_clean":"2024-05-12T11:06:45.306699+0000","last_became_active":"2024-05-12T11:06:05.171930+0000","last_became_peered":"2024-05-12T11:06:05.171930+0000","last_unstale":"2024-05-12T11:06:45.306699+0000","last_undegraded":"2024-05-12T11:06:45.306699+0000","last_fullsized":"2024-05-12T11:06:45.306699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:20:56.314181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309794+0000","last_change":"2024-05-12T11:06:05.173726+0000","last_active":"2024-05-12T11:06:45.309794+0000","last_peered":"2024-05-12T11:06:45.309794+0000","last_clean":"2024-05-12T11:06:45.309794+0000","last_became_active":"2024-05-12T11:06:05.173195+0000","last_became_peered":"2024-05-12T11:06:05.173195+0000","last_unstale":"2024-05-12T11:06:45.309794+0000","last_undegraded":"2024-05-12T11:06:45.309794+0000","last_fullsized":"2024-05-12T11:06:45.309794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:19.397213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305881+0000","last_change":"2024-05-12T11:06:05.167841+0000","last_active":"2024-05-12T11:06:45.305881+0000","last_peered":"2024-05-12T11:06:45.305881+0000","last_clean":"2024-05-12T11:06:45.305881+0000","last_became_active":"2024-05-12T11:06:05.166577+0000","last_became_peered":"2024-05-12T11:06:05.166577+0000","last_unstale":"2024-05-12T11:06:45.305881+0000","last_undegraded":"2024-05-12T11:06:45.305881+0000","last_fullsized":"2024-05-12T11:06:45.305881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:01.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.303932+0000","last_change":"2024-05-12T11:06:05.170753+0000","last_active":"2024-05-12T11:06:45.303932+0000","last_peered":"2024-05-12T11:06:45.303932+0000","last_clean":"2024-05-12T11:06:45.303932+0000","last_became_active":"2024-05-12T11:06:05.169410+0000","last_became_peered":"2024-05-12T11:06:05.169410+0000","last_unstale":"2024-05-12T11:06:45.303932+0000","last_undegraded":"2024-05-12T11:06:45.303932+0000","last_fullsized":"2024-05-12T11:06:45.303932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:42:30.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306641+0000","last_change":"2024-05-12T11:06:05.170692+0000","last_active":"2024-05-12T11:06:45.306641+0000","last_peered":"2024-05-12T11:06:45.306641+0000","last_clean":"2024-05-12T11:06:45.306641+0000","last_became_active":"2024-05-12T11:06:05.170349+0000","last_became_peered":"2024-05-12T11:06:05.170349+0000","last_unstale":"2024-05-12T11:06:45.306641+0000","last_undegraded":"2024-05-12T11:06:45.306641+0000","last_fullsized":"2024-05-12T11:06:45.306641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:13:19.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.307230+0000","last_change":"2024-05-12T11:06:05.173600+0000","last_active":"2024-05-12T11:06:44.307230+0000","last_peered":"2024-05-12T11:06:44.307230+0000","last_clean":"2024-05-12T11:06:44.307230+0000","last_became_active":"2024-05-12T11:06:05.173288+0000","last_became_peered":"2024-05-12T11:06:05.173288+0000","last_unstale":"2024-05-12T11:06:44.307230+0000","last_undegraded":"2024-05-12T11:06:44.307230+0000","last_fullsized":"2024-05-12T11:06:44.307230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:06:45.082031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306980+0000","last_change":"2024-05-12T11:06:05.169864+0000","last_active":"2024-05-12T11:06:45.306980+0000","last_peered":"2024-05-12T11:06:45.306980+0000","last_clean":"2024-05-12T11:06:45.306980+0000","last_became_active":"2024-05-12T11:06:05.169521+0000","last_became_peered":"2024-05-12T11:06:05.169521+0000","last_unstale":"2024-05-12T11:06:45.306980+0000","last_undegraded":"2024-05-12T11:06:45.306980+0000","last_fullsized":"2024-05-12T11:06:45.306980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.825436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-12T11:06:44.306137+0000","last_change":"2024-05-12T11:06:05.176370+0000","last_active":"2024-05-12T11:06:44.306137+0000","last_peered":"2024-05-12T11:06:44.306137+0000","last_clean":"2024-05-12T11:06:44.306137+0000","last_became_active":"2024-05-12T11:06:05.176031+0000","last_became_peered":"2024-05-12T11:06:05.176031+0000","last_unstale":"2024-05-12T11:06:44.306137+0000","last_undegraded":"2024-05-12T11:06:44.306137+0000","last_fullsized":"2024-05-12T11:06:44.306137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:32:52.893909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306358+0000","last_change":"2024-05-12T11:06:05.170708+0000","last_active":"2024-05-12T11:06:45.306358+0000","last_peered":"2024-05-12T11:06:45.306358+0000","last_clean":"2024-05-12T11:06:45.306358+0000","last_became_active":"2024-05-12T11:06:05.169591+0000","last_became_peered":"2024-05-12T11:06:05.169591+0000","last_unstale":"2024-05-12T11:06:45.306358+0000","last_undegraded":"2024-05-12T11:06:45.306358+0000","last_fullsized":"2024-05-12T11:06:45.306358+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:08.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306329+0000","last_change":"2024-05-12T11:06:05.172614+0000","last_active":"2024-05-12T11:06:45.306329+0000","last_peered":"2024-05-12T11:06:45.306329+0000","last_clean":"2024-05-12T11:06:45.306329+0000","last_became_active":"2024-05-12T11:06:05.172290+0000","last_became_peered":"2024-05-12T11:06:05.172290+0000","last_unstale":"2024-05-12T11:06:45.306329+0000","last_undegraded":"2024-05-12T11:06:45.306329+0000","last_fullsized":"2024-05-12T11:06:45.306329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:32.169139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.303762+0000","last_change":"2024-05-12T11:06:05.171333+0000","last_active":"2024-05-12T11:06:45.303762+0000","last_peered":"2024-05-12T11:06:45.303762+0000","last_clean":"2024-05-12T11:06:45.303762+0000","last_became_active":"2024-05-12T11:06:05.170035+0000","last_became_peered":"2024-05-12T11:06:05.170035+0000","last_unstale":"2024-05-12T11:06:45.303762+0000","last_undegraded":"2024-05-12T11:06:45.303762+0000","last_fullsized":"2024-05-12T11:06:45.303762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:18.852851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280976,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62394,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":266,"num_read_kb":192,"num_write":239,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":187182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645336,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":434049,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841564,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":1057398,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005090,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":416113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201320,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":909312,"data_stored":433193,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397549,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":1026293,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561074,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":901120,"data_stored":433114,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":958464,"data_stored":489608,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":434453,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":966656,"data_stored":481694,"data_compressed":2863,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149759,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":424414,"data_compressed":2863,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":909312,"data_stored":433087,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757303,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1025971,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":57317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T11:06:50.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-12T11:06:50.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:50 smithi172 ceph-mon[34517]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:06:50.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:50 smithi176 ceph-mon[34357]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:06:50.833 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:51.707 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:51 smithi086 ceph-mon[30110]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 12 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:51.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:51 smithi172 ceph-mon[34517]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 12 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:51.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:51 smithi176 ceph-mon[34357]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 12 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 -- 172.21.15.86:0/223835264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 msgr2=0x7feae41067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/223835264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 0x7feae41067a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fead40099c0 tx=0x7fead4009cd0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 -- 172.21.15.86:0/223835264 shutdown_connections 2024-05-12T11:06:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/223835264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae4106e80 0x7feae410ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/223835264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae4101da0 0x7feae4102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/223835264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 0x7feae41067a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 -- 172.21.15.86:0/223835264 >> 172.21.15.86:0/223835264 conn(0x7feae40789a0 msgr2=0x7feae40ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 -- 172.21.15.86:0/223835264 shutdown_connections 2024-05-12T11:06:52.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 -- 172.21.15.86:0/223835264 wait complete. 2024-05-12T11:06:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 Processor -- start 2024-05-12T11:06:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.596+0000 7feaeb4b1700 1 -- start start 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feaeb4b1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae4101da0 0x7feae419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feaeb4b1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 0x7feae419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feaeb4b1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae4106e80 0x7feae4199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feaeb4b1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feae4112670 con 0x7feae4102750 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feaeb4b1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feae41124f0 con 0x7feae4101da0 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feaeb4b1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feae41127f0 con 0x7feae4106e80 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 0x7feae419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 0x7feae419fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49862/0 (socket says 172.21.15.86:49862) 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 -- 172.21.15.86:0/418449681 learned_addr learned my addr 172.21.15.86:0/418449681 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae924d700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae4101da0 0x7feae419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae9a4e700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae4106e80 0x7feae4199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:52.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 -- 172.21.15.86:0/418449681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae4106e80 msgr2=0x7feae4199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae4106e80 0x7feae4199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 -- 172.21.15.86:0/418449681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae4101da0 msgr2=0x7feae419f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae4101da0 0x7feae419f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 -- 172.21.15.86:0/418449681 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae419a280 con 0x7feae4102750 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feae8a4c700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 0x7feae419fe50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fead4009f50 tx=0x7fead40037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feada7fc700 1 -- 172.21.15.86:0/418449681 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4027070 con 0x7feae4102750 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae419a510 con 0x7feae4102750 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feada7fc700 1 -- 172.21.15.86:0/418449681 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fead4003fa0 con 0x7feae4102750 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feada7fc700 1 -- 172.21.15.86:0/418449681 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4022d20 con 0x7feae4102750 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.597+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae41a67e0 con 0x7feae4102750 2024-05-12T11:06:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.598+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae4103280 con 0x7feae4102750 2024-05-12T11:06:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.600+0000 7feada7fc700 1 -- 172.21.15.86:0/418449681 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fead402a070 con 0x7feae4102750 2024-05-12T11:06:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.600+0000 7feada7fc700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fead00b2910 0x7fead00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.600+0000 7feae924d700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fead00b2910 0x7fead00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:52.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.600+0000 7feada7fc700 1 -- 172.21.15.86:0/418449681 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fead40e3a00 con 0x7feae4102750 2024-05-12T11:06:52.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.601+0000 7feae924d700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fead00b2910 0x7fead00b4dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feae0009a10 tx=0x7feae0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.604+0000 7feada7fc700 1 -- 172.21.15.86:0/418449681 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fead4031070 con 0x7feae4102750 2024-05-12T11:06:52.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.803+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feae40fff20 con 0x7fead00b2910 2024-05-12T11:06:52.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.811+0000 7feada7fc700 1 -- 172.21.15.86:0/418449681 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259011 (secure 0 0 0) 0x7feae40fff20 con 0x7fead00b2910 2024-05-12T11:06:52.807 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:06:52.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.813+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fead00b2910 msgr2=0x7fead00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:52.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.813+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fead00b2910 0x7fead00b4dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feae0009a10 tx=0x7feae0009190 comp rx=0 tx=0).stop 2024-05-12T11:06:52.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.813+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 msgr2=0x7feae419fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:52.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.813+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 0x7feae419fe50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fead4009f50 tx=0x7fead40037c0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.814+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 shutdown_connections 2024-05-12T11:06:52.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.814+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fead00b2910 0x7fead00b4dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.814+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae4106e80 0x7feae4199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.814+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae4101da0 0x7feae419f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.814+0000 7feaeb4b1700 1 --2- 172.21.15.86:0/418449681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae4102750 0x7feae419fe50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:52.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.814+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 >> 172.21.15.86:0/418449681 conn(0x7feae40789a0 msgr2=0x7feae4105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:52.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.814+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 shutdown_connections 2024-05-12T11:06:52.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:52.814+0000 7feaeb4b1700 1 -- 172.21.15.86:0/418449681 wait complete. 2024-05-12T11:06:52.810 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-05-12T11:06:53.392 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:53 smithi086 ceph-mon[30110]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:53.392 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:53 smithi086 ceph-mon[30110]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:06:53.417 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-05-12T11:06:52.080637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659241,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":393,"num_read_kb":292,"num_write":370,"num_write_kb":2288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":2952534,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":290,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372724,"kb_used_data":11032,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569100,"statfs":{"total":1151940427776,"available":1151558758400,"internally_reserved":0,"allocated":11296768,"data_stored":7152533,"data_compressed":175989,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11640,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":58,"num_write":9,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001821"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304104+0000","last_change":"2024-05-12T11:06:05.173542+0000","last_active":"2024-05-12T11:06:45.304104+0000","last_peered":"2024-05-12T11:06:45.304104+0000","last_clean":"2024-05-12T11:06:45.304104+0000","last_became_active":"2024-05-12T11:06:05.173221+0000","last_became_peered":"2024-05-12T11:06:05.173221+0000","last_unstale":"2024-05-12T11:06:45.304104+0000","last_undegraded":"2024-05-12T11:06:45.304104+0000","last_fullsized":"2024-05-12T11:06:45.304104+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310246+0000","last_change":"2024-05-12T11:06:05.178626+0000","last_active":"2024-05-12T11:06:45.310246+0000","last_peered":"2024-05-12T11:06:45.310246+0000","last_clean":"2024-05-12T11:06:45.310246+0000","last_became_active":"2024-05-12T11:06:05.178313+0000","last_became_peered":"2024-05-12T11:06:05.178313+0000","last_unstale":"2024-05-12T11:06:45.310246+0000","last_undegraded":"2024-05-12T11:06:45.310246+0000","last_fullsized":"2024-05-12T11:06:45.310246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:45:25.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309717+0000","last_change":"2024-05-12T11:06:05.175396+0000","last_active":"2024-05-12T11:06:45.309717+0000","last_peered":"2024-05-12T11:06:45.309717+0000","last_clean":"2024-05-12T11:06:45.309717+0000","last_became_active":"2024-05-12T11:06:05.175060+0000","last_became_peered":"2024-05-12T11:06:05.175060+0000","last_unstale":"2024-05-12T11:06:45.309717+0000","last_undegraded":"2024-05-12T11:06:45.309717+0000","last_fullsized":"2024-05-12T11:06:45.309717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:55:08.180220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498372+0000","last_change":"2024-05-12T11:06:05.172900+0000","last_active":"2024-05-12T11:06:45.498372+0000","last_peered":"2024-05-12T11:06:45.498372+0000","last_clean":"2024-05-12T11:06:45.498372+0000","last_became_active":"2024-05-12T11:06:05.172549+0000","last_became_peered":"2024-05-12T11:06:05.172549+0000","last_unstale":"2024-05-12T11:06:45.498372+0000","last_undegraded":"2024-05-12T11:06:45.498372+0000","last_fullsized":"2024-05-12T11:06:45.498372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:07:39.683046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307613+0000","last_change":"2024-05-12T11:06:05.168126+0000","last_active":"2024-05-12T11:06:45.307613+0000","last_peered":"2024-05-12T11:06:45.307613+0000","last_clean":"2024-05-12T11:06:45.307613+0000","last_became_active":"2024-05-12T11:06:05.167729+0000","last_became_peered":"2024-05-12T11:06:05.167729+0000","last_unstale":"2024-05-12T11:06:45.307613+0000","last_undegraded":"2024-05-12T11:06:45.307613+0000","last_fullsized":"2024-05-12T11:06:45.307613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:38.996242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304275+0000","last_change":"2024-05-12T11:06:05.180165+0000","last_active":"2024-05-12T11:06:45.304275+0000","last_peered":"2024-05-12T11:06:45.304275+0000","last_clean":"2024-05-12T11:06:45.304275+0000","last_became_active":"2024-05-12T11:06:05.179589+0000","last_became_peered":"2024-05-12T11:06:05.179589+0000","last_unstale":"2024-05-12T11:06:45.304275+0000","last_undegraded":"2024-05-12T11:06:45.304275+0000","last_fullsized":"2024-05-12T11:06:45.304275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:51:53.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.350979+0000","last_change":"2024-05-12T11:06:05.176052+0000","last_active":"2024-05-12T11:06:45.350979+0000","last_peered":"2024-05-12T11:06:45.350979+0000","last_clean":"2024-05-12T11:06:45.350979+0000","last_became_active":"2024-05-12T11:06:05.175703+0000","last_became_peered":"2024-05-12T11:06:05.175703+0000","last_unstale":"2024-05-12T11:06:45.350979+0000","last_undegraded":"2024-05-12T11:06:45.350979+0000","last_fullsized":"2024-05-12T11:06:45.350979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:51:11.008516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306780+0000","last_change":"2024-05-12T11:06:05.179144+0000","last_active":"2024-05-12T11:06:45.306780+0000","last_peered":"2024-05-12T11:06:45.306780+0000","last_clean":"2024-05-12T11:06:45.306780+0000","last_became_active":"2024-05-12T11:06:05.177854+0000","last_became_peered":"2024-05-12T11:06:05.177854+0000","last_unstale":"2024-05-12T11:06:45.306780+0000","last_undegraded":"2024-05-12T11:06:45.306780+0000","last_fullsized":"2024-05-12T11:06:45.306780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:12.231086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.311602+0000","last_change":"2024-05-12T11:06:45.310743+0000","last_active":"2024-05-12T11:06:45.311602+0000","last_peered":"2024-05-12T11:06:45.311602+0000","last_clean":"2024-05-12T11:06:45.311602+0000","last_became_active":"2024-05-12T11:06:45.310358+0000","last_became_peered":"2024-05-12T11:06:45.310358+0000","last_unstale":"2024-05-12T11:06:45.311602+0000","last_undegraded":"2024-05-12T11:06:45.311602+0000","last_fullsized":"2024-05-12T11:06:45.311602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:22:30.862132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304770+0000","last_change":"2024-05-12T11:06:05.176196+0000","last_active":"2024-05-12T11:06:45.304770+0000","last_peered":"2024-05-12T11:06:45.304770+0000","last_clean":"2024-05-12T11:06:45.304770+0000","last_became_active":"2024-05-12T11:06:05.175863+0000","last_became_peered":"2024-05-12T11:06:05.175863+0000","last_unstale":"2024-05-12T11:06:45.304770+0000","last_undegraded":"2024-05-12T11:06:45.304770+0000","last_fullsized":"2024-05-12T11:06:45.304770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:26:41.815661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351350+0000","last_change":"2024-05-12T11:06:05.175901+0000","last_active":"2024-05-12T11:06:45.351350+0000","last_peered":"2024-05-12T11:06:45.351350+0000","last_clean":"2024-05-12T11:06:45.351350+0000","last_became_active":"2024-05-12T11:06:05.175514+0000","last_became_peered":"2024-05-12T11:06:05.175514+0000","last_unstale":"2024-05-12T11:06:45.351350+0000","last_undegraded":"2024-05-12T11:06:45.351350+0000","last_fullsized":"2024-05-12T11:06:45.351350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:11.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498283+0000","last_change":"2024-05-12T11:06:05.175474+0000","last_active":"2024-05-12T11:06:45.498283+0000","last_peered":"2024-05-12T11:06:45.498283+0000","last_clean":"2024-05-12T11:06:45.498283+0000","last_became_active":"2024-05-12T11:06:05.175082+0000","last_became_peered":"2024-05-12T11:06:05.175082+0000","last_unstale":"2024-05-12T11:06:45.498283+0000","last_undegraded":"2024-05-12T11:06:45.498283+0000","last_fullsized":"2024-05-12T11:06:45.498283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:10:53.548758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306267+0000","last_change":"2024-05-12T11:06:05.170426+0000","last_active":"2024-05-12T11:06:45.306267+0000","last_peered":"2024-05-12T11:06:45.306267+0000","last_clean":"2024-05-12T11:06:45.306267+0000","last_became_active":"2024-05-12T11:06:05.170111+0000","last_became_peered":"2024-05-12T11:06:05.170111+0000","last_unstale":"2024-05-12T11:06:45.306267+0000","last_undegraded":"2024-05-12T11:06:45.306267+0000","last_fullsized":"2024-05-12T11:06:45.306267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:50.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309078+0000","last_change":"2024-05-12T11:06:05.178939+0000","last_active":"2024-05-12T11:06:45.309078+0000","last_peered":"2024-05-12T11:06:45.309078+0000","last_clean":"2024-05-12T11:06:45.309078+0000","last_became_active":"2024-05-12T11:06:05.178604+0000","last_became_peered":"2024-05-12T11:06:05.178604+0000","last_unstale":"2024-05-12T11:06:45.309078+0000","last_undegraded":"2024-05-12T11:06:45.309078+0000","last_fullsized":"2024-05-12T11:06:45.309078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:36.222841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.312800+0000","last_change":"2024-05-12T11:06:45.312800+0000","last_active":"2024-05-12T11:06:45.312800+0000","last_peered":"2024-05-12T11:06:45.312800+0000","last_clean":"2024-05-12T11:06:45.312800+0000","last_became_active":"2024-05-12T11:06:45.312567+0000","last_became_peered":"2024-05-12T11:06:45.312567+0000","last_unstale":"2024-05-12T11:06:45.312800+0000","last_undegraded":"2024-05-12T11:06:45.312800+0000","last_fullsized":"2024-05-12T11:06:45.312800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:30:21.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305748+0000","last_change":"2024-05-12T11:06:05.170481+0000","last_active":"2024-05-12T11:06:45.305748+0000","last_peered":"2024-05-12T11:06:45.305748+0000","last_clean":"2024-05-12T11:06:45.305748+0000","last_became_active":"2024-05-12T11:06:05.170173+0000","last_became_peered":"2024-05-12T11:06:05.170173+0000","last_unstale":"2024-05-12T11:06:45.305748+0000","last_undegraded":"2024-05-12T11:06:45.305748+0000","last_fullsized":"2024-05-12T11:06:45.305748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:01:37.775287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304227+0000","last_change":"2024-05-12T11:06:05.172942+0000","last_active":"2024-05-12T11:06:45.304227+0000","last_peered":"2024-05-12T11:06:45.304227+0000","last_clean":"2024-05-12T11:06:45.304227+0000","last_became_active":"2024-05-12T11:06:05.172612+0000","last_became_peered":"2024-05-12T11:06:05.172612+0000","last_unstale":"2024-05-12T11:06:45.304227+0000","last_undegraded":"2024-05-12T11:06:45.304227+0000","last_fullsized":"2024-05-12T11:06:45.304227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:26:51.548027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305613+0000","last_change":"2024-05-12T11:06:05.175400+0000","last_active":"2024-05-12T11:06:45.305613+0000","last_peered":"2024-05-12T11:06:45.305613+0000","last_clean":"2024-05-12T11:06:45.305613+0000","last_became_active":"2024-05-12T11:06:05.174871+0000","last_became_peered":"2024-05-12T11:06:05.174871+0000","last_unstale":"2024-05-12T11:06:45.305613+0000","last_undegraded":"2024-05-12T11:06:45.305613+0000","last_fullsized":"2024-05-12T11:06:45.305613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:48:12.566540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308040+0000","last_change":"2024-05-12T11:06:05.172584+0000","last_active":"2024-05-12T11:06:45.308040+0000","last_peered":"2024-05-12T11:06:45.308040+0000","last_clean":"2024-05-12T11:06:45.308040+0000","last_became_active":"2024-05-12T11:06:05.171545+0000","last_became_peered":"2024-05-12T11:06:05.171545+0000","last_unstale":"2024-05-12T11:06:45.308040+0000","last_undegraded":"2024-05-12T11:06:45.308040+0000","last_fullsized":"2024-05-12T11:06:45.308040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:34:45.950231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:47.284090+0000","last_change":"2024-05-12T11:06:02.148890+0000","last_active":"2024-05-12T11:06:47.284090+0000","last_peered":"2024-05-12T11:06:47.284090+0000","last_clean":"2024-05-12T11:06:47.284090+0000","last_became_active":"2024-05-12T11:06:02.148544+0000","last_became_peered":"2024-05-12T11:06:02.148544+0000","last_unstale":"2024-05-12T11:06:47.284090+0000","last_undegraded":"2024-05-12T11:06:47.284090+0000","last_fullsized":"2024-05-12T11:06:47.284090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:34.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307426+0000","last_change":"2024-05-12T11:06:05.175214+0000","last_active":"2024-05-12T11:06:45.307426+0000","last_peered":"2024-05-12T11:06:45.307426+0000","last_clean":"2024-05-12T11:06:45.307426+0000","last_became_active":"2024-05-12T11:06:05.174920+0000","last_became_peered":"2024-05-12T11:06:05.174920+0000","last_unstale":"2024-05-12T11:06:45.307426+0000","last_undegraded":"2024-05-12T11:06:45.307426+0000","last_fullsized":"2024-05-12T11:06:45.307426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:30:36.277975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307920+0000","last_change":"2024-05-12T11:06:02.246073+0000","last_active":"2024-05-12T11:06:45.307920+0000","last_peered":"2024-05-12T11:06:45.307920+0000","last_clean":"2024-05-12T11:06:45.307920+0000","last_became_active":"2024-05-12T11:06:02.245728+0000","last_became_peered":"2024-05-12T11:06:02.245728+0000","last_unstale":"2024-05-12T11:06:45.307920+0000","last_undegraded":"2024-05-12T11:06:45.307920+0000","last_fullsized":"2024-05-12T11:06:45.307920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:43:03.273179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309614+0000","last_change":"2024-05-12T11:06:05.170448+0000","last_active":"2024-05-12T11:06:45.309614+0000","last_peered":"2024-05-12T11:06:45.309614+0000","last_clean":"2024-05-12T11:06:45.309614+0000","last_became_active":"2024-05-12T11:06:05.170133+0000","last_became_peered":"2024-05-12T11:06:05.170133+0000","last_unstale":"2024-05-12T11:06:45.309614+0000","last_undegraded":"2024-05-12T11:06:45.309614+0000","last_fullsized":"2024-05-12T11:06:45.309614+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:17:30.669009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307324+0000","last_change":"2024-05-12T11:06:02.155137+0000","last_active":"2024-05-12T11:06:45.307324+0000","last_peered":"2024-05-12T11:06:45.307324+0000","last_clean":"2024-05-12T11:06:45.307324+0000","last_became_active":"2024-05-12T11:06:02.154467+0000","last_became_peered":"2024-05-12T11:06:02.154467+0000","last_unstale":"2024-05-12T11:06:45.307324+0000","last_undegraded":"2024-05-12T11:06:45.307324+0000","last_fullsized":"2024-05-12T11:06:45.307324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:38.708094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306120+0000","last_change":"2024-05-12T11:06:05.180903+0000","last_active":"2024-05-12T11:06:45.306120+0000","last_peered":"2024-05-12T11:06:45.306120+0000","last_clean":"2024-05-12T11:06:45.306120+0000","last_became_active":"2024-05-12T11:06:05.180519+0000","last_became_peered":"2024-05-12T11:06:05.180519+0000","last_unstale":"2024-05-12T11:06:45.306120+0000","last_undegraded":"2024-05-12T11:06:45.306120+0000","last_fullsized":"2024-05-12T11:06:45.306120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:57:47.535714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.325802+0000","last_change":"2024-05-12T11:06:45.325333+0000","last_active":"2024-05-12T11:06:45.325802+0000","last_peered":"2024-05-12T11:06:45.325802+0000","last_clean":"2024-05-12T11:06:45.325802+0000","last_became_active":"2024-05-12T11:06:45.312552+0000","last_became_peered":"2024-05-12T11:06:45.312552+0000","last_unstale":"2024-05-12T11:06:45.325802+0000","last_undegraded":"2024-05-12T11:06:45.325802+0000","last_fullsized":"2024-05-12T11:06:45.325802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:45.862620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310285+0000","last_change":"2024-05-12T11:06:05.167052+0000","last_active":"2024-05-12T11:06:45.310285+0000","last_peered":"2024-05-12T11:06:45.310285+0000","last_clean":"2024-05-12T11:06:45.310285+0000","last_became_active":"2024-05-12T11:06:05.166689+0000","last_became_peered":"2024-05-12T11:06:05.166689+0000","last_unstale":"2024-05-12T11:06:45.310285+0000","last_undegraded":"2024-05-12T11:06:45.310285+0000","last_fullsized":"2024-05-12T11:06:45.310285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:34:05.008336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:50.292065+0000","last_change":"2024-05-12T11:06:02.154630+0000","last_active":"2024-05-12T11:06:50.292065+0000","last_peered":"2024-05-12T11:06:50.292065+0000","last_clean":"2024-05-12T11:06:50.292065+0000","last_became_active":"2024-05-12T11:06:02.154254+0000","last_became_peered":"2024-05-12T11:06:02.154254+0000","last_unstale":"2024-05-12T11:06:50.292065+0000","last_undegraded":"2024-05-12T11:06:50.292065+0000","last_fullsized":"2024-05-12T11:06:50.292065+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:54.294058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308547+0000","last_change":"2024-05-12T11:06:05.176582+0000","last_active":"2024-05-12T11:06:45.308547+0000","last_peered":"2024-05-12T11:06:45.308547+0000","last_clean":"2024-05-12T11:06:45.308547+0000","last_became_active":"2024-05-12T11:06:05.176241+0000","last_became_peered":"2024-05-12T11:06:05.176241+0000","last_unstale":"2024-05-12T11:06:45.308547+0000","last_undegraded":"2024-05-12T11:06:45.308547+0000","last_fullsized":"2024-05-12T11:06:45.308547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:09:00.020166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304182+0000","last_change":"2024-05-12T11:06:02.148534+0000","last_active":"2024-05-12T11:06:45.304182+0000","last_peered":"2024-05-12T11:06:45.304182+0000","last_clean":"2024-05-12T11:06:45.304182+0000","last_became_active":"2024-05-12T11:06:02.148155+0000","last_became_peered":"2024-05-12T11:06:02.148155+0000","last_unstale":"2024-05-12T11:06:45.304182+0000","last_undegraded":"2024-05-12T11:06:45.304182+0000","last_fullsized":"2024-05-12T11:06:45.304182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:52:21.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308560+0000","last_change":"2024-05-12T11:06:05.169944+0000","last_active":"2024-05-12T11:06:45.308560+0000","last_peered":"2024-05-12T11:06:45.308560+0000","last_clean":"2024-05-12T11:06:45.308560+0000","last_became_active":"2024-05-12T11:06:05.169597+0000","last_became_peered":"2024-05-12T11:06:05.169597+0000","last_unstale":"2024-05-12T11:06:45.308560+0000","last_undegraded":"2024-05-12T11:06:45.308560+0000","last_fullsized":"2024-05-12T11:06:45.308560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:05:17.724037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305926+0000","last_change":"2024-05-12T11:06:02.154539+0000","last_active":"2024-05-12T11:06:45.305926+0000","last_peered":"2024-05-12T11:06:45.305926+0000","last_clean":"2024-05-12T11:06:45.305926+0000","last_became_active":"2024-05-12T11:06:02.154040+0000","last_became_peered":"2024-05-12T11:06:02.154040+0000","last_unstale":"2024-05-12T11:06:45.305926+0000","last_undegraded":"2024-05-12T11:06:45.305926+0000","last_fullsized":"2024-05-12T11:06:45.305926+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:10:23.875273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310807+0000","last_change":"2024-05-12T11:06:45.308950+0000","last_active":"2024-05-12T11:06:45.310807+0000","last_peered":"2024-05-12T11:06:45.310807+0000","last_clean":"2024-05-12T11:06:45.310807+0000","last_became_active":"2024-05-12T11:06:45.308579+0000","last_became_peered":"2024-05-12T11:06:45.308579+0000","last_unstale":"2024-05-12T11:06:45.310807+0000","last_undegraded":"2024-05-12T11:06:45.310807+0000","last_fullsized":"2024-05-12T11:06:45.310807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:01:08.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306812+0000","last_change":"2024-05-12T11:06:02.151341+0000","last_active":"2024-05-12T11:06:45.306812+0000","last_peered":"2024-05-12T11:06:45.306812+0000","last_clean":"2024-05-12T11:06:45.306812+0000","last_became_active":"2024-05-12T11:06:02.150949+0000","last_became_peered":"2024-05-12T11:06:02.150949+0000","last_unstale":"2024-05-12T11:06:45.306812+0000","last_undegraded":"2024-05-12T11:06:45.306812+0000","last_fullsized":"2024-05-12T11:06:45.306812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:07:26.699269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305689+0000","last_change":"2024-05-12T11:06:05.173060+0000","last_active":"2024-05-12T11:06:45.305689+0000","last_peered":"2024-05-12T11:06:45.305689+0000","last_clean":"2024-05-12T11:06:45.305689+0000","last_became_active":"2024-05-12T11:06:05.172756+0000","last_became_peered":"2024-05-12T11:06:05.172756+0000","last_unstale":"2024-05-12T11:06:45.305689+0000","last_undegraded":"2024-05-12T11:06:45.305689+0000","last_fullsized":"2024-05-12T11:06:45.305689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:15:12.797466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:49.289763+0000","last_change":"2024-05-12T11:06:02.152219+0000","last_active":"2024-05-12T11:06:49.289763+0000","last_peered":"2024-05-12T11:06:49.289763+0000","last_clean":"2024-05-12T11:06:49.289763+0000","last_became_active":"2024-05-12T11:06:02.151707+0000","last_became_peered":"2024-05-12T11:06:02.151707+0000","last_unstale":"2024-05-12T11:06:49.289763+0000","last_undegraded":"2024-05-12T11:06:49.289763+0000","last_fullsized":"2024-05-12T11:06:49.289763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:43.047957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306140+0000","last_change":"2024-05-12T11:06:05.173436+0000","last_active":"2024-05-12T11:06:45.306140+0000","last_peered":"2024-05-12T11:06:45.306140+0000","last_clean":"2024-05-12T11:06:45.306140+0000","last_became_active":"2024-05-12T11:06:05.173057+0000","last_became_peered":"2024-05-12T11:06:05.173057+0000","last_unstale":"2024-05-12T11:06:45.306140+0000","last_undegraded":"2024-05-12T11:06:45.306140+0000","last_fullsized":"2024-05-12T11:06:45.306140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.408017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351515+0000","last_change":"2024-05-12T11:06:02.155037+0000","last_active":"2024-05-12T11:06:45.351515+0000","last_peered":"2024-05-12T11:06:45.351515+0000","last_clean":"2024-05-12T11:06:45.351515+0000","last_became_active":"2024-05-12T11:06:02.154658+0000","last_became_peered":"2024-05-12T11:06:02.154658+0000","last_unstale":"2024-05-12T11:06:45.351515+0000","last_undegraded":"2024-05-12T11:06:45.351515+0000","last_fullsized":"2024-05-12T11:06:45.351515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:58:16.633636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309518+0000","last_change":"2024-05-12T11:06:05.176100+0000","last_active":"2024-05-12T11:06:45.309518+0000","last_peered":"2024-05-12T11:06:45.309518+0000","last_clean":"2024-05-12T11:06:45.309518+0000","last_became_active":"2024-05-12T11:06:05.175385+0000","last_became_peered":"2024-05-12T11:06:05.175385+0000","last_unstale":"2024-05-12T11:06:45.309518+0000","last_undegraded":"2024-05-12T11:06:45.309518+0000","last_fullsized":"2024-05-12T11:06:45.309518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:10.627583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310308+0000","last_change":"2024-05-12T11:06:02.246427+0000","last_active":"2024-05-12T11:06:45.310308+0000","last_peered":"2024-05-12T11:06:45.310308+0000","last_clean":"2024-05-12T11:06:45.310308+0000","last_became_active":"2024-05-12T11:06:02.246068+0000","last_became_peered":"2024-05-12T11:06:02.246068+0000","last_unstale":"2024-05-12T11:06:45.310308+0000","last_undegraded":"2024-05-12T11:06:45.310308+0000","last_fullsized":"2024-05-12T11:06:45.310308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:40:25.533391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310358+0000","last_change":"2024-05-12T11:06:45.310358+0000","last_active":"2024-05-12T11:06:45.310358+0000","last_peered":"2024-05-12T11:06:45.310358+0000","last_clean":"2024-05-12T11:06:45.310358+0000","last_became_active":"2024-05-12T11:06:45.309960+0000","last_became_peered":"2024-05-12T11:06:45.309960+0000","last_unstale":"2024-05-12T11:06:45.310358+0000","last_undegraded":"2024-05-12T11:06:45.310358+0000","last_fullsized":"2024-05-12T11:06:45.310358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:28.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:49.569014+0000","last_change":"2024-05-12T11:06:02.151099+0000","last_active":"2024-05-12T11:06:49.569014+0000","last_peered":"2024-05-12T11:06:49.569014+0000","last_clean":"2024-05-12T11:06:49.569014+0000","last_became_active":"2024-05-12T11:06:02.150702+0000","last_became_peered":"2024-05-12T11:06:02.150702+0000","last_unstale":"2024-05-12T11:06:49.569014+0000","last_undegraded":"2024-05-12T11:06:49.569014+0000","last_fullsized":"2024-05-12T11:06:49.569014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:14:00.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61826,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":84,"num_write":34,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306585+0000","last_change":"2024-05-12T11:06:05.171016+0000","last_active":"2024-05-12T11:06:45.306585+0000","last_peered":"2024-05-12T11:06:45.306585+0000","last_clean":"2024-05-12T11:06:45.306585+0000","last_became_active":"2024-05-12T11:06:05.170659+0000","last_became_peered":"2024-05-12T11:06:05.170659+0000","last_unstale":"2024-05-12T11:06:45.306585+0000","last_undegraded":"2024-05-12T11:06:45.306585+0000","last_fullsized":"2024-05-12T11:06:45.306585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:13:00.756621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306762+0000","last_change":"2024-05-12T11:06:02.153854+0000","last_active":"2024-05-12T11:06:45.306762+0000","last_peered":"2024-05-12T11:06:45.306762+0000","last_clean":"2024-05-12T11:06:45.306762+0000","last_became_active":"2024-05-12T11:06:02.153501+0000","last_became_peered":"2024-05-12T11:06:02.153501+0000","last_unstale":"2024-05-12T11:06:45.306762+0000","last_undegraded":"2024-05-12T11:06:45.306762+0000","last_fullsized":"2024-05-12T11:06:45.306762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:42:37.608641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305589+0000","last_change":"2024-05-12T11:06:05.169348+0000","last_active":"2024-05-12T11:06:45.305589+0000","last_peered":"2024-05-12T11:06:45.305589+0000","last_clean":"2024-05-12T11:06:45.305589+0000","last_became_active":"2024-05-12T11:06:05.169031+0000","last_became_peered":"2024-05-12T11:06:05.169031+0000","last_unstale":"2024-05-12T11:06:45.305589+0000","last_undegraded":"2024-05-12T11:06:45.305589+0000","last_fullsized":"2024-05-12T11:06:45.305589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:07:13.104465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308102+0000","last_change":"2024-05-12T11:06:02.152482+0000","last_active":"2024-05-12T11:06:45.308102+0000","last_peered":"2024-05-12T11:06:45.308102+0000","last_clean":"2024-05-12T11:06:45.308102+0000","last_became_active":"2024-05-12T11:06:02.152077+0000","last_became_peered":"2024-05-12T11:06:02.152077+0000","last_unstale":"2024-05-12T11:06:45.308102+0000","last_undegraded":"2024-05-12T11:06:45.308102+0000","last_fullsized":"2024-05-12T11:06:45.308102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:42.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351348+0000","last_change":"2024-05-12T11:06:05.175228+0000","last_active":"2024-05-12T11:06:45.351348+0000","last_peered":"2024-05-12T11:06:45.351348+0000","last_clean":"2024-05-12T11:06:45.351348+0000","last_became_active":"2024-05-12T11:06:05.174892+0000","last_became_peered":"2024-05-12T11:06:05.174892+0000","last_unstale":"2024-05-12T11:06:45.351348+0000","last_undegraded":"2024-05-12T11:06:45.351348+0000","last_fullsized":"2024-05-12T11:06:45.351348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:34.581296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:50.289223+0000","last_change":"2024-05-12T11:06:02.149923+0000","last_active":"2024-05-12T11:06:50.289223+0000","last_peered":"2024-05-12T11:06:50.289223+0000","last_clean":"2024-05-12T11:06:50.289223+0000","last_became_active":"2024-05-12T11:06:02.149571+0000","last_became_peered":"2024-05-12T11:06:02.149571+0000","last_unstale":"2024-05-12T11:06:50.289223+0000","last_undegraded":"2024-05-12T11:06:50.289223+0000","last_fullsized":"2024-05-12T11:06:50.289223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:23:36.118502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.350918+0000","last_change":"2024-05-12T11:06:05.178843+0000","last_active":"2024-05-12T11:06:45.350918+0000","last_peered":"2024-05-12T11:06:45.350918+0000","last_clean":"2024-05-12T11:06:45.350918+0000","last_became_active":"2024-05-12T11:06:05.178526+0000","last_became_peered":"2024-05-12T11:06:05.178526+0000","last_unstale":"2024-05-12T11:06:45.350918+0000","last_undegraded":"2024-05-12T11:06:45.350918+0000","last_fullsized":"2024-05-12T11:06:45.350918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:57.760329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.512231+0000","last_change":"2024-05-12T11:06:45.512231+0000","last_active":"2024-05-12T11:06:45.512231+0000","last_peered":"2024-05-12T11:06:45.512231+0000","last_clean":"2024-05-12T11:06:45.512231+0000","last_became_active":"2024-05-12T11:06:45.499482+0000","last_became_peered":"2024-05-12T11:06:45.499482+0000","last_unstale":"2024-05-12T11:06:45.512231+0000","last_undegraded":"2024-05-12T11:06:45.512231+0000","last_fullsized":"2024-05-12T11:06:45.512231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:34:43.986131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308676+0000","last_change":"2024-05-12T11:06:05.168307+0000","last_active":"2024-05-12T11:06:45.308676+0000","last_peered":"2024-05-12T11:06:45.308676+0000","last_clean":"2024-05-12T11:06:45.308676+0000","last_became_active":"2024-05-12T11:06:05.167606+0000","last_became_peered":"2024-05-12T11:06:05.167606+0000","last_unstale":"2024-05-12T11:06:45.308676+0000","last_undegraded":"2024-05-12T11:06:45.308676+0000","last_fullsized":"2024-05-12T11:06:45.308676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:25:09.384425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308010+0000","last_change":"2024-05-12T11:06:02.156201+0000","last_active":"2024-05-12T11:06:45.308010+0000","last_peered":"2024-05-12T11:06:45.308010+0000","last_clean":"2024-05-12T11:06:45.308010+0000","last_became_active":"2024-05-12T11:06:02.155398+0000","last_became_peered":"2024-05-12T11:06:02.155398+0000","last_unstale":"2024-05-12T11:06:45.308010+0000","last_undegraded":"2024-05-12T11:06:45.308010+0000","last_fullsized":"2024-05-12T11:06:45.308010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:23:01.157554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304115+0000","last_change":"2024-05-12T11:06:05.176837+0000","last_active":"2024-05-12T11:06:45.304115+0000","last_peered":"2024-05-12T11:06:45.304115+0000","last_clean":"2024-05-12T11:06:45.304115+0000","last_became_active":"2024-05-12T11:06:05.176450+0000","last_became_peered":"2024-05-12T11:06:05.176450+0000","last_unstale":"2024-05-12T11:06:45.304115+0000","last_undegraded":"2024-05-12T11:06:45.304115+0000","last_fullsized":"2024-05-12T11:06:45.304115+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:36:17.654259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305632+0000","last_change":"2024-05-12T11:06:02.246999+0000","last_active":"2024-05-12T11:06:45.305632+0000","last_peered":"2024-05-12T11:06:45.305632+0000","last_clean":"2024-05-12T11:06:45.305632+0000","last_became_active":"2024-05-12T11:06:02.246063+0000","last_became_peered":"2024-05-12T11:06:02.246063+0000","last_unstale":"2024-05-12T11:06:45.305632+0000","last_undegraded":"2024-05-12T11:06:45.305632+0000","last_fullsized":"2024-05-12T11:06:45.305632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:39.303069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304407+0000","last_change":"2024-05-12T11:06:05.175333+0000","last_active":"2024-05-12T11:06:45.304407+0000","last_peered":"2024-05-12T11:06:45.304407+0000","last_clean":"2024-05-12T11:06:45.304407+0000","last_became_active":"2024-05-12T11:06:05.175011+0000","last_became_peered":"2024-05-12T11:06:05.175011+0000","last_unstale":"2024-05-12T11:06:45.304407+0000","last_undegraded":"2024-05-12T11:06:45.304407+0000","last_fullsized":"2024-05-12T11:06:45.304407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:51:57.025941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:46.283471+0000","last_change":"2024-05-12T11:06:02.151044+0000","last_active":"2024-05-12T11:06:46.283471+0000","last_peered":"2024-05-12T11:06:46.283471+0000","last_clean":"2024-05-12T11:06:46.283471+0000","last_became_active":"2024-05-12T11:06:02.150011+0000","last_became_peered":"2024-05-12T11:06:02.150011+0000","last_unstale":"2024-05-12T11:06:46.283471+0000","last_undegraded":"2024-05-12T11:06:46.283471+0000","last_fullsized":"2024-05-12T11:06:46.283471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:16:14.058893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304302+0000","last_change":"2024-05-12T11:06:05.179210+0000","last_active":"2024-05-12T11:06:45.304302+0000","last_peered":"2024-05-12T11:06:45.304302+0000","last_clean":"2024-05-12T11:06:45.304302+0000","last_became_active":"2024-05-12T11:06:05.178853+0000","last_became_peered":"2024-05-12T11:06:05.178853+0000","last_unstale":"2024-05-12T11:06:45.304302+0000","last_undegraded":"2024-05-12T11:06:45.304302+0000","last_fullsized":"2024-05-12T11:06:45.304302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:50:05.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307278+0000","last_change":"2024-05-12T11:06:05.170860+0000","last_active":"2024-05-12T11:06:45.307278+0000","last_peered":"2024-05-12T11:06:45.307278+0000","last_clean":"2024-05-12T11:06:45.307278+0000","last_became_active":"2024-05-12T11:06:05.170502+0000","last_became_peered":"2024-05-12T11:06:05.170502+0000","last_unstale":"2024-05-12T11:06:45.307278+0000","last_undegraded":"2024-05-12T11:06:45.307278+0000","last_fullsized":"2024-05-12T11:06:45.307278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:26:46.495176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:50.288493+0000","last_change":"2024-05-12T11:06:02.245996+0000","last_active":"2024-05-12T11:06:50.288493+0000","last_peered":"2024-05-12T11:06:50.288493+0000","last_clean":"2024-05-12T11:06:50.288493+0000","last_became_active":"2024-05-12T11:06:02.245629+0000","last_became_peered":"2024-05-12T11:06:02.245629+0000","last_unstale":"2024-05-12T11:06:50.288493+0000","last_undegraded":"2024-05-12T11:06:50.288493+0000","last_fullsized":"2024-05-12T11:06:50.288493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:02:54.794852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307224+0000","last_change":"2024-05-12T11:06:05.174731+0000","last_active":"2024-05-12T11:06:45.307224+0000","last_peered":"2024-05-12T11:06:45.307224+0000","last_clean":"2024-05-12T11:06:45.307224+0000","last_became_active":"2024-05-12T11:06:05.174396+0000","last_became_peered":"2024-05-12T11:06:05.174396+0000","last_unstale":"2024-05-12T11:06:45.307224+0000","last_undegraded":"2024-05-12T11:06:45.307224+0000","last_fullsized":"2024-05-12T11:06:45.307224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:30:48.352011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498237+0000","last_change":"2024-05-12T11:06:02.153635+0000","last_active":"2024-05-12T11:06:45.498237+0000","last_peered":"2024-05-12T11:06:45.498237+0000","last_clean":"2024-05-12T11:06:45.498237+0000","last_became_active":"2024-05-12T11:06:02.153268+0000","last_became_peered":"2024-05-12T11:06:02.153268+0000","last_unstale":"2024-05-12T11:06:45.498237+0000","last_undegraded":"2024-05-12T11:06:45.498237+0000","last_fullsized":"2024-05-12T11:06:45.498237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:55.245138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351059+0000","last_change":"2024-05-12T11:04:37.106045+0000","last_active":"2024-05-12T11:06:45.351059+0000","last_peered":"2024-05-12T11:06:45.351059+0000","last_clean":"2024-05-12T11:06:45.351059+0000","last_became_active":"2024-05-12T11:04:37.101364+0000","last_became_peered":"2024-05-12T11:04:37.101364+0000","last_unstale":"2024-05-12T11:06:45.351059+0000","last_undegraded":"2024-05-12T11:06:45.351059+0000","last_fullsized":"2024-05-12T11:06:45.351059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_clean_scrub_stamp":"2024-05-12T11:01:12.632157+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:53:22.531168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305728+0000","last_change":"2024-05-12T11:06:05.163927+0000","last_active":"2024-05-12T11:06:45.305728+0000","last_peered":"2024-05-12T11:06:45.305728+0000","last_clean":"2024-05-12T11:06:45.305728+0000","last_became_active":"2024-05-12T11:06:05.163610+0000","last_became_peered":"2024-05-12T11:06:05.163610+0000","last_unstale":"2024-05-12T11:06:45.305728+0000","last_undegraded":"2024-05-12T11:06:45.305728+0000","last_fullsized":"2024-05-12T11:06:45.305728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:58:31.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351125+0000","last_change":"2024-05-12T11:06:02.152658+0000","last_active":"2024-05-12T11:06:45.351125+0000","last_peered":"2024-05-12T11:06:45.351125+0000","last_clean":"2024-05-12T11:06:45.351125+0000","last_became_active":"2024-05-12T11:06:02.151770+0000","last_became_peered":"2024-05-12T11:06:02.151770+0000","last_unstale":"2024-05-12T11:06:45.351125+0000","last_undegraded":"2024-05-12T11:06:45.351125+0000","last_fullsized":"2024-05-12T11:06:45.351125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:18.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307050+0000","last_change":"2024-05-12T11:06:02.246421+0000","last_active":"2024-05-12T11:06:45.307050+0000","last_peered":"2024-05-12T11:06:45.307050+0000","last_clean":"2024-05-12T11:06:45.307050+0000","last_became_active":"2024-05-12T11:06:02.246065+0000","last_became_peered":"2024-05-12T11:06:02.246065+0000","last_unstale":"2024-05-12T11:06:45.307050+0000","last_undegraded":"2024-05-12T11:06:45.307050+0000","last_fullsized":"2024-05-12T11:06:45.307050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:34:28.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305785+0000","last_change":"2024-05-12T11:06:05.166916+0000","last_active":"2024-05-12T11:06:45.305785+0000","last_peered":"2024-05-12T11:06:45.305785+0000","last_clean":"2024-05-12T11:06:45.305785+0000","last_became_active":"2024-05-12T11:06:05.165877+0000","last_became_peered":"2024-05-12T11:06:05.165877+0000","last_unstale":"2024-05-12T11:06:45.305785+0000","last_undegraded":"2024-05-12T11:06:45.305785+0000","last_fullsized":"2024-05-12T11:06:45.305785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:46:47.935159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'15","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305554+0000","last_change":"2024-05-12T11:06:02.151339+0000","last_active":"2024-05-12T11:06:45.305554+0000","last_peered":"2024-05-12T11:06:45.305554+0000","last_clean":"2024-05-12T11:06:45.305554+0000","last_became_active":"2024-05-12T11:06:02.150968+0000","last_became_peered":"2024-05-12T11:06:02.150968+0000","last_unstale":"2024-05-12T11:06:45.305554+0000","last_undegraded":"2024-05-12T11:06:45.305554+0000","last_fullsized":"2024-05-12T11:06:45.305554+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:22:39.625972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307841+0000","last_change":"2024-05-12T11:06:05.165277+0000","last_active":"2024-05-12T11:06:45.307841+0000","last_peered":"2024-05-12T11:06:45.307841+0000","last_clean":"2024-05-12T11:06:45.307841+0000","last_became_active":"2024-05-12T11:06:05.164992+0000","last_became_peered":"2024-05-12T11:06:05.164992+0000","last_unstale":"2024-05-12T11:06:45.307841+0000","last_undegraded":"2024-05-12T11:06:45.307841+0000","last_fullsized":"2024-05-12T11:06:45.307841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:18.193170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498226+0000","last_change":"2024-05-12T11:06:02.151167+0000","last_active":"2024-05-12T11:06:45.498226+0000","last_peered":"2024-05-12T11:06:45.498226+0000","last_clean":"2024-05-12T11:06:45.498226+0000","last_became_active":"2024-05-12T11:06:02.150815+0000","last_became_peered":"2024-05-12T11:06:02.150815+0000","last_unstale":"2024-05-12T11:06:45.498226+0000","last_undegraded":"2024-05-12T11:06:45.498226+0000","last_fullsized":"2024-05-12T11:06:45.498226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:50.811297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.352790+0000","last_change":"2024-05-12T11:06:45.352790+0000","last_active":"2024-05-12T11:06:45.352790+0000","last_peered":"2024-05-12T11:06:45.352790+0000","last_clean":"2024-05-12T11:06:45.352790+0000","last_became_active":"2024-05-12T11:06:45.352409+0000","last_became_peered":"2024-05-12T11:06:45.352409+0000","last_unstale":"2024-05-12T11:06:45.352790+0000","last_undegraded":"2024-05-12T11:06:45.352790+0000","last_fullsized":"2024-05-12T11:06:45.352790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:16.535709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305794+0000","last_change":"2024-05-12T11:06:02.246676+0000","last_active":"2024-05-12T11:06:45.305794+0000","last_peered":"2024-05-12T11:06:45.305794+0000","last_clean":"2024-05-12T11:06:45.305794+0000","last_became_active":"2024-05-12T11:06:02.246344+0000","last_became_peered":"2024-05-12T11:06:02.246344+0000","last_unstale":"2024-05-12T11:06:45.305794+0000","last_undegraded":"2024-05-12T11:06:45.305794+0000","last_fullsized":"2024-05-12T11:06:45.305794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:17.805058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307475+0000","last_change":"2024-05-12T11:06:05.175597+0000","last_active":"2024-05-12T11:06:45.307475+0000","last_peered":"2024-05-12T11:06:45.307475+0000","last_clean":"2024-05-12T11:06:45.307475+0000","last_became_active":"2024-05-12T11:06:05.175237+0000","last_became_peered":"2024-05-12T11:06:05.175237+0000","last_unstale":"2024-05-12T11:06:45.307475+0000","last_undegraded":"2024-05-12T11:06:45.307475+0000","last_fullsized":"2024-05-12T11:06:45.307475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:50:12.872570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306976+0000","last_change":"2024-05-12T11:06:02.148706+0000","last_active":"2024-05-12T11:06:45.306976+0000","last_peered":"2024-05-12T11:06:45.306976+0000","last_clean":"2024-05-12T11:06:45.306976+0000","last_became_active":"2024-05-12T11:06:02.148437+0000","last_became_peered":"2024-05-12T11:06:02.148437+0000","last_unstale":"2024-05-12T11:06:45.306976+0000","last_undegraded":"2024-05-12T11:06:45.306976+0000","last_fullsized":"2024-05-12T11:06:45.306976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:54:39.969677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.303571+0000","last_change":"2024-05-12T11:06:05.174248+0000","last_active":"2024-05-12T11:06:45.303571+0000","last_peered":"2024-05-12T11:06:45.303571+0000","last_clean":"2024-05-12T11:06:45.303571+0000","last_became_active":"2024-05-12T11:06:05.173934+0000","last_became_peered":"2024-05-12T11:06:05.173934+0000","last_unstale":"2024-05-12T11:06:45.303571+0000","last_undegraded":"2024-05-12T11:06:45.303571+0000","last_fullsized":"2024-05-12T11:06:45.303571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:04:58.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.316925+0000","last_change":"2024-05-12T11:06:45.316406+0000","last_active":"2024-05-12T11:06:45.316925+0000","last_peered":"2024-05-12T11:06:45.316925+0000","last_clean":"2024-05-12T11:06:45.316925+0000","last_became_active":"2024-05-12T11:06:45.310351+0000","last_became_peered":"2024-05-12T11:06:45.310351+0000","last_unstale":"2024-05-12T11:06:45.316925+0000","last_undegraded":"2024-05-12T11:06:45.316925+0000","last_fullsized":"2024-05-12T11:06:45.316925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:11.687974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306976+0000","last_change":"2024-05-12T11:06:05.177548+0000","last_active":"2024-05-12T11:06:45.306976+0000","last_peered":"2024-05-12T11:06:45.306976+0000","last_clean":"2024-05-12T11:06:45.306976+0000","last_became_active":"2024-05-12T11:06:05.176871+0000","last_became_peered":"2024-05-12T11:06:05.176871+0000","last_unstale":"2024-05-12T11:06:45.306976+0000","last_undegraded":"2024-05-12T11:06:45.306976+0000","last_fullsized":"2024-05-12T11:06:45.306976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:38:08.347801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307748+0000","last_change":"2024-05-12T11:06:02.155096+0000","last_active":"2024-05-12T11:06:45.307748+0000","last_peered":"2024-05-12T11:06:45.307748+0000","last_clean":"2024-05-12T11:06:45.307748+0000","last_became_active":"2024-05-12T11:06:02.154721+0000","last_became_peered":"2024-05-12T11:06:02.154721+0000","last_unstale":"2024-05-12T11:06:45.307748+0000","last_undegraded":"2024-05-12T11:06:45.307748+0000","last_fullsized":"2024-05-12T11:06:45.307748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:01.407453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351244+0000","last_change":"2024-05-12T11:06:05.170305+0000","last_active":"2024-05-12T11:06:45.351244+0000","last_peered":"2024-05-12T11:06:45.351244+0000","last_clean":"2024-05-12T11:06:45.351244+0000","last_became_active":"2024-05-12T11:06:05.169970+0000","last_became_peered":"2024-05-12T11:06:05.169970+0000","last_unstale":"2024-05-12T11:06:45.351244+0000","last_undegraded":"2024-05-12T11:06:45.351244+0000","last_fullsized":"2024-05-12T11:06:45.351244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:48:11.680873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:49.290708+0000","last_change":"2024-05-12T11:06:02.246541+0000","last_active":"2024-05-12T11:06:49.290708+0000","last_peered":"2024-05-12T11:06:49.290708+0000","last_clean":"2024-05-12T11:06:49.290708+0000","last_became_active":"2024-05-12T11:06:02.246071+0000","last_became_peered":"2024-05-12T11:06:02.246071+0000","last_unstale":"2024-05-12T11:06:49.290708+0000","last_undegraded":"2024-05-12T11:06:49.290708+0000","last_fullsized":"2024-05-12T11:06:49.290708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:27:16.649146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351417+0000","last_change":"2024-05-12T11:06:05.170566+0000","last_active":"2024-05-12T11:06:45.351417+0000","last_peered":"2024-05-12T11:06:45.351417+0000","last_clean":"2024-05-12T11:06:45.351417+0000","last_became_active":"2024-05-12T11:06:05.170225+0000","last_became_peered":"2024-05-12T11:06:05.170225+0000","last_unstale":"2024-05-12T11:06:45.351417+0000","last_undegraded":"2024-05-12T11:06:45.351417+0000","last_fullsized":"2024-05-12T11:06:45.351417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:42.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310170+0000","last_change":"2024-05-12T11:06:02.151920+0000","last_active":"2024-05-12T11:06:45.310170+0000","last_peered":"2024-05-12T11:06:45.310170+0000","last_clean":"2024-05-12T11:06:45.310170+0000","last_became_active":"2024-05-12T11:06:02.151551+0000","last_became_peered":"2024-05-12T11:06:02.151551+0000","last_unstale":"2024-05-12T11:06:45.310170+0000","last_undegraded":"2024-05-12T11:06:45.310170+0000","last_fullsized":"2024-05-12T11:06:45.310170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:11:10.230956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351219+0000","last_change":"2024-05-12T11:06:05.174964+0000","last_active":"2024-05-12T11:06:45.351219+0000","last_peered":"2024-05-12T11:06:45.351219+0000","last_clean":"2024-05-12T11:06:45.351219+0000","last_became_active":"2024-05-12T11:06:05.174562+0000","last_became_peered":"2024-05-12T11:06:05.174562+0000","last_unstale":"2024-05-12T11:06:45.351219+0000","last_undegraded":"2024-05-12T11:06:45.351219+0000","last_fullsized":"2024-05-12T11:06:45.351219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:37:22.252200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.319312+0000","last_change":"2024-05-12T11:06:45.319312+0000","last_active":"2024-05-12T11:06:45.319312+0000","last_peered":"2024-05-12T11:06:45.319312+0000","last_clean":"2024-05-12T11:06:45.319312+0000","last_became_active":"2024-05-12T11:06:45.310683+0000","last_became_peered":"2024-05-12T11:06:45.310683+0000","last_unstale":"2024-05-12T11:06:45.319312+0000","last_undegraded":"2024-05-12T11:06:45.319312+0000","last_fullsized":"2024-05-12T11:06:45.319312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:24:21.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351597+0000","last_change":"2024-05-12T11:06:05.176798+0000","last_active":"2024-05-12T11:06:45.351597+0000","last_peered":"2024-05-12T11:06:45.351597+0000","last_clean":"2024-05-12T11:06:45.351597+0000","last_became_active":"2024-05-12T11:06:05.176476+0000","last_became_peered":"2024-05-12T11:06:05.176476+0000","last_unstale":"2024-05-12T11:06:45.351597+0000","last_undegraded":"2024-05-12T11:06:45.351597+0000","last_fullsized":"2024-05-12T11:06:45.351597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:16.111038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.303794+0000","last_change":"2024-05-12T11:06:05.180278+0000","last_active":"2024-05-12T11:06:45.303794+0000","last_peered":"2024-05-12T11:06:45.303794+0000","last_clean":"2024-05-12T11:06:45.303794+0000","last_became_active":"2024-05-12T11:06:05.179863+0000","last_became_peered":"2024-05-12T11:06:05.179863+0000","last_unstale":"2024-05-12T11:06:45.303794+0000","last_undegraded":"2024-05-12T11:06:45.303794+0000","last_fullsized":"2024-05-12T11:06:45.303794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:13:32.588753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.499552+0000","last_change":"2024-05-12T11:06:45.499552+0000","last_active":"2024-05-12T11:06:45.499552+0000","last_peered":"2024-05-12T11:06:45.499552+0000","last_clean":"2024-05-12T11:06:45.499552+0000","last_became_active":"2024-05-12T11:06:45.499078+0000","last_became_peered":"2024-05-12T11:06:45.499078+0000","last_unstale":"2024-05-12T11:06:45.499552+0000","last_undegraded":"2024-05-12T11:06:45.499552+0000","last_fullsized":"2024-05-12T11:06:45.499552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:41:37.019535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306699+0000","last_change":"2024-05-12T11:06:05.172282+0000","last_active":"2024-05-12T11:06:45.306699+0000","last_peered":"2024-05-12T11:06:45.306699+0000","last_clean":"2024-05-12T11:06:45.306699+0000","last_became_active":"2024-05-12T11:06:05.171930+0000","last_became_peered":"2024-05-12T11:06:05.171930+0000","last_unstale":"2024-05-12T11:06:45.306699+0000","last_undegraded":"2024-05-12T11:06:45.306699+0000","last_fullsized":"2024-05-12T11:06:45.306699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:20:56.314181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.309794+0000","last_change":"2024-05-12T11:06:05.173726+0000","last_active":"2024-05-12T11:06:45.309794+0000","last_peered":"2024-05-12T11:06:45.309794+0000","last_clean":"2024-05-12T11:06:45.309794+0000","last_became_active":"2024-05-12T11:06:05.173195+0000","last_became_peered":"2024-05-12T11:06:05.173195+0000","last_unstale":"2024-05-12T11:06:45.309794+0000","last_undegraded":"2024-05-12T11:06:45.309794+0000","last_fullsized":"2024-05-12T11:06:45.309794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:19.397213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305881+0000","last_change":"2024-05-12T11:06:05.167841+0000","last_active":"2024-05-12T11:06:45.305881+0000","last_peered":"2024-05-12T11:06:45.305881+0000","last_clean":"2024-05-12T11:06:45.305881+0000","last_became_active":"2024-05-12T11:06:05.166577+0000","last_became_peered":"2024-05-12T11:06:05.166577+0000","last_unstale":"2024-05-12T11:06:45.305881+0000","last_undegraded":"2024-05-12T11:06:45.305881+0000","last_fullsized":"2024-05-12T11:06:45.305881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:01.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.303932+0000","last_change":"2024-05-12T11:06:05.170753+0000","last_active":"2024-05-12T11:06:45.303932+0000","last_peered":"2024-05-12T11:06:45.303932+0000","last_clean":"2024-05-12T11:06:45.303932+0000","last_became_active":"2024-05-12T11:06:05.169410+0000","last_became_peered":"2024-05-12T11:06:05.169410+0000","last_unstale":"2024-05-12T11:06:45.303932+0000","last_undegraded":"2024-05-12T11:06:45.303932+0000","last_fullsized":"2024-05-12T11:06:45.303932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:42:30.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306641+0000","last_change":"2024-05-12T11:06:05.170692+0000","last_active":"2024-05-12T11:06:45.306641+0000","last_peered":"2024-05-12T11:06:45.306641+0000","last_clean":"2024-05-12T11:06:45.306641+0000","last_became_active":"2024-05-12T11:06:05.170349+0000","last_became_peered":"2024-05-12T11:06:05.170349+0000","last_unstale":"2024-05-12T11:06:45.306641+0000","last_undegraded":"2024-05-12T11:06:45.306641+0000","last_fullsized":"2024-05-12T11:06:45.306641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:13:19.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307709+0000","last_change":"2024-05-12T11:06:05.173600+0000","last_active":"2024-05-12T11:06:45.307709+0000","last_peered":"2024-05-12T11:06:45.307709+0000","last_clean":"2024-05-12T11:06:45.307709+0000","last_became_active":"2024-05-12T11:06:05.173288+0000","last_became_peered":"2024-05-12T11:06:05.173288+0000","last_unstale":"2024-05-12T11:06:45.307709+0000","last_undegraded":"2024-05-12T11:06:45.307709+0000","last_fullsized":"2024-05-12T11:06:45.307709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:06:45.082031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306980+0000","last_change":"2024-05-12T11:06:05.169864+0000","last_active":"2024-05-12T11:06:45.306980+0000","last_peered":"2024-05-12T11:06:45.306980+0000","last_clean":"2024-05-12T11:06:45.306980+0000","last_became_active":"2024-05-12T11:06:05.169521+0000","last_became_peered":"2024-05-12T11:06:05.169521+0000","last_unstale":"2024-05-12T11:06:45.306980+0000","last_undegraded":"2024-05-12T11:06:45.306980+0000","last_fullsized":"2024-05-12T11:06:45.306980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.825436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306883+0000","last_change":"2024-05-12T11:06:05.176370+0000","last_active":"2024-05-12T11:06:45.306883+0000","last_peered":"2024-05-12T11:06:45.306883+0000","last_clean":"2024-05-12T11:06:45.306883+0000","last_became_active":"2024-05-12T11:06:05.176031+0000","last_became_peered":"2024-05-12T11:06:05.176031+0000","last_unstale":"2024-05-12T11:06:45.306883+0000","last_undegraded":"2024-05-12T11:06:45.306883+0000","last_fullsized":"2024-05-12T11:06:45.306883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:32:52.893909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306358+0000","last_change":"2024-05-12T11:06:05.170708+0000","last_active":"2024-05-12T11:06:45.306358+0000","last_peered":"2024-05-12T11:06:45.306358+0000","last_clean":"2024-05-12T11:06:45.306358+0000","last_became_active":"2024-05-12T11:06:05.169591+0000","last_became_peered":"2024-05-12T11:06:05.169591+0000","last_unstale":"2024-05-12T11:06:45.306358+0000","last_undegraded":"2024-05-12T11:06:45.306358+0000","last_fullsized":"2024-05-12T11:06:45.306358+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:08.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306329+0000","last_change":"2024-05-12T11:06:05.172614+0000","last_active":"2024-05-12T11:06:45.306329+0000","last_peered":"2024-05-12T11:06:45.306329+0000","last_clean":"2024-05-12T11:06:45.306329+0000","last_became_active":"2024-05-12T11:06:05.172290+0000","last_became_peered":"2024-05-12T11:06:05.172290+0000","last_unstale":"2024-05-12T11:06:45.306329+0000","last_undegraded":"2024-05-12T11:06:45.306329+0000","last_fullsized":"2024-05-12T11:06:45.306329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:32.169139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.303762+0000","last_change":"2024-05-12T11:06:05.171333+0000","last_active":"2024-05-12T11:06:45.303762+0000","last_peered":"2024-05-12T11:06:45.303762+0000","last_clean":"2024-05-12T11:06:45.303762+0000","last_became_active":"2024-05-12T11:06:05.170035+0000","last_became_peered":"2024-05-12T11:06:05.170035+0000","last_unstale":"2024-05-12T11:06:45.303762+0000","last_undegraded":"2024-05-12T11:06:45.303762+0000","last_fullsized":"2024-05-12T11:06:45.303762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:18.852851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280976,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68639,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":312,"num_read_kb":223,"num_write":245,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":199672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645337,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":434049,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841565,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1080077,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":433397,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201320,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":909312,"data_stored":433193,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397549,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":1026293,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561075,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":901120,"data_stored":433114,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":958464,"data_stored":489608,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":434453,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":496352,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149760,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":432939,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":909312,"data_stored":433087,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1025971,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T11:06:53.421 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-12T11:06:53.422 INFO:tasks.cephadm:Setting up client nodes... 2024-05-12T11:06:53.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-12T11:06:53.664 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:53.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:53 smithi172 ceph-mon[34517]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:53.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:53 smithi172 ceph-mon[34517]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:06:53.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:53 smithi176 ceph-mon[34357]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s; 86 B/s, 1 objects/s recovering 2024-05-12T11:06:53.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:53 smithi176 ceph-mon[34357]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:06:55.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 -- 172.21.15.86:0/1651049232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a18104720 msgr2=0x7f0a18104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:55.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/1651049232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a18104720 0x7f0a18104b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a080099c0 tx=0x7f0a08009cd0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 -- 172.21.15.86:0/1651049232 shutdown_connections 2024-05-12T11:06:55.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/1651049232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a181050c0 0x7f0a1810b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/1651049232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a18103520 0x7f0a18103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/1651049232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a18104720 0x7f0a18104b80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 -- 172.21.15.86:0/1651049232 >> 172.21.15.86:0/1651049232 conn(0x7f0a180feac0 msgr2=0x7f0a18100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:55.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 -- 172.21.15.86:0/1651049232 shutdown_connections 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.377+0000 7f0a1ed61700 1 -- 172.21.15.86:0/1651049232 wait complete. 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1ed61700 1 Processor -- start 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1ed61700 1 -- start start 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1ed61700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a18103520 0x7f0a181995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1ed61700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a18104720 0x7f0a18199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1ed61700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a181050c0 0x7f0a181a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1ed61700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1810efc0 con 0x7f0a181050c0 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1ed61700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1810ee40 con 0x7f0a18104720 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1ed61700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1810f140 con 0x7f0a18103520 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1d2fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a181050c0 0x7f0a181a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1d2fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a181050c0 0x7f0a181a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49888/0 (socket says 172.21.15.86:49888) 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1d2fe700 1 -- 172.21.15.86:0/846133305 learned_addr learned my addr 172.21.15.86:0/846133305 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1cafd700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a18103520 0x7f0a181995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a0ffff700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a18104720 0x7f0a18199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1d2fe700 1 -- 172.21.15.86:0/846133305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a18103520 msgr2=0x7f0a181995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:55.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1d2fe700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a18103520 0x7f0a181995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1d2fe700 1 -- 172.21.15.86:0/846133305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a18104720 msgr2=0x7f0a18199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:55.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1d2fe700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a18104720 0x7f0a18199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a1d2fe700 1 -- 172.21.15.86:0/846133305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a181a1230 con 0x7f0a181050c0 2024-05-12T11:06:55.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.378+0000 7f0a0ffff700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a18104720 0x7f0a18199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:06:55.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.379+0000 7f0a1d2fe700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a181050c0 0x7f0a181a0b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007f10 tx=0x7f0a1000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:55.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.379+0000 7f0a0dffb700 1 -- 172.21.15.86:0/846133305 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000ddd0 con 0x7f0a181050c0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.379+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a181a1520 con 0x7f0a181050c0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.379+0000 7f0a0dffb700 1 -- 172.21.15.86:0/846133305 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a10004020 con 0x7f0a181050c0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.379+0000 7f0a0dffb700 1 -- 172.21.15.86:0/846133305 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10015660 con 0x7f0a181050c0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.379+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a181a1a60 con 0x7f0a181050c0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.380+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a180519e0 con 0x7f0a181050c0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.381+0000 7f0a0dffb700 1 -- 172.21.15.86:0/846133305 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0a100044f0 con 0x7f0a181050c0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.382+0000 7f0a0dffb700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0a000b29b0 0x7f0a000b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.382+0000 7f0a1cafd700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0a000b29b0 0x7f0a000b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.382+0000 7f0a0dffb700 1 -- 172.21.15.86:0/846133305 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0a100e25b0 con 0x7f0a181050c0 2024-05-12T11:06:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.382+0000 7f0a1cafd700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0a000b29b0 0x7f0a000b4e70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0a14005950 tx=0x7f0a1400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:55.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.385+0000 7f0a0dffb700 1 -- 172.21.15.86:0/846133305 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0a10010070 con 0x7f0a181050c0 2024-05-12T11:06:55.376 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:55 smithi086 ceph-mon[30110]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s; 70 B/s, 1 objects/s recovering 2024-05-12T11:06:55.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.672+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f0a180640b0 con 0x7f0a181050c0 2024-05-12T11:06:55.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.675+0000 7f0a0dffb700 1 -- 172.21.15.86:0/846133305 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f0a100aa150 con 0x7f0a181050c0 2024-05-12T11:06:55.666 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-05-12T11:06:55.666 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDPokBmH0QuKBAArqAaBV9dncsKREB69TuO6w== 2024-05-12T11:06:55.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0a000b29b0 msgr2=0x7f0a000b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:55.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0a000b29b0 0x7f0a000b4e70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0a14005950 tx=0x7f0a1400a300 comp rx=0 tx=0).stop 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a181050c0 msgr2=0x7f0a181a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a181050c0 0x7f0a181a0b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007f10 tx=0x7f0a1000d3b0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 shutdown_connections 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0a000b29b0 0x7f0a000b4e70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a181050c0 0x7f0a181a0b90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a18103520 0x7f0a181995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 --2- 172.21.15.86:0/846133305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a18104720 0x7f0a18199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.677+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 >> 172.21.15.86:0/846133305 conn(0x7f0a180feac0 msgr2=0x7f0a18107a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.678+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 shutdown_connections 2024-05-12T11:06:55.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:55.678+0000 7f0a1ed61700 1 -- 172.21.15.86:0/846133305 wait complete. 2024-05-12T11:06:55.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:55 smithi172 ceph-mon[34517]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s; 70 B/s, 1 objects/s recovering 2024-05-12T11:06:55.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:55 smithi176 ceph-mon[34357]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s; 70 B/s, 1 objects/s recovering 2024-05-12T11:06:56.379 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T11:06:56.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-12T11:06:56.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-12T11:06:56.417 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-12T11:06:56.417 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-12T11:06:56.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph mgr dump --format=json 2024-05-12T11:06:56.699 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:06:56.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:56 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/846133305' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-12T11:06:56.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:56 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/846133305' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-12T11:06:56.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:56 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/846133305' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-12T11:06:56.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:56 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/846133305' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-12T11:06:56.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:56 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/846133305' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-12T11:06:56.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:56 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/846133305' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-12T11:06:57.776 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:57 smithi086 ceph-mon[30110]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 665 B/s wr, 10 op/s; 64 B/s, 1 objects/s recovering 2024-05-12T11:06:57.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:57 smithi172 ceph-mon[34517]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 665 B/s wr, 10 op/s; 64 B/s, 1 objects/s recovering 2024-05-12T11:06:58.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:57 smithi176 ceph-mon[34357]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 665 B/s wr, 10 op/s; 64 B/s, 1 objects/s recovering 2024-05-12T11:06:58.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/3474881360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103520 msgr2=0x7f2a281039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:58.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/3474881360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103520 0x7f2a281039a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009990 tx=0x7f2a1c009ca0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/3474881360 shutdown_connections 2024-05-12T11:06:58.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/3474881360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a28103ee0 0x7f2a28110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/3474881360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a28109530 0x7f2a28109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/3474881360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103520 0x7f2a281039a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/3474881360 >> 172.21.15.86:0/3474881360 conn(0x7f2a2807a570 msgr2=0x7f2a2807a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:58.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/3474881360 shutdown_connections 2024-05-12T11:06:58.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.340+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/3474881360 wait complete. 2024-05-12T11:06:58.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.341+0000 7f2a2e8ec700 1 Processor -- start 2024-05-12T11:06:58.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.341+0000 7f2a2e8ec700 1 -- start start 2024-05-12T11:06:58.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.341+0000 7f2a2e8ec700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a28103520 0x7f2a281a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:58.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a2e8ec700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103ee0 0x7f2a281a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:58.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a277fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103ee0 0x7f2a281a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:58.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a2e8ec700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a28109530 0x7f2a2819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:58.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a2e8ec700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28113690 con 0x7f2a28103ee0 2024-05-12T11:06:58.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a2e8ec700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28113510 con 0x7f2a28103520 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a277fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103ee0 0x7f2a281a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49904/0 (socket says 172.21.15.86:49904) 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a2e8ec700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28113810 con 0x7f2a28109530 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a277fe700 1 -- 172.21.15.86:0/1266787632 learned_addr learned my addr 172.21.15.86:0/1266787632 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a27fff700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a28103520 0x7f2a281a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a2ce89700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a28109530 0x7f2a2819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a27fff700 1 -- 172.21.15.86:0/1266787632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a28109530 msgr2=0x7f2a2819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a27fff700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a28109530 0x7f2a2819bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a27fff700 1 -- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103ee0 msgr2=0x7f2a281a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a27fff700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103ee0 0x7f2a281a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a27fff700 1 -- 172.21.15.86:0/1266787632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2819c410 con 0x7f2a28103520 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a27fff700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a28103520 0x7f2a281a1a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800e9f0 tx=0x7f2a1800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.342+0000 7f2a257fa700 1 -- 172.21.15.86:0/1266787632 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18004220 con 0x7f2a28103520 2024-05-12T11:06:58.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.343+0000 7f2a257fa700 1 -- 172.21.15.86:0/1266787632 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a180043c0 con 0x7f2a28103520 2024-05-12T11:06:58.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.343+0000 7f2a257fa700 1 -- 172.21.15.86:0/1266787632 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18005020 con 0x7f2a28103520 2024-05-12T11:06:58.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.343+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2819c700 con 0x7f2a28103520 2024-05-12T11:06:58.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.343+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a281a89e0 con 0x7f2a28103520 2024-05-12T11:06:58.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.344+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a28104c10 con 0x7f2a28103520 2024-05-12T11:06:58.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.345+0000 7f2a257fa700 1 -- 172.21.15.86:0/1266787632 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2a18004750 con 0x7f2a28103520 2024-05-12T11:06:58.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.346+0000 7f2a257fa700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a100b2990 0x7f2a100b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:06:58.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.346+0000 7f2a277fe700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a100b2990 0x7f2a100b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:06:58.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.346+0000 7f2a257fa700 1 -- 172.21.15.86:0/1266787632 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2a180e2330 con 0x7f2a28103520 2024-05-12T11:06:58.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.346+0000 7f2a277fe700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a100b2990 0x7f2a100b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2a2819d280 tx=0x7f2a1c009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:06:58.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.351+0000 7f2a257fa700 1 -- 172.21.15.86:0/1266787632 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2a180a9e70 con 0x7f2a28103520 2024-05-12T11:06:58.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.617+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2a281a8bb0 con 0x7f2a28103520 2024-05-12T11:06:58.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.624+0000 7f2a257fa700 1 -- 172.21.15.86:0/1266787632 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288644 (secure 0 0 0) 0x7f2a180a9770 con 0x7f2a28103520 2024-05-12T11:06:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:06:58.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.628+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a100b2990 msgr2=0x7f2a100b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:58.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.628+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a100b2990 0x7f2a100b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2a2819d280 tx=0x7f2a1c009510 comp rx=0 tx=0).stop 2024-05-12T11:06:58.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.628+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a28103520 msgr2=0x7f2a281a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:06:58.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.628+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a28103520 0x7f2a281a1a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800e9f0 tx=0x7f2a1800ed00 comp rx=0 tx=0).stop 2024-05-12T11:06:58.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.629+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 shutdown_connections 2024-05-12T11:06:58.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.629+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f2a100b2990 0x7f2a100b4e50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.629+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a28109530 0x7f2a2819bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.629+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a28103520 0x7f2a281a1a60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.629+0000 7f2a2e8ec700 1 --2- 172.21.15.86:0/1266787632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a28103ee0 0x7f2a281a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:06:58.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.629+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 >> 172.21.15.86:0/1266787632 conn(0x7f2a2807a570 msgr2=0x7f2a28075960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:06:58.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.629+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 shutdown_connections 2024-05-12T11:06:58.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:06:58.629+0000 7f2a2e8ec700 1 -- 172.21.15.86:0/1266787632 wait complete. 2024-05-12T11:06:58.941 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:58 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:06:58.941 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:58 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1266787632' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-12T11:06:58.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:58 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:06:58.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:58 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1266787632' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-12T11:06:59.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:58 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:06:59.017 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:58 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1266787632' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-12T11:06:59.324 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":155657181},{"type":"v1","addr":"172.21.15.86:6801","nonce":155657181}]},"active_addr":"172.21.15.86:6801/155657181","active_change":"2024-05-12T10:58:43.982172+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.86:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2138389102}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3505671883}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":4229502845}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2852030835}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2645868054}]}]} 2024-05-12T11:06:59.332 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-12T11:06:59.332 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-12T11:06:59.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:06:59.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:06:59 smithi086 ceph-mon[30110]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s; 57 B/s, 1 objects/s recovering 2024-05-12T11:06:59.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:06:59 smithi172 ceph-mon[34517]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s; 57 B/s, 1 objects/s recovering 2024-05-12T11:07:00.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:06:59 smithi176 ceph-mon[34357]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s; 57 B/s, 1 objects/s recovering 2024-05-12T11:07:00.172 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:00.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:00.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:00.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:00.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:00 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:00 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:00 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 -- 172.21.15.86:0/448823605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 msgr2=0x7f3290102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 --2- 172.21.15.86:0/448823605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 0x7f3290102a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32800099c0 tx=0x7f3280009cd0 comp rx=0 tx=0).stop 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 -- 172.21.15.86:0/448823605 shutdown_connections 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 --2- 172.21.15.86:0/448823605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32901076e0 0x7f329010f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 --2- 172.21.15.86:0/448823605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 0x7f3290102a70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 --2- 172.21.15.86:0/448823605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3290103040 0x7f3290107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 -- 172.21.15.86:0/448823605 >> 172.21.15.86:0/448823605 conn(0x7f32900783f0 msgr2=0x7f3290078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 -- 172.21.15.86:0/448823605 shutdown_connections 2024-05-12T11:07:01.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 -- 172.21.15.86:0/448823605 wait complete. 2024-05-12T11:07:01.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 Processor -- start 2024-05-12T11:07:01.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.852+0000 7f32965e3700 1 -- start start 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f32965e3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 0x7f329019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f32965e3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3290103040 0x7f329019af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f32965e3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32901076e0 0x7f32901a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f32965e3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32901125f0 con 0x7f3290102690 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f32965e3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112470 con 0x7f32901076e0 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f32965e3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112770 con 0x7f3290103040 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 0x7f329019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 0x7f329019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51902/0 (socket says 172.21.15.86:51902) 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 -- 172.21.15.86:0/4003582612 learned_addr learned my addr 172.21.15.86:0/4003582612 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f3294b80700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32901076e0 0x7f32901a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328f7fe700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3290103040 0x7f329019af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:01.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 -- 172.21.15.86:0/4003582612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3290103040 msgr2=0x7f329019af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3290103040 0x7f329019af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 -- 172.21.15.86:0/4003582612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32901076e0 msgr2=0x7f32901a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32901076e0 0x7f32901a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 -- 172.21.15.86:0/4003582612 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32901a5fb0 con 0x7f3290102690 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.853+0000 7f328ffff700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 0x7f329019a9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f328000b580 tx=0x7f32800047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.854+0000 7f328d7fa700 1 -- 172.21.15.86:0/4003582612 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280027070 con 0x7f3290102690 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.854+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32901a6180 con 0x7f3290102690 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.854+0000 7f328d7fa700 1 -- 172.21.15.86:0/4003582612 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32800040a0 con 0x7f3290102690 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.854+0000 7f328d7fa700 1 -- 172.21.15.86:0/4003582612 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328000f460 con 0x7f3290102690 2024-05-12T11:07:01.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.854+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32901a6630 con 0x7f3290102690 2024-05-12T11:07:01.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.855+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329006a190 con 0x7f3290102690 2024-05-12T11:07:01.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.856+0000 7f328d7fa700 1 -- 172.21.15.86:0/4003582612 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f328002a070 con 0x7f3290102690 2024-05-12T11:07:01.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.856+0000 7f328d7fa700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32780b2910 0x7f32780b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:01.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.857+0000 7f328f7fe700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32780b2910 0x7f32780b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:01.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.857+0000 7f328d7fa700 1 -- 172.21.15.86:0/4003582612 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f32800e3840 con 0x7f3290102690 2024-05-12T11:07:01.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.857+0000 7f328f7fe700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32780b2910 0x7f32780b4dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3284006fd0 tx=0x7f3284008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:01.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:01.860+0000 7f328d7fa700 1 -- 172.21.15.86:0/4003582612 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3280031070 con 0x7f3290102690 2024-05-12T11:07:01.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:01 smithi086 ceph-mon[30110]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-12T11:07:02.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.074+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f329002e510 con 0x7f3290102690 2024-05-12T11:07:02.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.075+0000 7f328d7fa700 1 -- 172.21.15.86:0/4003582612 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22746 (secure 0 0 0) 0x7f3280013070 con 0x7f3290102690 2024-05-12T11:07:02.067 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:07:02.067 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:06:45.299850+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:07:02.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32780b2910 msgr2=0x7f32780b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:02.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32780b2910 0x7f32780b4dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3284006fd0 tx=0x7f3284008040 comp rx=0 tx=0).stop 2024-05-12T11:07:02.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 msgr2=0x7f329019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:02.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 0x7f329019a9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f328000b580 tx=0x7f32800047b0 comp rx=0 tx=0).stop 2024-05-12T11:07:02.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 shutdown_connections 2024-05-12T11:07:02.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32780b2910 0x7f32780b4dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:02.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32901076e0 0x7f32901a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:02.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3290102690 0x7f329019a9f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:02.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 --2- 172.21.15.86:0/4003582612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3290103040 0x7f329019af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:02.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 >> 172.21.15.86:0/4003582612 conn(0x7f32900783f0 msgr2=0x7f3290106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:02.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 shutdown_connections 2024-05-12T11:07:02.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:02.078+0000 7f32965e3700 1 -- 172.21.15.86:0/4003582612 wait complete. 2024-05-12T11:07:02.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:01 smithi172 ceph-mon[34517]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-12T11:07:02.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:01 smithi176 ceph-mon[34357]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-12T11:07:02.799 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-12T11:07:02.800 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:07:03.077 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:03.199 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:02 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4003582612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:07:03.199 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:03.200 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:02 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:03.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:02 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4003582612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:07:03.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:03.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:02 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:03.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:02 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4003582612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:07:03.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:03.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:02 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:04.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:03 smithi086 ceph-mon[30110]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-12T11:07:04.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:07:04.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:07:04.213 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:03 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:04.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:03 smithi172 ceph-mon[34517]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-12T11:07:04.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:07:04.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:07:04.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:03 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:04.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:03 smithi176 ceph-mon[34357]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-12T11:07:04.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:07:04.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:07:04.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:03 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.768+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/3001161431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec01029e0 msgr2=0x7f1ec0102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.768+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/3001161431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec01029e0 0x7f1ec0102dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc0099c0 tx=0x7f1ebc009cd0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/3001161431 shutdown_connections 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/3001161431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec0107730 0x7f1ec010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/3001161431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec01029e0 0x7f1ec0102dc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/3001161431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ec0103390 0x7f1ec0107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/3001161431 >> 172.21.15.86:0/3001161431 conn(0x7f1ec0079350 msgr2=0x7f1ec0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/3001161431 shutdown_connections 2024-05-12T11:07:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/3001161431 wait complete. 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 Processor -- start 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 -- start start 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ec01029e0 0x7f1ec019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec0103390 0x7f1ec019af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0107730 0x7f1ec01a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0112610 con 0x7f1ec0107730 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0112490 con 0x7f1ec0103390 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.769+0000 7f1ec7ae9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0112790 con 0x7f1ec01029e0 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0107730 0x7f1ec01a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0107730 0x7f1ec01a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51924/0 (socket says 172.21.15.86:51924) 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 -- 172.21.15.86:0/2115742573 learned_addr learned my addr 172.21.15.86:0/2115742573 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec5885700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ec01029e0 0x7f1ec019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec5084700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec0103390 0x7f1ec019af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 -- 172.21.15.86:0/2115742573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ec01029e0 msgr2=0x7f1ec019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ec01029e0 0x7f1ec019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 -- 172.21.15.86:0/2115742573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec0103390 msgr2=0x7f1ec019af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec0103390 0x7f1ec019af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 -- 172.21.15.86:0/2115742573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec01a5fd0 con 0x7f1ec0107730 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec6086700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0107730 0x7f1ec01a5a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800b970 tx=0x7f1eb800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1eb6ffd700 1 -- 172.21.15.86:0/2115742573 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8019070 con 0x7f1ec0107730 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1eb6ffd700 1 -- 172.21.15.86:0/2115742573 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb800cde0 con 0x7f1ec0107730 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec01a6200 con 0x7f1ec0107730 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1eb6ffd700 1 -- 172.21.15.86:0/2115742573 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8007370 con 0x7f1ec0107730 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.770+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec01a66f0 con 0x7f1ec0107730 2024-05-12T11:07:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.771+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec010a920 con 0x7f1ec0107730 2024-05-12T11:07:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.773+0000 7f1eb6ffd700 1 -- 172.21.15.86:0/2115742573 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1eb801c070 con 0x7f1ec0107730 2024-05-12T11:07:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.774+0000 7f1eb6ffd700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1eac0b2910 0x7f1eac0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.774+0000 7f1ec5885700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1eac0b2910 0x7f1eac0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.774+0000 7f1eb6ffd700 1 -- 172.21.15.86:0/2115742573 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1eb80e1f10 con 0x7f1ec0107730 2024-05-12T11:07:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.775+0000 7f1ec5885700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1eac0b2910 0x7f1eac0b4dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009990 tx=0x7f1ebc009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:04.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.778+0000 7f1eb6ffd700 1 -- 172.21.15.86:0/2115742573 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1eb8023070 con 0x7f1ec0107730 2024-05-12T11:07:04.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.980+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ec010a300 con 0x7f1ec0107730 2024-05-12T11:07:04.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.981+0000 7f1eb6ffd700 1 -- 172.21.15.86:0/2115742573 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22746 (secure 0 0 0) 0x7f1eb80a9bc0 con 0x7f1ec0107730 2024-05-12T11:07:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:07:04.973 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:06:45.299850+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1eac0b2910 msgr2=0x7f1eac0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1eac0b2910 0x7f1eac0b4dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009990 tx=0x7f1ebc009650 comp rx=0 tx=0).stop 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0107730 msgr2=0x7f1ec01a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0107730 0x7f1ec01a5a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800b970 tx=0x7f1eb800bc80 comp rx=0 tx=0).stop 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 shutdown_connections 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1eac0b2910 0x7f1eac0b4dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec0107730 0x7f1ec01a5a90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ec01029e0 0x7f1ec019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 --2- 172.21.15.86:0/2115742573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec0103390 0x7f1ec019af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 >> 172.21.15.86:0/2115742573 conn(0x7f1ec0079350 msgr2=0x7f1ec0100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:04.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 shutdown_connections 2024-05-12T11:07:04.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:04.984+0000 7f1ec7ae9700 1 -- 172.21.15.86:0/2115742573 wait complete. 2024-05-12T11:07:05.658 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-12T11:07:05.658 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-12T11:07:05.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-12T11:07:05.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-12T11:07:05.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-12T11:07:05.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-12T11:07:05.661 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-12T11:07:05.661 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-12T11:07:05.661 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-12T11:07:05.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-12T11:07:05.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-12T11:07:05.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-12T11:07:05.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:05 smithi086 ceph-mon[30110]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-12T11:07:05.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:05 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2115742573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:07:06.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:05 smithi172 ceph-mon[34517]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-12T11:07:06.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:05 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2115742573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:07:06.253 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:06.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:05 smithi176 ceph-mon[34357]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-12T11:07:06.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:05 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2115742573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:07:06.295 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:07.765 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:07.766 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:07.766 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:07.894 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:08.184 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:07 smithi086 ceph-mon[30110]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-05-12T11:07:08.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:07 smithi172 ceph-mon[34517]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-05-12T11:07:08.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:07 smithi176 ceph-mon[34357]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-05-12T11:07:08.629 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:10.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:09 smithi086 ceph-mon[30110]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:10.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:09 smithi172 ceph-mon[34517]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:10.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:09 smithi176 ceph-mon[34357]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 -- 172.21.15.86:0/652861454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66141023a0 msgr2=0x7f6614102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 --2- 172.21.15.86:0/652861454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66141023a0 0x7f6614102820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6600009990 tx=0x7f6600009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 -- 172.21.15.86:0/652861454 shutdown_connections 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 --2- 172.21.15.86:0/652861454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6614102d60 0x7f661410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 --2- 172.21.15.86:0/652861454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6614108410 0x7f66141087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 --2- 172.21.15.86:0/652861454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66141023a0 0x7f6614102820 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 -- 172.21.15.86:0/652861454 >> 172.21.15.86:0/652861454 conn(0x7f6614079350 msgr2=0x7f6614079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 -- 172.21.15.86:0/652861454 shutdown_connections 2024-05-12T11:07:11.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.366+0000 7f661ab91700 1 -- 172.21.15.86:0/652861454 wait complete. 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f661ab91700 1 Processor -- start 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f661ab91700 1 -- start start 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f661ab91700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66141023a0 0x7f661419e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f661ab91700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6614102d60 0x7f661419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f661ab91700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6614108410 0x7f66141988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f661ab91700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f66141125b0 con 0x7f6614102d60 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f661ab91700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6614112430 con 0x7f66141023a0 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f661ab91700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6614112730 con 0x7f6614108410 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f6613fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6614102d60 0x7f661419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f6613fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6614102d60 0x7f661419ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51932/0 (socket says 172.21.15.86:51932) 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.367+0000 7f6613fff700 1 -- 172.21.15.86:0/1117467291 learned_addr learned my addr 172.21.15.86:0/1117467291 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f661912e700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6614108410 0x7f66141988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:11.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6613fff700 1 -- 172.21.15.86:0/1117467291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6614108410 msgr2=0x7f66141988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f661892d700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66141023a0 0x7f661419e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6613fff700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6614108410 0x7f66141988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6613fff700 1 -- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66141023a0 msgr2=0x7f661419e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6613fff700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66141023a0 0x7f661419e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6613fff700 1 -- 172.21.15.86:0/1117467291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6614199030 con 0x7f6614102d60 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f661892d700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66141023a0 0x7f661419e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6613fff700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6614102d60 0x7f661419ec50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f66000057f0 tx=0x7f6600003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600027070 con 0x7f6614102d60 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66000041c0 con 0x7f6614102d60 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66141992c0 con 0x7f6614102d60 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600022e60 con 0x7f6614102d60 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.368+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661406b180 con 0x7f6614102d60 2024-05-12T11:07:11.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.369+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f661406b6b0 con 0x7f6614102d60 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.370+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f660002a070 con 0x7f6614102d60 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.371+0000 7f6611ffb700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f66040b2910 0x7f66040b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.371+0000 7f661892d700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f66040b2910 0x7f66040b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.371+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f66000e3960 con 0x7f6614102d60 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.371+0000 7f6611ffb700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] conn(0x7f66040bc550 0x7f66040be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.371+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 --> [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66040bf0c0 con 0x7f66040bc550 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.371+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f66000e3db0 con 0x7f6614102d60 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.372+0000 7f661892d700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f66040b2910 0x7f66040b4dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6608005fd0 tx=0x7f6608005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.372+0000 7f661912e700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] conn(0x7f66040bc550 0x7f66040be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:11.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.372+0000 7f661912e700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] conn(0x7f66040bc550 0x7f66040be9f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:11.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.373+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 <== osd.7 v2:172.21.15.172:6816/183030662 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66040bf0c0 con 0x7f66040bc550 2024-05-12T11:07:11.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.389+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 --> [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f661406bb30 con 0x7f66040bc550 2024-05-12T11:07:11.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.390+0000 7f6611ffb700 1 -- 172.21.15.86:0/1117467291 <== osd.7 v2:172.21.15.172:6816/183030662 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f661406bb30 con 0x7f66040bc550 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.390+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] conn(0x7f66040bc550 msgr2=0x7f66040be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.390+0000 7f661ab91700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] conn(0x7f66040bc550 0x7f66040be9f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f66040b2910 msgr2=0x7f66040b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661ab91700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f66040b2910 0x7f66040b4dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6608005fd0 tx=0x7f6608005e40 comp rx=0 tx=0).stop 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6614102d60 msgr2=0x7f661419ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661ab91700 1 --2- 172.21.15.86:0/1117467291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6614102d60 0x7f661419ec50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f66000057f0 tx=0x7f6600003730 comp rx=0 tx=0).stop 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661912e700 1 -- 172.21.15.86:0/1117467291 reap_dead start 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 shutdown_connections 2024-05-12T11:07:11.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 >> 172.21.15.86:0/1117467291 conn(0x7f6614079350 msgr2=0x7f6614100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:11.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 shutdown_connections 2024-05-12T11:07:11.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.391+0000 7f661ab91700 1 -- 172.21.15.86:0/1117467291 wait complete. 2024-05-12T11:07:12.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:11 smithi086 ceph-mon[30110]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:12.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:11 smithi172 ceph-mon[34517]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:12.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:11 smithi176 ceph-mon[34357]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:12.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 -- 172.21.15.86:0/4279159697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c1023d0 msgr2=0x7fb00c102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:12.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 --2- 172.21.15.86:0/4279159697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c1023d0 0x7fb00c102850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faffc009990 tx=0x7faffc009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 -- 172.21.15.86:0/4279159697 shutdown_connections 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 --2- 172.21.15.86:0/4279159697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb00c102d90 0x7fb00c10f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 --2- 172.21.15.86:0/4279159697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb00c108440 0x7fb00c108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 --2- 172.21.15.86:0/4279159697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c1023d0 0x7fb00c102850 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 -- 172.21.15.86:0/4279159697 >> 172.21.15.86:0/4279159697 conn(0x7fb00c0793e0 msgr2=0x7fb00c0797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 -- 172.21.15.86:0/4279159697 shutdown_connections 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.846+0000 7fb013418700 1 -- 172.21.15.86:0/4279159697 wait complete. 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb013418700 1 Processor -- start 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb013418700 1 -- start start 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb013418700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb00c1023d0 0x7fb00c19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:12.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb013418700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c102d90 0x7fb00c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb013418700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb00c108440 0x7fb00c199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb013418700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c112560 con 0x7fb00c102d90 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb013418700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c1123e0 con 0x7fb00c108440 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb013418700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c1126e0 con 0x7fb00c1023d0 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0109b3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c102d90 0x7fb00c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0109b3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c102d90 0x7fb00c19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55372/0 (socket says 172.21.15.86:55372) 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0109b3700 1 -- 172.21.15.86:0/2810776483 learned_addr learned my addr 172.21.15.86:0/2810776483 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0119b5700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb00c108440 0x7fb00c199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0111b4700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb00c1023d0 0x7fb00c19f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0109b3700 1 -- 172.21.15.86:0/2810776483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb00c1023d0 msgr2=0x7fb00c19f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0109b3700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb00c1023d0 0x7fb00c19f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0109b3700 1 -- 172.21.15.86:0/2810776483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb00c108440 msgr2=0x7fb00c199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0109b3700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb00c108440 0x7fb00c199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.847+0000 7fb0109b3700 1 -- 172.21.15.86:0/2810776483 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c19a0b0 con 0x7fb00c102d90 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.848+0000 7fb0109b3700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c102d90 0x7fb00c19fcd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faffc0057c0 tx=0x7faffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.848+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc027070 con 0x7fb00c102d90 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.848+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00c19a340 con 0x7fb00c102d90 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.848+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faffc003f20 con 0x7fb00c102d90 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.848+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc022bc0 con 0x7fb00c102d90 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.848+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00c1a6660 con 0x7fb00c102d90 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.849+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb00c106540 con 0x7fb00c102d90 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.850+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7faffc02a070 con 0x7fb00c102d90 2024-05-12T11:07:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.851+0000 7fb0027fc700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faff80b2910 0x7faff80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.851+0000 7fb0111b4700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faff80b2910 0x7faff80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.851+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7faffc0e3e30 con 0x7fb00c102d90 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.851+0000 7fb0027fc700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] conn(0x7faff80bc550 0x7faff80be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.851+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 --> [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faffc004e70 con 0x7faff80bc550 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.851+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7faffc0e4280 con 0x7fb00c102d90 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.851+0000 7fb0111b4700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faff80b2910 0x7faff80b4dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb008005fd0 tx=0x7fb00800af00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.852+0000 7fb0119b5700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] conn(0x7faff80bc550 0x7faff80be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.852+0000 7fb0119b5700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] conn(0x7faff80bc550 0x7faff80be9f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.853+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 <== osd.4 v2:172.21.15.172:6808/3299166420 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faffc004e70 con 0x7faff80bc550 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.871+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 --> [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb00c103af0 con 0x7faff80bc550 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.871+0000 7fb0027fc700 1 -- 172.21.15.86:0/2810776483 <== osd.4 v2:172.21.15.172:6808/3299166420 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb00c103af0 con 0x7faff80bc550 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.871+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 >> [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] conn(0x7faff80bc550 msgr2=0x7faff80be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.871+0000 7fb013418700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] conn(0x7faff80bc550 0x7faff80be9f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faff80b2910 msgr2=0x7faff80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb013418700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7faff80b2910 0x7faff80b4dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb008005fd0 tx=0x7fb00800af00 comp rx=0 tx=0).stop 2024-05-12T11:07:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c102d90 msgr2=0x7fb00c19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb013418700 1 --2- 172.21.15.86:0/2810776483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c102d90 0x7fb00c19fcd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faffc0057c0 tx=0x7faffc0057f0 comp rx=0 tx=0).stop 2024-05-12T11:07:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb0119b5700 1 -- 172.21.15.86:0/2810776483 reap_dead start 2024-05-12T11:07:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 shutdown_connections 2024-05-12T11:07:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 >> 172.21.15.86:0/2810776483 conn(0x7fb00c0793e0 msgr2=0x7fb00c101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 shutdown_connections 2024-05-12T11:07:12.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:11.872+0000 7fb013418700 1 -- 172.21.15.86:0/2810776483 wait complete. 2024-05-12T11:07:14.125 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:13 smithi086 ceph-mon[30110]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-12T11:07:14.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:13 smithi172 ceph-mon[34517]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-12T11:07:14.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:13 smithi176 ceph-mon[34357]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-12T11:07:15.562 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:16.037 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:16.067 INFO:teuthology.orchestra.run.smithi086.stdout:137438953538 2024-05-12T11:07:16.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-12T11:07:16.165 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:15 smithi086 ceph-mon[30110]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:16.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:15 smithi172 ceph-mon[34517]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:16.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:15 smithi176 ceph-mon[34357]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:17.556 INFO:teuthology.orchestra.run.smithi086.stdout:210453397554 2024-05-12T11:07:17.557 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-12T11:07:18.037 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:17 smithi086 ceph-mon[30110]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:18.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:17 smithi172 ceph-mon[34517]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:18.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:17 smithi176 ceph-mon[34357]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 -- 172.21.15.86:0/2213241588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18102800 msgr2=0x7f5e18110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 --2- 172.21.15.86:0/2213241588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18102800 0x7f5e18110270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009990 tx=0x7f5e10009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 -- 172.21.15.86:0/2213241588 shutdown_connections 2024-05-12T11:07:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 --2- 172.21.15.86:0/2213241588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18102800 0x7f5e18110270 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 --2- 172.21.15.86:0/2213241588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e18108560 0x7f5e18108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 --2- 172.21.15.86:0/2213241588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e18101e40 0x7f5e181022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 -- 172.21.15.86:0/2213241588 >> 172.21.15.86:0/2213241588 conn(0x7f5e180776c0 msgr2=0x7f5e18077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 -- 172.21.15.86:0/2213241588 shutdown_connections 2024-05-12T11:07:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.961+0000 7f5e2078f700 1 -- 172.21.15.86:0/2213241588 wait complete. 2024-05-12T11:07:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.962+0000 7f5e2078f700 1 Processor -- start 2024-05-12T11:07:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.962+0000 7f5e2078f700 1 -- start start 2024-05-12T11:07:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.962+0000 7f5e2078f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e18101e40 0x7f5e1810f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.962+0000 7f5e2078f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e18102800 0x7f5e1810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.962+0000 7f5e2078f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18108560 0x7f5e181a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.962+0000 7f5e2078f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5e181136f0 con 0x7f5e18108560 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.962+0000 7f5e2078f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5e18113570 con 0x7f5e18102800 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.962+0000 7f5e2078f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e18113870 con 0x7f5e18101e40 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18108560 0x7f5e181a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18108560 0x7f5e181a4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55384/0 (socket says 172.21.15.86:55384) 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 -- 172.21.15.86:0/1422826145 learned_addr learned my addr 172.21.15.86:0/1422826145 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1e52b700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e18101e40 0x7f5e1810f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1dd2a700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e18102800 0x7f5e1810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 -- 172.21.15.86:0/1422826145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e18101e40 msgr2=0x7f5e1810f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e18101e40 0x7f5e1810f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 -- 172.21.15.86:0/1422826145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e18102800 msgr2=0x7f5e1810fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e18102800 0x7f5e1810fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 -- 172.21.15.86:0/1422826145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e181a5200 con 0x7f5e18108560 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1dd2a700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e18102800 0x7f5e1810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:07:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e1ed2c700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18108560 0x7f5e181a4af0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5e100047b0 tx=0x7f5e10005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10027070 con 0x7f5e18108560 2024-05-12T11:07:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e181a5490 con 0x7f5e18108560 2024-05-12T11:07:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e10003f20 con 0x7f5e18108560 2024-05-12T11:07:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10022bb0 con 0x7f5e18108560 2024-05-12T11:07:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.963+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e181acda0 con 0x7f5e18108560 2024-05-12T11:07:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.964+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e181013a0 con 0x7f5e18108560 2024-05-12T11:07:18.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.967+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5e1002a070 con 0x7f5e18108560 2024-05-12T11:07:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.968+0000 7f5e0f7fe700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5e040b2a10 0x7f5e040b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.968+0000 7f5e1e52b700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5e040b2a10 0x7f5e040b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.968+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f5e100e4030 con 0x7f5e18108560 2024-05-12T11:07:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.968+0000 7f5e0f7fe700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] conn(0x7f5e040bc650 0x7f5e040beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.968+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 --> [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e040bf1c0 con 0x7f5e040bc650 2024-05-12T11:07:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.968+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f5e100e4420 con 0x7f5e18108560 2024-05-12T11:07:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.968+0000 7f5e1e52b700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5e040b2a10 0x7f5e040b4ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e18078c40 tx=0x7f5e14009180 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.969+0000 7f5e1dd2a700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] conn(0x7f5e040bc650 0x7f5e040beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:18.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.969+0000 7f5e1dd2a700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] conn(0x7f5e040bc650 0x7f5e040beaf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.970+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 <== osd.5 v2:172.21.15.176:6808/3129482072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e040bf1c0 con 0x7f5e040bc650 2024-05-12T11:07:18.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.987+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 --> [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e1806b6f0 con 0x7f5e040bc650 2024-05-12T11:07:18.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e0f7fe700 1 -- 172.21.15.86:0/1422826145 <== osd.5 v2:172.21.15.176:6808/3129482072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e1806b6f0 con 0x7f5e040bc650 2024-05-12T11:07:18.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 >> [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] conn(0x7f5e040bc650 msgr2=0x7f5e040beaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:18.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] conn(0x7f5e040bc650 0x7f5e040beaf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:18.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5e040b2a10 msgr2=0x7f5e040b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5e040b2a10 0x7f5e040b4ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e18078c40 tx=0x7f5e14009180 comp rx=0 tx=0).stop 2024-05-12T11:07:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18108560 msgr2=0x7f5e181a4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 --2- 172.21.15.86:0/1422826145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e18108560 0x7f5e181a4af0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5e100047b0 tx=0x7f5e10005e80 comp rx=0 tx=0).stop 2024-05-12T11:07:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e1ed2c700 1 -- 172.21.15.86:0/1422826145 reap_dead start 2024-05-12T11:07:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 shutdown_connections 2024-05-12T11:07:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 >> 172.21.15.86:0/1422826145 conn(0x7f5e180776c0 msgr2=0x7f5e181009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.988+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 shutdown_connections 2024-05-12T11:07:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:18.989+0000 7f5e2078f700 1 -- 172.21.15.86:0/1422826145 wait complete. 2024-05-12T11:07:19.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 -- 172.21.15.86:0/590100614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c1023e0 msgr2=0x7f837c102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:19.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 --2- 172.21.15.86:0/590100614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c1023e0 0x7f837c102840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f836c009990 tx=0x7f836c009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:19.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 -- 172.21.15.86:0/590100614 shutdown_connections 2024-05-12T11:07:19.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 --2- 172.21.15.86:0/590100614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c102d80 0x7f837c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:19.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 --2- 172.21.15.86:0/590100614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837c108420 0x7f837c108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:19.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 --2- 172.21.15.86:0/590100614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c1023e0 0x7f837c102840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 -- 172.21.15.86:0/590100614 >> 172.21.15.86:0/590100614 conn(0x7f837c0792d0 msgr2=0x7f837c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:20.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 -- 172.21.15.86:0/590100614 shutdown_connections 2024-05-12T11:07:20.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.008+0000 7f838119b700 1 -- 172.21.15.86:0/590100614 wait complete. 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f838119b700 1 Processor -- start 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f838119b700 1 -- start start 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f838119b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837c1023e0 0x7f837c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f838119b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c102d80 0x7f837c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f838119b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c108420 0x7f837c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f838119b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f837c112610 con 0x7f837c108420 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f838119b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f837c112490 con 0x7f837c102d80 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f838119b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f837c112790 con 0x7f837c1023e0 2024-05-12T11:07:20.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f837b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c108420 0x7f837c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f837b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c108420 0x7f837c199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55428/0 (socket says 172.21.15.86:55428) 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f837b59e700 1 -- 172.21.15.86:0/1544902756 learned_addr learned my addr 172.21.15.86:0/1544902756 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f837a59c700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c102d80 0x7f837c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.009+0000 7f837ad9d700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837c1023e0 0x7f837c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f837b59e700 1 -- 172.21.15.86:0/1544902756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837c1023e0 msgr2=0x7f837c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f837b59e700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837c1023e0 0x7f837c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f837b59e700 1 -- 172.21.15.86:0/1544902756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c102d80 msgr2=0x7f837c19ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f837b59e700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c102d80 0x7f837c19ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f837b59e700 1 -- 172.21.15.86:0/1544902756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c19a3f0 con 0x7f837c108420 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f837b59e700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c108420 0x7f837c199b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f837400b970 tx=0x7f837400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374019070 con 0x7f837c108420 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837c19a6e0 con 0x7f837c108420 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8374014440 con 0x7f837c108420 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837400ce60 con 0x7f837c108420 2024-05-12T11:07:20.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.010+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837c1a69c0 con 0x7f837c108420 2024-05-12T11:07:20.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.011+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f837c06bf40 con 0x7f837c108420 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.012+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f837401c070 con 0x7f837c108420 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.013+0000 7f8363fff700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f83640b2910 0x7f83640b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.013+0000 7f837ad9d700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f83640b2910 0x7f83640b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.013+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f83740e1f40 con 0x7f837c108420 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.013+0000 7f8363fff700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] conn(0x7f83640bc550 0x7f83640be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.013+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 --> [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8374021e50 con 0x7f83640bc550 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.014+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f83740e2390 con 0x7f837c108420 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.014+0000 7f837ad9d700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f83640b2910 0x7f83640b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8370006fd0 tx=0x7f8370008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:20.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.014+0000 7f837a59c700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] conn(0x7f83640bc550 0x7f83640be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.014+0000 7f837a59c700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] conn(0x7f83640bc550 0x7f83640be9f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:20.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.015+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 <== osd.10 v2:172.21.15.172:6824/2676876464 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8374021e50 con 0x7f83640bc550 2024-05-12T11:07:20.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.031+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 --> [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f837c103ad0 con 0x7f83640bc550 2024-05-12T11:07:20.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f8363fff700 1 -- 172.21.15.86:0/1544902756 <== osd.10 v2:172.21.15.172:6824/2676876464 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f837c103ad0 con 0x7f83640bc550 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 >> [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] conn(0x7f83640bc550 msgr2=0x7f83640be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f838119b700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] conn(0x7f83640bc550 0x7f83640be9f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f83640b2910 msgr2=0x7f83640b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f838119b700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f83640b2910 0x7f83640b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8370006fd0 tx=0x7f8370008040 comp rx=0 tx=0).stop 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c108420 msgr2=0x7f837c199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f838119b700 1 --2- 172.21.15.86:0/1544902756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f837c108420 0x7f837c199b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f837400b970 tx=0x7f837400bd30 comp rx=0 tx=0).stop 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f837b59e700 1 -- 172.21.15.86:0/1544902756 reap_dead start 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 shutdown_connections 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.032+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 >> 172.21.15.86:0/1544902756 conn(0x7f837c0792d0 msgr2=0x7f837c1068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.033+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 shutdown_connections 2024-05-12T11:07:20.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.033+0000 7f838119b700 1 -- 172.21.15.86:0/1544902756 wait complete. 2024-05-12T11:07:20.107 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:19 smithi086 ceph-mon[30110]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:20.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:19 smithi172 ceph-mon[34517]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:20.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:19 smithi176 ceph-mon[34357]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:20.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.458+0000 7f0b76ebb700 1 -- 172.21.15.86:0/1118474478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701026a0 msgr2=0x7f0b70102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.458+0000 7f0b76ebb700 1 --2- 172.21.15.86:0/1118474478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701026a0 0x7f0b70102b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009990 tx=0x7f0b5c009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 -- 172.21.15.86:0/1118474478 shutdown_connections 2024-05-12T11:07:20.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 --2- 172.21.15.86:0/1118474478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b70103060 0x7f0b7010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 --2- 172.21.15.86:0/1118474478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b701084b0 0x7f0b70108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 --2- 172.21.15.86:0/1118474478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701026a0 0x7f0b70102b20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 -- 172.21.15.86:0/1118474478 >> 172.21.15.86:0/1118474478 conn(0x7f0b700791a0 msgr2=0x7f0b700795b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:20.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 -- 172.21.15.86:0/1118474478 shutdown_connections 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 -- 172.21.15.86:0/1118474478 wait complete. 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 Processor -- start 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 -- start start 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b701026a0 0x7f0b7019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b70103060 0x7f0b7019afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701084b0 0x7f0b701a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701125e0 con 0x7f0b701084b0 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70112460 con 0x7f0b701026a0 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.459+0000 7f0b76ebb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70112760 con 0x7f0b70103060 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701084b0 0x7f0b701a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701084b0 0x7f0b701a5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55444/0 (socket says 172.21.15.86:55444) 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 -- 172.21.15.86:0/3875995297 learned_addr learned my addr 172.21.15.86:0/3875995297 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:20.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b6ffff700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b70103060 0x7f0b7019afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b74c57700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b701026a0 0x7f0b7019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 -- 172.21.15.86:0/3875995297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b70103060 msgr2=0x7f0b7019afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b70103060 0x7f0b7019afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 -- 172.21.15.86:0/3875995297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b701026a0 msgr2=0x7f0b7019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b701026a0 0x7f0b7019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 -- 172.21.15.86:0/3875995297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b701a6060 con 0x7f0b701084b0 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b6ffff700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b70103060 0x7f0b7019afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b74c57700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b701026a0 0x7f0b7019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b75458700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701084b0 0x7f0b701a5b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800ab50 tx=0x7f0b6800af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68017020 con 0x7f0b701084b0 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b68004bb0 con 0x7f0b701084b0 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b701a6290 con 0x7f0b701084b0 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68005350 con 0x7f0b701084b0 2024-05-12T11:07:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.460+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b701a6750 con 0x7f0b701084b0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.461+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b70063bb0 con 0x7f0b701084b0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.462+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0b6800c6d0 con 0x7f0b701084b0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.463+0000 7f0b6dffb700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0b600b2910 0x7f0b600b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.463+0000 7f0b74c57700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0b600b2910 0x7f0b600b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.463+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0b680e2470 con 0x7f0b701084b0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.463+0000 7f0b6dffb700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] conn(0x7f0b600bc550 0x7f0b600be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.463+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 --> [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b600bf0c0 con 0x7f0b600bc550 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.463+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0b680e28c0 con 0x7f0b701084b0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.464+0000 7f0b6ffff700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] conn(0x7f0b600bc550 0x7f0b600be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.464+0000 7f0b74c57700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0b600b2910 0x7f0b600b4dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009b50 tx=0x7f0b64009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.464+0000 7f0b6ffff700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] conn(0x7f0b600bc550 0x7f0b600be9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:20.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.464+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 <== osd.3 v2:172.21.15.86:6810/743430147 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b600bf0c0 con 0x7f0b600bc550 2024-05-12T11:07:20.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 --> [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b70063fb0 con 0x7f0b600bc550 2024-05-12T11:07:20.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b6dffb700 1 -- 172.21.15.86:0/3875995297 <== osd.3 v2:172.21.15.86:6810/743430147 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0b70063fb0 con 0x7f0b600bc550 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] conn(0x7f0b600bc550 msgr2=0x7f0b600be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] conn(0x7f0b600bc550 0x7f0b600be9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0b600b2910 msgr2=0x7f0b600b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f0b600b2910 0x7f0b600b4dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009b50 tx=0x7f0b64009550 comp rx=0 tx=0).stop 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701084b0 msgr2=0x7f0b701a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 --2- 172.21.15.86:0/3875995297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b701084b0 0x7f0b701a5b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800ab50 tx=0x7f0b6800af10 comp rx=0 tx=0).stop 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b75458700 1 -- 172.21.15.86:0/3875995297 reap_dead start 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 shutdown_connections 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 >> 172.21.15.86:0/3875995297 conn(0x7f0b700791a0 msgr2=0x7f0b701007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 shutdown_connections 2024-05-12T11:07:20.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:20.481+0000 7f0b76ebb700 1 -- 172.21.15.86:0/3875995297 wait complete. 2024-05-12T11:07:21.127 INFO:teuthology.orchestra.run.smithi086.stdout:283467841572 2024-05-12T11:07:21.128 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-12T11:07:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 -- 172.21.15.86:0/1458455365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c1023a0 msgr2=0x7f329c102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 --2- 172.21.15.86:0/1458455365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c1023a0 0x7f329c102820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f328c009990 tx=0x7f328c009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 -- 172.21.15.86:0/1458455365 shutdown_connections 2024-05-12T11:07:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 --2- 172.21.15.86:0/1458455365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f329c102d60 0x7f329c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 --2- 172.21.15.86:0/1458455365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f329c108410 0x7f329c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 --2- 172.21.15.86:0/1458455365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c1023a0 0x7f329c102820 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 -- 172.21.15.86:0/1458455365 >> 172.21.15.86:0/1458455365 conn(0x7f329c079350 msgr2=0x7f329c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 -- 172.21.15.86:0/1458455365 shutdown_connections 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.491+0000 7f32a3514700 1 -- 172.21.15.86:0/1458455365 wait complete. 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a3514700 1 Processor -- start 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a3514700 1 -- start start 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a3514700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f329c1023a0 0x7f329c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a3514700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f329c102d60 0x7f329c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a3514700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c108410 0x7f329c1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a3514700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f329c1125d0 con 0x7f329c108410 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a3514700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f329c112450 con 0x7f329c1023a0 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a3514700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f329c112750 con 0x7f329c102d60 2024-05-12T11:07:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a1ab1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c108410 0x7f329c1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a1ab1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c108410 0x7f329c1999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55404/0 (socket says 172.21.15.86:55404) 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a1ab1700 1 -- 172.21.15.86:0/477373729 learned_addr learned my addr 172.21.15.86:0/477373729 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.492+0000 7f32a0aaf700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f329c102d60 0x7f329c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a1ab1700 1 -- 172.21.15.86:0/477373729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f329c102d60 msgr2=0x7f329c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a1ab1700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f329c102d60 0x7f329c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a1ab1700 1 -- 172.21.15.86:0/477373729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f329c1023a0 msgr2=0x7f329c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a1ab1700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f329c1023a0 0x7f329c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a1ab1700 1 -- 172.21.15.86:0/477373729 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c19a140 con 0x7f329c108410 2024-05-12T11:07:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a0aaf700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f329c102d60 0x7f329c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a1ab1700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c108410 0x7f329c1999e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f329400b970 tx=0x7f329400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294019070 con 0x7f329c108410 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329c19a430 con 0x7f329c108410 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3294014440 con 0x7f329c108410 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329400ce60 con 0x7f329c108410 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.493+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f329c1a66f0 con 0x7f329c108410 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.494+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f329c06b510 con 0x7f329c108410 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.495+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f329401c070 con 0x7f329c108410 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.496+0000 7f32927fc700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32880b2910 0x7f32880b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.496+0000 7f32a12b0700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32880b2910 0x7f32880b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.496+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f32940e1ef0 con 0x7f329c108410 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.496+0000 7f32927fc700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] conn(0x7f32880bc550 0x7f32880be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.496+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 --> [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3294025ea0 con 0x7f32880bc550 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.496+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f32940e2340 con 0x7f329c108410 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.496+0000 7f32a0aaf700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] conn(0x7f32880bc550 0x7f32880be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.496+0000 7f32a12b0700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32880b2910 0x7f32880b4dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3298005950 tx=0x7f32980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.497+0000 7f32a0aaf700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] conn(0x7f32880bc550 0x7f32880be9f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.497+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 <== osd.6 v2:172.21.15.86:6818/2940460720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3294025ea0 con 0x7f32880bc550 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.513+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 --> [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f329c103ac0 con 0x7f32880bc550 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32927fc700 1 -- 172.21.15.86:0/477373729 <== osd.6 v2:172.21.15.86:6818/2940460720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f329c103ac0 con 0x7f32880bc550 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] conn(0x7f32880bc550 msgr2=0x7f32880be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] conn(0x7f32880bc550 0x7f32880be9f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:21.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32880b2910 msgr2=0x7f32880b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f32880b2910 0x7f32880b4dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3298005950 tx=0x7f32980058e0 comp rx=0 tx=0).stop 2024-05-12T11:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c108410 msgr2=0x7f329c1999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 --2- 172.21.15.86:0/477373729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f329c108410 0x7f329c1999e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f329400b970 tx=0x7f329400bd30 comp rx=0 tx=0).stop 2024-05-12T11:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a1ab1700 1 -- 172.21.15.86:0/477373729 reap_dead start 2024-05-12T11:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 shutdown_connections 2024-05-12T11:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 >> 172.21.15.86:0/477373729 conn(0x7f329c079350 msgr2=0x7f329c101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 shutdown_connections 2024-05-12T11:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:19.514+0000 7f32a3514700 1 -- 172.21.15.86:0/477373729 wait complete. 2024-05-12T11:07:21.808 INFO:teuthology.orchestra.run.smithi086.stdout:188978561081 2024-05-12T11:07:21.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-12T11:07:22.042 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:21 smithi086 ceph-mon[30110]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-05-12T11:07:22.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:21 smithi172 ceph-mon[34517]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-05-12T11:07:22.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:21 smithi176 ceph-mon[34357]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-05-12T11:07:22.857 INFO:teuthology.orchestra.run.smithi086.stdout:163208757310 2024-05-12T11:07:22.858 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-12T11:07:24.088 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:23 smithi086 ceph-mon[30110]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:24.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:23 smithi172 ceph-mon[34517]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:24.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:23 smithi176 ceph-mon[34357]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 -- 172.21.15.86:0/3387864137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680107be0 msgr2=0x7fd680107fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 --2- 172.21.15.86:0/3387864137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680107be0 0x7fd680107fc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd67400aad0 tx=0x7fd67400ade0 comp rx=0 tx=0).stop 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 -- 172.21.15.86:0/3387864137 shutdown_connections 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 --2- 172.21.15.86:0/3387864137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd680102540 0x7fd68010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 --2- 172.21.15.86:0/3387864137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680107be0 0x7fd680107fc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 --2- 172.21.15.86:0/3387864137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd680101b80 0x7fd680102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 -- 172.21.15.86:0/3387864137 >> 172.21.15.86:0/3387864137 conn(0x7fd680078a10 msgr2=0x7fd6800ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 -- 172.21.15.86:0/3387864137 shutdown_connections 2024-05-12T11:07:24.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 -- 172.21.15.86:0/3387864137 wait complete. 2024-05-12T11:07:24.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 Processor -- start 2024-05-12T11:07:24.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.390+0000 7fd686b01700 1 -- start start 2024-05-12T11:07:24.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd686b01700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680101b80 0x7fd68019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:24.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd686b01700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd680102540 0x7fd68019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:24.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd686b01700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd680107be0 0x7fd680199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:24.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd686b01700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd680111470 con 0x7fd680101b80 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd686b01700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6801112f0 con 0x7fd680107be0 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd686b01700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd6801115f0 con 0x7fd680102540 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680101b80 0x7fd68019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680101b80 0x7fd68019f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40584/0 (socket says 172.21.15.86:40584) 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 -- 172.21.15.86:0/980977740 learned_addr learned my addr 172.21.15.86:0/980977740 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68509e700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd680107be0 0x7fd680199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd67ffff700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd680102540 0x7fd68019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 -- 172.21.15.86:0/980977740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd680102540 msgr2=0x7fd68019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd680102540 0x7fd68019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 -- 172.21.15.86:0/980977740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd680107be0 msgr2=0x7fd680199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd680107be0 0x7fd680199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 -- 172.21.15.86:0/980977740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68019a0f0 con 0x7fd680101b80 2024-05-12T11:07:24.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd68489d700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680101b80 0x7fd68019f7d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd674006010 tx=0x7fd674003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:24.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674023020 con 0x7fd680101b80 2024-05-12T11:07:24.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd67400e450 con 0x7fd680101b80 2024-05-12T11:07:24.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68019a380 con 0x7fd680101b80 2024-05-12T11:07:24.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.391+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674016680 con 0x7fd680101b80 2024-05-12T11:07:24.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.392+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6801a66a0 con 0x7fd680101b80 2024-05-12T11:07:24.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.392+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd680063c30 con 0x7fd680101b80 2024-05-12T11:07:24.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.394+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd674026020 con 0x7fd680101b80 2024-05-12T11:07:24.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.394+0000 7fd67dffb700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd6700b2910 0x7fd6700b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:24.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.395+0000 7fd67ffff700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd6700b2910 0x7fd6700b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:24.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.395+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd6740e3e80 con 0x7fd680101b80 2024-05-12T11:07:24.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.395+0000 7fd67dffb700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] conn(0x7fd6700bc550 0x7fd6700be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:24.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.395+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 --> [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd67402ee50 con 0x7fd6700bc550 2024-05-12T11:07:24.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.395+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd6740e42d0 con 0x7fd680101b80 2024-05-12T11:07:24.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.395+0000 7fd67ffff700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd6700b2910 0x7fd6700b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6800ffb50 tx=0x7fd66c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:24.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.395+0000 7fd68509e700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] conn(0x7fd6700bc550 0x7fd6700be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:24.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.396+0000 7fd68509e700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] conn(0x7fd6700bc550 0x7fd6700be9f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:24.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.397+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 <== osd.8 v2:172.21.15.176:6816/1304311054 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd67402ee50 con 0x7fd6700bc550 2024-05-12T11:07:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.414+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 --> [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd6800640b0 con 0x7fd6700bc550 2024-05-12T11:07:24.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.414+0000 7fd67dffb700 1 -- 172.21.15.86:0/980977740 <== osd.8 v2:172.21.15.176:6816/1304311054 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd6800640b0 con 0x7fd6700bc550 2024-05-12T11:07:24.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 >> [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] conn(0x7fd6700bc550 msgr2=0x7fd6700be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:24.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] conn(0x7fd6700bc550 0x7fd6700be9f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:24.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd6700b2910 msgr2=0x7fd6700b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:24.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd6700b2910 0x7fd6700b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6800ffb50 tx=0x7fd66c00a300 comp rx=0 tx=0).stop 2024-05-12T11:07:24.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680101b80 msgr2=0x7fd68019f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:24.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 --2- 172.21.15.86:0/980977740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd680101b80 0x7fd68019f7d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd674006010 tx=0x7fd674003a90 comp rx=0 tx=0).stop 2024-05-12T11:07:24.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd68509e700 1 -- 172.21.15.86:0/980977740 reap_dead start 2024-05-12T11:07:24.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 shutdown_connections 2024-05-12T11:07:24.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 >> 172.21.15.86:0/980977740 conn(0x7fd680078a10 msgr2=0x7fd680100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:24.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 shutdown_connections 2024-05-12T11:07:24.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:24.415+0000 7fd686b01700 1 -- 172.21.15.86:0/980977740 wait complete. 2024-05-12T11:07:25.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 -- 172.21.15.86:0/1455403598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 msgr2=0x7f758410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 --2- 172.21.15.86:0/1455403598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 0x7f758410f2e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f757c00b0d0 tx=0x7f757c00b3e0 comp rx=0 tx=0).stop 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 -- 172.21.15.86:0/1455403598 shutdown_connections 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 --2- 172.21.15.86:0/1455403598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 0x7f758410f2e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 --2- 172.21.15.86:0/1455403598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7584102e00 0x7f75841031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 --2- 172.21.15.86:0/1455403598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75841037b0 0x7f7584107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 -- 172.21.15.86:0/1455403598 >> 172.21.15.86:0/1455403598 conn(0x7f7584078a10 msgr2=0x7f75840ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 -- 172.21.15.86:0/1455403598 shutdown_connections 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.024+0000 7f7588e41700 1 -- 172.21.15.86:0/1455403598 wait complete. 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7588e41700 1 Processor -- start 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7588e41700 1 -- start start 2024-05-12T11:07:25.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7588e41700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7584102e00 0x7f75840fde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7588e41700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75841037b0 0x7f75840fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7588e41700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 0x7f75840fe900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7588e41700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7584112620 con 0x7f7584107760 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7588e41700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75841124a0 con 0x7f7584102e00 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7588e41700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75841127a0 con 0x7f75841037b0 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7582d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 0x7f75840fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7582d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 0x7f75840fe900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40606/0 (socket says 172.21.15.86:40606) 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7582d9d700 1 -- 172.21.15.86:0/74189970 learned_addr learned my addr 172.21.15.86:0/74189970 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7581d9b700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75841037b0 0x7f75840fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f758259c700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7584102e00 0x7f75840fde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7582d9d700 1 -- 172.21.15.86:0/74189970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75841037b0 msgr2=0x7f75840fe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7582d9d700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75841037b0 0x7f75840fe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7582d9d700 1 -- 172.21.15.86:0/74189970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7584102e00 msgr2=0x7f75840fde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:25.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7582d9d700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7584102e00 0x7f75840fde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.025+0000 7f7582d9d700 1 -- 172.21.15.86:0/74189970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75841a8130 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.026+0000 7f7582d9d700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 0x7f75840fe900 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f757c009fd0 tx=0x7f757c007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.026+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c01f070 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.026+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75841a83c0 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.026+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f757c007e50 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.026+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c01b6a0 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.026+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75841a8810 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.027+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7584106970 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.028+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f757c022070 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.029+0000 7f75737fe700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f756c0b2910 0x7f756c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.029+0000 7f758259c700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f756c0b2910 0x7f756c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.029+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f757c0e3490 con 0x7f7584107760 2024-05-12T11:07:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.029+0000 7f75737fe700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] conn(0x7f756c0bc550 0x7f756c0be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:25.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.029+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 --> [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f757c02de50 con 0x7f756c0bc550 2024-05-12T11:07:25.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.029+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f757c0e38e0 con 0x7f7584107760 2024-05-12T11:07:25.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.029+0000 7f758259c700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f756c0b2910 0x7f756c0b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7574009a10 tx=0x7f7574009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:25.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.030+0000 7f7581d9b700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] conn(0x7f756c0bc550 0x7f756c0be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:25.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.030+0000 7f7581d9b700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] conn(0x7f756c0bc550 0x7f756c0be9f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:25.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.031+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 <== osd.2 v2:172.21.15.176:6800/753242720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f757c02de50 con 0x7f756c0bc550 2024-05-12T11:07:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.047+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 --> [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f758406a190 con 0x7f756c0bc550 2024-05-12T11:07:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f75737fe700 1 -- 172.21.15.86:0/74189970 <== osd.2 v2:172.21.15.176:6800/753242720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f758406a190 con 0x7f756c0bc550 2024-05-12T11:07:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 >> [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] conn(0x7f756c0bc550 msgr2=0x7f756c0be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] conn(0x7f756c0bc550 0x7f756c0be9f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f756c0b2910 msgr2=0x7f756c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f756c0b2910 0x7f756c0b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7574009a10 tx=0x7f7574009190 comp rx=0 tx=0).stop 2024-05-12T11:07:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 msgr2=0x7f75840fe900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 --2- 172.21.15.86:0/74189970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7584107760 0x7f75840fe900 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f757c009fd0 tx=0x7f757c007a20 comp rx=0 tx=0).stop 2024-05-12T11:07:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7582d9d700 1 -- 172.21.15.86:0/74189970 reap_dead start 2024-05-12T11:07:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 shutdown_connections 2024-05-12T11:07:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 >> 172.21.15.86:0/74189970 conn(0x7f7584078a10 msgr2=0x7f7584101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 shutdown_connections 2024-05-12T11:07:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:25.048+0000 7f7588e41700 1 -- 172.21.15.86:0/74189970 wait complete. 2024-05-12T11:07:25.580 INFO:teuthology.orchestra.run.smithi086.stdout:111669149767 2024-05-12T11:07:25.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-12T11:07:26.112 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:25 smithi086 ceph-mon[30110]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-12T11:07:26.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:25 smithi172 ceph-mon[34517]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-12T11:07:26.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:25 smithi176 ceph-mon[34357]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-12T11:07:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 -- 172.21.15.86:0/1203813456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610102390 msgr2=0x7f3610102810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 --2- 172.21.15.86:0/1203813456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610102390 0x7f3610102810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009990 tx=0x7f35fc009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 -- 172.21.15.86:0/1203813456 shutdown_connections 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 --2- 172.21.15.86:0/1203813456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3610102d50 0x7f361010f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 --2- 172.21.15.86:0/1203813456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3610108400 0x7f36101087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 --2- 172.21.15.86:0/1203813456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610102390 0x7f3610102810 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 -- 172.21.15.86:0/1203813456 >> 172.21.15.86:0/1203813456 conn(0x7f3610079310 msgr2=0x7f3610079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 -- 172.21.15.86:0/1203813456 shutdown_connections 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 -- 172.21.15.86:0/1203813456 wait complete. 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.260+0000 7f3616d7c700 1 Processor -- start 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3616d7c700 1 -- start start 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3616d7c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3610102390 0x7f361019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3616d7c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3610102d50 0x7f361019b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3616d7c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610108400 0x7f36101a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3616d7c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f36101126b0 con 0x7f3610108400 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3616d7c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3610112530 con 0x7f3610102390 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3616d7c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3610112830 con 0x7f3610102d50 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610108400 0x7f36101a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610108400 0x7f36101a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40634/0 (socket says 172.21.15.86:40634) 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 -- 172.21.15.86:0/3709870854 learned_addr learned my addr 172.21.15.86:0/3709870854 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 -- 172.21.15.86:0/3709870854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3610102d50 msgr2=0x7f361019b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3614b18700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3610102390 0x7f361019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3610102d50 0x7f361019b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 -- 172.21.15.86:0/3709870854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3610102390 msgr2=0x7f361019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3610102390 0x7f361019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 -- 172.21.15.86:0/3709870854 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101a60f0 con 0x7f3610108400 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3614b18700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3610102390 0x7f361019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f3615319700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610108400 0x7f36101a5bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f360800b780 tx=0x7f360800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.261+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360800f840 con 0x7f3610108400 2024-05-12T11:07:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.262+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101a6380 con 0x7f3610108400 2024-05-12T11:07:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.262+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3608017400 con 0x7f3610108400 2024-05-12T11:07:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.262+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360800d610 con 0x7f3610108400 2024-05-12T11:07:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.262+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36101a6840 con 0x7f3610108400 2024-05-12T11:07:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.262+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3610063bb0 con 0x7f3610108400 2024-05-12T11:07:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.264+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f36080175b0 con 0x7f3610108400 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.265+0000 7f360dffb700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f36000b2910 0x7f36000b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.265+0000 7f3614b18700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f36000b2910 0x7f36000b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.265+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f36080e25e0 con 0x7f3610108400 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.265+0000 7f360dffb700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] conn(0x7f36000bc550 0x7f36000be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.265+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 --> [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3608011ec0 con 0x7f36000bc550 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.265+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f36080e2a30 con 0x7f3610108400 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.265+0000 7f3614b18700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f36000b2910 0x7f36000b4dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3604006fd0 tx=0x7f3604008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.265+0000 7f360ffff700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] conn(0x7f36000bc550 0x7f36000be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.266+0000 7f360ffff700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] conn(0x7f36000bc550 0x7f36000be9f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.266+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 <== osd.11 v2:172.21.15.176:6824/2310445273 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3608011ec0 con 0x7f36000bc550 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.283+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 --> [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3610064030 con 0x7f36000bc550 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.283+0000 7f360dffb700 1 -- 172.21.15.86:0/3709870854 <== osd.11 v2:172.21.15.176:6824/2310445273 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3610064030 con 0x7f36000bc550 2024-05-12T11:07:27.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 >> [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] conn(0x7f36000bc550 msgr2=0x7f36000be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] conn(0x7f36000bc550 0x7f36000be9f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f36000b2910 msgr2=0x7f36000b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f36000b2910 0x7f36000b4dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3604006fd0 tx=0x7f3604008040 comp rx=0 tx=0).stop 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610108400 msgr2=0x7f36101a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 --2- 172.21.15.86:0/3709870854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3610108400 0x7f36101a5bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f360800b780 tx=0x7f360800bb40 comp rx=0 tx=0).stop 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3615319700 1 -- 172.21.15.86:0/3709870854 reap_dead start 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 shutdown_connections 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 >> 172.21.15.86:0/3709870854 conn(0x7f3610079310 msgr2=0x7f3610101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 shutdown_connections 2024-05-12T11:07:27.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:26.284+0000 7f3616d7c700 1 -- 172.21.15.86:0/3709870854 wait complete. 2024-05-12T11:07:27.787 INFO:teuthology.orchestra.run.smithi086.stdout:309237645344 2024-05-12T11:07:27.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-12T11:07:28.005 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:27 smithi086 ceph-mon[30110]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:28.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:27 smithi172 ceph-mon[34517]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:28.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:27 smithi176 ceph-mon[34357]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:28.426 INFO:teuthology.orchestra.run.smithi086.stdout:236223201328 2024-05-12T11:07:28.426 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-12T11:07:28.828 INFO:teuthology.orchestra.run.smithi086.stdout:77309411406 2024-05-12T11:07:28.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-12T11:07:29.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 -- 172.21.15.86:0/3128604063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 msgr2=0x7f4268102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:29.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 --2- 172.21.15.86:0/3128604063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 0x7f4268102820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4264009990 tx=0x7f4264009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 -- 172.21.15.86:0/3128604063 shutdown_connections 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 --2- 172.21.15.86:0/3128604063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4268102d60 0x7f426810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 --2- 172.21.15.86:0/3128604063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4268108410 0x7f42681087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 --2- 172.21.15.86:0/3128604063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 0x7f4268102820 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 -- 172.21.15.86:0/3128604063 >> 172.21.15.86:0/3128604063 conn(0x7f4268079350 msgr2=0x7f4268079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 -- 172.21.15.86:0/3128604063 shutdown_connections 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.062+0000 7f426fb5d700 1 -- 172.21.15.86:0/3128604063 wait complete. 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426fb5d700 1 Processor -- start 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426fb5d700 1 -- start start 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426fb5d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 0x7f426819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426fb5d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4268102d60 0x7f426819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426fb5d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4268108410 0x7f42681989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:29.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426fb5d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4268112630 con 0x7f42681023a0 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426fb5d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42681124b0 con 0x7f4268108410 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426fb5d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42681127b0 con 0x7f4268102d60 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426d8f9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 0x7f426819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426d8f9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 0x7f426819e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40648/0 (socket says 172.21.15.86:40648) 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.063+0000 7f426d8f9700 1 -- 172.21.15.86:0/2048956838 learned_addr learned my addr 172.21.15.86:0/2048956838 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426d0f8700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4268102d60 0x7f426819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426e0fa700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4268108410 0x7f42681989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426d8f9700 1 -- 172.21.15.86:0/2048956838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4268102d60 msgr2=0x7f426819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426d8f9700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4268102d60 0x7f426819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426d8f9700 1 -- 172.21.15.86:0/2048956838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4268108410 msgr2=0x7f42681989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426d8f9700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4268108410 0x7f42681989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426d8f9700 1 -- 172.21.15.86:0/2048956838 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4268199150 con 0x7f42681023a0 2024-05-12T11:07:29.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426d8f9700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 0x7f426819e830 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f425c00b530 tx=0x7f425c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:29.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c015020 con 0x7f42681023a0 2024-05-12T11:07:29.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4268199440 con 0x7f42681023a0 2024-05-12T11:07:29.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f425c011ce0 con 0x7f42681023a0 2024-05-12T11:07:29.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c010d20 con 0x7f42681023a0 2024-05-12T11:07:29.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.064+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426806b180 con 0x7f42681023a0 2024-05-12T11:07:29.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.065+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f426806b760 con 0x7f42681023a0 2024-05-12T11:07:29.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.067+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f425c018020 con 0x7f42681023a0 2024-05-12T11:07:29.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.068+0000 7f425affd700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42540b2910 0x7f42540b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:29.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.068+0000 7f426d0f8700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42540b2910 0x7f42540b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:29.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.068+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f425c0e2230 con 0x7f42681023a0 2024-05-12T11:07:29.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.068+0000 7f425affd700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] conn(0x7f42540bc550 0x7f42540be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:29.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.068+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 --> [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f425c01be50 con 0x7f42540bc550 2024-05-12T11:07:29.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.068+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f425c0e2680 con 0x7f42681023a0 2024-05-12T11:07:29.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.069+0000 7f426e0fa700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] conn(0x7f42540bc550 0x7f42540be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:29.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.069+0000 7f426d0f8700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42540b2910 0x7f42540b4dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4264006010 tx=0x7f426401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:29.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.069+0000 7f426e0fa700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] conn(0x7f42540bc550 0x7f42540be9f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:29.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.070+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 <== osd.0 v2:172.21.15.86:6802/2476610607 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f425c01be50 con 0x7f42540bc550 2024-05-12T11:07:29.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 --> [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f426806bb60 con 0x7f42540bc550 2024-05-12T11:07:29.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f425affd700 1 -- 172.21.15.86:0/2048956838 <== osd.0 v2:172.21.15.86:6802/2476610607 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f426806bb60 con 0x7f42540bc550 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] conn(0x7f42540bc550 msgr2=0x7f42540be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426fb5d700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] conn(0x7f42540bc550 0x7f42540be9f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42540b2910 msgr2=0x7f42540b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426fb5d700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42540b2910 0x7f42540b4dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4264006010 tx=0x7f426401a040 comp rx=0 tx=0).stop 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 msgr2=0x7f426819e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426fb5d700 1 --2- 172.21.15.86:0/2048956838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42681023a0 0x7f426819e830 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f425c00b530 tx=0x7f425c00b8f0 comp rx=0 tx=0).stop 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426e0fa700 1 -- 172.21.15.86:0/2048956838 reap_dead start 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.087+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 shutdown_connections 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.088+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 >> 172.21.15.86:0/2048956838 conn(0x7f4268079350 msgr2=0x7f4268101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.088+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 shutdown_connections 2024-05-12T11:07:29.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:29.088+0000 7f426fb5d700 1 -- 172.21.15.86:0/2048956838 wait complete. 2024-05-12T11:07:29.873 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:29 smithi086 ceph-mon[30110]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:30.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:29 smithi172 ceph-mon[34517]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:30.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:29 smithi176 ceph-mon[34357]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:30.777 INFO:teuthology.orchestra.run.smithi086.stdout:34359738457 2024-05-12T11:07:30.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-12T11:07:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 -- 172.21.15.86:0/82036659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 msgr2=0x7f18a810f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 --2- 172.21.15.86:0/82036659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 0x7f18a810f290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f18980099c0 tx=0x7f1898009cd0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 -- 172.21.15.86:0/82036659 shutdown_connections 2024-05-12T11:07:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 --2- 172.21.15.86:0/82036659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 0x7f18a810f290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 --2- 172.21.15.86:0/82036659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a8102630 0x7f18a8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 --2- 172.21.15.86:0/82036659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a8102fe0 0x7f18a8106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 -- 172.21.15.86:0/82036659 >> 172.21.15.86:0/82036659 conn(0x7f18a8079370 msgr2=0x7f18a8079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 -- 172.21.15.86:0/82036659 shutdown_connections 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.283+0000 7f18acecd700 1 -- 172.21.15.86:0/82036659 wait complete. 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18acecd700 1 Processor -- start 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18acecd700 1 -- start start 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18acecd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a8102630 0x7f18a819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18acecd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a8102fe0 0x7f18a819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18acecd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 0x7f18a8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18acecd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8112560 con 0x7f18a81076c0 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18acecd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18a81123e0 con 0x7f18a8102fe0 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18acecd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18a81126e0 con 0x7f18a8102630 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18a6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 0x7f18a8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18a6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 0x7f18a8198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40662/0 (socket says 172.21.15.86:40662) 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18a6d9d700 1 -- 172.21.15.86:0/1335449526 learned_addr learned my addr 172.21.15.86:0/1335449526 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18a659c700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a8102630 0x7f18a819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.284+0000 7f18a5d9b700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a8102fe0 0x7f18a819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f18a6d9d700 1 -- 172.21.15.86:0/1335449526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a8102630 msgr2=0x7f18a819e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f18a6d9d700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a8102630 0x7f18a819e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f18a6d9d700 1 -- 172.21.15.86:0/1335449526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a8102fe0 msgr2=0x7f18a819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f18a6d9d700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a8102fe0 0x7f18a819ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f18a6d9d700 1 -- 172.21.15.86:0/1335449526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a8199060 con 0x7f18a81076c0 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f18a6d9d700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 0x7f18a8198880 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1898005910 tx=0x7f1898009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898027070 con 0x7f18a81076c0 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a81992f0 con 0x7f18a81076c0 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1898003f20 con 0x7f18a81076c0 2024-05-12T11:07:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898022c50 con 0x7f18a81076c0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.285+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a81a5510 con 0x7f18a81076c0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.286+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18a8063c30 con 0x7f18a81076c0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.287+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f189802a070 con 0x7f18a81076c0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.288+0000 7f189f7fe700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f18940b2910 0x7f18940b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.288+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f18980e3460 con 0x7f18a81076c0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.288+0000 7f189f7fe700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] conn(0x7f18940bc550 0x7f18940be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.288+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 --> [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18940bf0c0 con 0x7f18940bc550 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.288+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f18980e38b0 con 0x7f18a81076c0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.288+0000 7f18a659c700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f18940b2910 0x7f18940b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.289+0000 7f18a5d9b700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] conn(0x7f18940bc550 0x7f18940be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.289+0000 7f18a659c700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f18940b2910 0x7f18940b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f18a00060b0 tx=0x7f18a000c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:31.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.289+0000 7f18a5d9b700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] conn(0x7f18940bc550 0x7f18940be9f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:31.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.290+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 <== osd.9 v2:172.21.15.86:6826/3922597037 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18940bf0c0 con 0x7f18940bc550 2024-05-12T11:07:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 --> [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18a8064030 con 0x7f18940bc550 2024-05-12T11:07:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f189f7fe700 1 -- 172.21.15.86:0/1335449526 <== osd.9 v2:172.21.15.86:6826/3922597037 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f18a8064030 con 0x7f18940bc550 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] conn(0x7f18940bc550 msgr2=0x7f18940be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f18acecd700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] conn(0x7f18940bc550 0x7f18940be9f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f18940b2910 msgr2=0x7f18940b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f18acecd700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f18940b2910 0x7f18940b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f18a00060b0 tx=0x7f18a000c040 comp rx=0 tx=0).stop 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 msgr2=0x7f18a8198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f18acecd700 1 --2- 172.21.15.86:0/1335449526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18a81076c0 0x7f18a8198880 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1898005910 tx=0x7f1898009580 comp rx=0 tx=0).stop 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.311+0000 7f18a6d9d700 1 -- 172.21.15.86:0/1335449526 reap_dead start 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.312+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 shutdown_connections 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.312+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 >> 172.21.15.86:0/1335449526 conn(0x7f18a8079370 msgr2=0x7f18a8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.312+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 shutdown_connections 2024-05-12T11:07:31.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.312+0000 7f18acecd700 1 -- 172.21.15.86:0/1335449526 wait complete. 2024-05-12T11:07:31.723 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:31.723 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:31.724 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:31.727 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:31.727 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:31.727 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:31.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 -- 172.21.15.86:0/4023315165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4109520 msgr2=0x7fd5b4109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 --2- 172.21.15.86:0/4023315165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4109520 0x7fd5b4109900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009990 tx=0x7fd5b0009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 -- 172.21.15.86:0/4023315165 shutdown_connections 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 --2- 172.21.15.86:0/4023315165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5b4102450 0x7fd5b4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 --2- 172.21.15.86:0/4023315165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4109520 0x7fd5b4109900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 --2- 172.21.15.86:0/4023315165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5b4101a90 0x7fd5b4101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 -- 172.21.15.86:0/4023315165 >> 172.21.15.86:0/4023315165 conn(0x7fd5b4078a10 msgr2=0x7fd5b40ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 -- 172.21.15.86:0/4023315165 shutdown_connections 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.938+0000 7fd5bc74c700 1 -- 172.21.15.86:0/4023315165 wait complete. 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5bc74c700 1 Processor -- start 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5bc74c700 1 -- start start 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5bc74c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4101a90 0x7fd5b419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5bc74c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5b4102450 0x7fd5b419fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5bc74c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5b4109520 0x7fd5b4199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5bc74c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4113730 con 0x7fd5b4101a90 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5bc74c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b41135b0 con 0x7fd5b4109520 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5bc74c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b41138b0 con 0x7fd5b4102450 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5ba4e8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4101a90 0x7fd5b419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5ba4e8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4101a90 0x7fd5b419f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44780/0 (socket says 172.21.15.86:44780) 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.939+0000 7fd5ba4e8700 1 -- 172.21.15.86:0/1067612256 learned_addr learned my addr 172.21.15.86:0/1067612256 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ba4e8700 1 -- 172.21.15.86:0/1067612256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5b4102450 msgr2=0x7fd5b419fe70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ba4e8700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5b4102450 0x7fd5b419fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ba4e8700 1 -- 172.21.15.86:0/1067612256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5b4109520 msgr2=0x7fd5b4199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ba4e8700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5b4109520 0x7fd5b4199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ba4e8700 1 -- 172.21.15.86:0/1067612256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b419a250 con 0x7fd5b4101a90 2024-05-12T11:07:31.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ba4e8700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4101a90 0x7fd5b419f930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000c00 tx=0x7fd5b00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0027070 con 0x7fd5b4101a90 2024-05-12T11:07:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5b00041d0 con 0x7fd5b4101a90 2024-05-12T11:07:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b419a4e0 con 0x7fd5b4101a90 2024-05-12T11:07:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b000f460 con 0x7fd5b4101a90 2024-05-12T11:07:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.940+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b41a6800 con 0x7fd5b4101a90 2024-05-12T11:07:31.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.941+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5b4063c30 con 0x7fd5b4101a90 2024-05-12T11:07:31.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.942+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd5b002a070 con 0x7fd5b4101a90 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.943+0000 7fd5ab7fe700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd5a00b2910 0x7fd5a00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.943+0000 7fd5b9ce7700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd5a00b2910 0x7fd5a00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.943+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd5b00e3b00 con 0x7fd5b4101a90 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.943+0000 7fd5ab7fe700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] conn(0x7fd5a00bc550 0x7fd5a00be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.943+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 --> [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5b00043d0 con 0x7fd5a00bc550 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.943+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd5b00e3f50 con 0x7fd5b4101a90 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.944+0000 7fd5b9ce7700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd5a00b2910 0x7fd5a00b4dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40ffbf0 tx=0x7fd5a4006cb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.944+0000 7fd5bace9700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] conn(0x7fd5a00bc550 0x7fd5a00be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:31.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.944+0000 7fd5bace9700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] conn(0x7fd5a00bc550 0x7fd5a00be9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:31.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.945+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 <== osd.1 v2:172.21.15.172:6800/3776376045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5b00043d0 con 0x7fd5a00bc550 2024-05-12T11:07:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.971+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 --> [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd5b40640b0 con 0x7fd5a00bc550 2024-05-12T11:07:31.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5ab7fe700 1 -- 172.21.15.86:0/1067612256 <== osd.1 v2:172.21.15.172:6800/3776376045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd5b40640b0 con 0x7fd5a00bc550 2024-05-12T11:07:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 >> [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] conn(0x7fd5a00bc550 msgr2=0x7fd5a00be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bc74c700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] conn(0x7fd5a00bc550 0x7fd5a00be9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd5a00b2910 msgr2=0x7fd5a00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bc74c700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fd5a00b2910 0x7fd5a00b4dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40ffbf0 tx=0x7fd5a4006cb0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4101a90 msgr2=0x7fd5b419f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bc74c700 1 --2- 172.21.15.86:0/1067612256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b4101a90 0x7fd5b419f930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000c00 tx=0x7fd5b00047b0 comp rx=0 tx=0).stop 2024-05-12T11:07:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bace9700 1 -- 172.21.15.86:0/1067612256 reap_dead start 2024-05-12T11:07:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 shutdown_connections 2024-05-12T11:07:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.972+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 >> 172.21.15.86:0/1067612256 conn(0x7fd5b4078a10 msgr2=0x7fd5b4100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.973+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 shutdown_connections 2024-05-12T11:07:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:31.973+0000 7fd5bc74c700 1 -- 172.21.15.86:0/1067612256 wait complete. 2024-05-12T11:07:32.112 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:31 smithi086 ceph-mon[30110]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:32.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:31 smithi172 ceph-mon[34517]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:32.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:31 smithi176 ceph-mon[34357]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:34.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:33 smithi086 ceph-mon[30110]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-12T11:07:34.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:33 smithi172 ceph-mon[34517]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-12T11:07:34.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:33 smithi176 ceph-mon[34357]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-12T11:07:35.428 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:36.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:35 smithi086 ceph-mon[30110]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:36.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:35 smithi172 ceph-mon[34517]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:36.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:35 smithi176 ceph-mon[34357]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:37.773 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:37.798 INFO:teuthology.orchestra.run.smithi086.stdout:55834574932 2024-05-12T11:07:37.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-12T11:07:38.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:37 smithi086 ceph-mon[30110]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:38.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:37 smithi172 ceph-mon[34517]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:38.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:37 smithi176 ceph-mon[34357]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:07:38.279 INFO:teuthology.orchestra.run.smithi086.stdout:261993005100 2024-05-12T11:07:38.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-12T11:07:40.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 -- 172.21.15.86:0/3976202384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 msgr2=0x7f5184108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:40.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3976202384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 0x7f5184108120 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51780099c0 tx=0x7f5178009cd0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 -- 172.21.15.86:0/3976202384 shutdown_connections 2024-05-12T11:07:40.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3976202384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5184108850 0x7f51841103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3976202384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5184103750 0x7f5184103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3976202384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 0x7f5184108120 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 -- 172.21.15.86:0/3976202384 >> 172.21.15.86:0/3976202384 conn(0x7f518407a600 msgr2=0x7f518407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:40.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 -- 172.21.15.86:0/3976202384 shutdown_connections 2024-05-12T11:07:40.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.131+0000 7f518a9d6700 1 -- 172.21.15.86:0/3976202384 wait complete. 2024-05-12T11:07:40.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f518a9d6700 1 Processor -- start 2024-05-12T11:07:40.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f518a9d6700 1 -- start start 2024-05-12T11:07:40.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f518a9d6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5184103750 0x7f51840757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:40.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f518a9d6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 0x7f5184075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f518a9d6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5184108850 0x7f5184076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f518a9d6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5184113690 con 0x7f5184104100 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f518a9d6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5184113510 con 0x7f5184108850 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f518a9d6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5184113810 con 0x7f5184103750 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f51837fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 0x7f5184075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f51837fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 0x7f5184075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44802/0 (socket says 172.21.15.86:44802) 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f51837fe700 1 -- 172.21.15.86:0/3835385579 learned_addr learned my addr 172.21.15.86:0/3835385579 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.132+0000 7f5188f73700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5184108850 0x7f5184076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f5183fff700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5184103750 0x7f51840757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51837fe700 1 -- 172.21.15.86:0/3835385579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5184103750 msgr2=0x7f51840757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51837fe700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5184103750 0x7f51840757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51837fe700 1 -- 172.21.15.86:0/3835385579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5184108850 msgr2=0x7f5184076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51837fe700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5184108850 0x7f5184076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51837fe700 1 -- 172.21.15.86:0/3835385579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51841a8030 con 0x7f5184104100 2024-05-12T11:07:40.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f5188f73700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5184108850 0x7f5184076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:07:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f5183fff700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5184103750 0x7f51840757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51837fe700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 0x7f5184075ce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f517800b580 tx=0x7f51780037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51817fa700 1 -- 172.21.15.86:0/3835385579 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178027070 con 0x7f5184104100 2024-05-12T11:07:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51841a82c0 con 0x7f5184104100 2024-05-12T11:07:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51817fa700 1 -- 172.21.15.86:0/3835385579 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5178004110 con 0x7f5184104100 2024-05-12T11:07:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f51817fa700 1 -- 172.21.15.86:0/3835385579 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517800f460 con 0x7f5184104100 2024-05-12T11:07:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.133+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51841a8710 con 0x7f5184104100 2024-05-12T11:07:40.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.134+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f518406a190 con 0x7f5184104100 2024-05-12T11:07:40.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.135+0000 7f51817fa700 1 -- 172.21.15.86:0/3835385579 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f517802a070 con 0x7f5184104100 2024-05-12T11:07:40.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.136+0000 7f51817fa700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f516c0b2910 0x7f516c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:40.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.136+0000 7f5183fff700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f516c0b2910 0x7f516c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:40.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.136+0000 7f51817fa700 1 -- 172.21.15.86:0/3835385579 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f51780e37b0 con 0x7f5184104100 2024-05-12T11:07:40.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.137+0000 7f5183fff700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f516c0b2910 0x7f516c0b4dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5174007900 tx=0x7f5174008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:40.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.140+0000 7f51817fa700 1 -- 172.21.15.86:0/3835385579 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5178031070 con 0x7f5184104100 2024-05-12T11:07:40.138 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:40.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:39 smithi086 ceph-mon[30110]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:40.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:39 smithi172 ceph-mon[34517]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:40.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:39 smithi176 ceph-mon[34357]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:40.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.359+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f518410ba90 con 0x7f5184104100 2024-05-12T11:07:40.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.359+0000 7f51817fa700 1 -- 172.21.15.86:0/3835385579 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5178013070 con 0x7f5184104100 2024-05-12T11:07:40.351 INFO:teuthology.orchestra.run.smithi086.stdout:283467841575 2024-05-12T11:07:40.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f516c0b2910 msgr2=0x7f516c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:40.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f516c0b2910 0x7f516c0b4dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5174007900 tx=0x7f5174008040 comp rx=0 tx=0).stop 2024-05-12T11:07:40.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 msgr2=0x7f5184075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:40.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 0x7f5184075ce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f517800b580 tx=0x7f51780037c0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 shutdown_connections 2024-05-12T11:07:40.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f516c0b2910 0x7f516c0b4dd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5184108850 0x7f5184076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5184103750 0x7f51840757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 --2- 172.21.15.86:0/3835385579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5184104100 0x7f5184075ce0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:40.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.361+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 >> 172.21.15.86:0/3835385579 conn(0x7f518407a600 msgr2=0x7f5184102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:40.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.362+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 shutdown_connections 2024-05-12T11:07:40.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:40.362+0000 7f518a9d6700 1 -- 172.21.15.86:0/3835385579 wait complete. 2024-05-12T11:07:40.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:40 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3835385579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-12T11:07:41.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:40 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3835385579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-12T11:07:41.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:40 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3835385579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-12T11:07:42.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:41 smithi086 ceph-mon[30110]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:42.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:41 smithi172 ceph-mon[34517]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:42.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:41 smithi176 ceph-mon[34357]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:07:43.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 -- 172.21.15.86:0/2028871850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 msgr2=0x7f7600107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:43.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 --2- 172.21.15.86:0/2028871850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 0x7f7600107030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0099c0 tx=0x7f75ec009cd0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 -- 172.21.15.86:0/2028871850 shutdown_connections 2024-05-12T11:07:43.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 --2- 172.21.15.86:0/2028871850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7600107760 0x7f760010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 --2- 172.21.15.86:0/2028871850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7600102e00 0x7f76001031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 --2- 172.21.15.86:0/2028871850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 0x7f7600107030 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 -- 172.21.15.86:0/2028871850 >> 172.21.15.86:0/2028871850 conn(0x7f7600078a10 msgr2=0x7f76000ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 -- 172.21.15.86:0/2028871850 shutdown_connections 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 -- 172.21.15.86:0/2028871850 wait complete. 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.723+0000 7f760702c700 1 Processor -- start 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f760702c700 1 -- start start 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f760702c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7600102e00 0x7f760019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f760702c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 0x7f760019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f760702c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7600107760 0x7f76001998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f760702c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7600112540 con 0x7f76001037b0 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f760702c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76001123c0 con 0x7f7600102e00 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f760702c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76001126c0 con 0x7f7600107760 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 0x7f760019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:43.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 0x7f760019fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52170/0 (socket says 172.21.15.86:52170) 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 -- 172.21.15.86:0/715560055 learned_addr learned my addr 172.21.15.86:0/715560055 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f7604dc8700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7600102e00 0x7f760019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f76055c9700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7600107760 0x7f76001998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 -- 172.21.15.86:0/715560055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7600107760 msgr2=0x7f76001998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7600107760 0x7f76001998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 -- 172.21.15.86:0/715560055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7600102e00 msgr2=0x7f760019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7600102e00 0x7f760019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 -- 172.21.15.86:0/715560055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760019a040 con 0x7f76001037b0 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.724+0000 7f75fffff700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 0x7f760019fc10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00b580 tx=0x7f75ec0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.725+0000 7f75fdffb700 1 -- 172.21.15.86:0/715560055 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec027070 con 0x7f76001037b0 2024-05-12T11:07:43.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.725+0000 7f75fdffb700 1 -- 172.21.15.86:0/715560055 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ec004020 con 0x7f76001037b0 2024-05-12T11:07:43.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.725+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760019a2d0 con 0x7f76001037b0 2024-05-12T11:07:43.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.725+0000 7f75fdffb700 1 -- 172.21.15.86:0/715560055 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec022e10 con 0x7f76001037b0 2024-05-12T11:07:43.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.726+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76001a65a0 con 0x7f76001037b0 2024-05-12T11:07:43.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.727+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760006a190 con 0x7f76001037b0 2024-05-12T11:07:43.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.728+0000 7f75fdffb700 1 -- 172.21.15.86:0/715560055 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f75ec02a070 con 0x7f76001037b0 2024-05-12T11:07:43.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.728+0000 7f75fdffb700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f75f00b2910 0x7f75f00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:43.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.728+0000 7f7604dc8700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f75f00b2910 0x7f75f00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:43.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.728+0000 7f75fdffb700 1 -- 172.21.15.86:0/715560055 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f75ec0e3110 con 0x7f76001037b0 2024-05-12T11:07:43.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.729+0000 7f7604dc8700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f75f00b2910 0x7f75f00b4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7600108ea0 tx=0x7f75f400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:43.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.733+0000 7f75fdffb700 1 -- 172.21.15.86:0/715560055 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f75ec013070 con 0x7f76001037b0 2024-05-12T11:07:43.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.957+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f7600103bc0 con 0x7f76001037b0 2024-05-12T11:07:43.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.958+0000 7f75fdffb700 1 -- 172.21.15.86:0/715560055 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f75ec0aad40 con 0x7f76001037b0 2024-05-12T11:07:43.949 INFO:teuthology.orchestra.run.smithi086.stdout:309237645348 2024-05-12T11:07:43.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f75f00b2910 msgr2=0x7f75f00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:43.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f75f00b2910 0x7f75f00b4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7600108ea0 tx=0x7f75f400a380 comp rx=0 tx=0).stop 2024-05-12T11:07:43.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 msgr2=0x7f760019fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:43.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 0x7f760019fc10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00b580 tx=0x7f75ec0047b0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 shutdown_connections 2024-05-12T11:07:43.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f75f00b2910 0x7f75f00b4dd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7600107760 0x7f76001998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7600102e00 0x7f760019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 --2- 172.21.15.86:0/715560055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76001037b0 0x7f760019fc10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:43.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 >> 172.21.15.86:0/715560055 conn(0x7f7600078a10 msgr2=0x7f7600101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:43.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 shutdown_connections 2024-05-12T11:07:43.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.960+0000 7f760702c700 1 -- 172.21.15.86:0/715560055 wait complete. 2024-05-12T11:07:43.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:43 smithi086 ceph-mon[30110]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:43.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:43 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/776249087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-12T11:07:44.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:43 smithi172 ceph-mon[34517]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:44.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:43 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/776249087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-12T11:07:44.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:43 smithi176 ceph-mon[34357]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:07:44.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:43 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/776249087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-12T11:07:45.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 -- 172.21.15.86:0/1488706056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 msgr2=0x7f6ba81087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1488706056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 0x7f6ba81087f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009990 tx=0x7f6b98009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 -- 172.21.15.86:0/1488706056 shutdown_connections 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1488706056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8102d60 0x7f6ba810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1488706056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 0x7f6ba81087f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1488706056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ba81023a0 0x7f6ba8102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 -- 172.21.15.86:0/1488706056 >> 172.21.15.86:0/1488706056 conn(0x7f6ba8079350 msgr2=0x7f6ba8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 -- 172.21.15.86:0/1488706056 shutdown_connections 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.066+0000 7f6badd8f700 1 -- 172.21.15.86:0/1488706056 wait complete. 2024-05-12T11:07:45.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6badd8f700 1 Processor -- start 2024-05-12T11:07:45.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6badd8f700 1 -- start start 2024-05-12T11:07:45.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6badd8f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ba81023a0 0x7f6ba8104080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:45.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6badd8f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8102d60 0x7f6ba81045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:45.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6badd8f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 0x7f6ba8104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:45.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6badd8f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8112530 con 0x7f6ba8108410 2024-05-12T11:07:45.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6badd8f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81123b0 con 0x7f6ba8102d60 2024-05-12T11:07:45.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6badd8f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81126b0 con 0x7f6ba81023a0 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.067+0000 7f6ba7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 0x7f6ba8104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 0x7f6ba8104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52226/0 (socket says 172.21.15.86:52226) 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba7fff700 1 -- 172.21.15.86:0/1639598078 learned_addr learned my addr 172.21.15.86:0/1639598078 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba77fe700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ba81023a0 0x7f6ba8104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba6ffd700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8102d60 0x7f6ba81045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba7fff700 1 -- 172.21.15.86:0/1639598078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ba81023a0 msgr2=0x7f6ba8104080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba7fff700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ba81023a0 0x7f6ba8104080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba7fff700 1 -- 172.21.15.86:0/1639598078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8102d60 msgr2=0x7f6ba81045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba7fff700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8102d60 0x7f6ba81045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba7fff700 1 -- 172.21.15.86:0/1639598078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba81a8030 con 0x7f6ba8108410 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba6ffd700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8102d60 0x7f6ba81045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba7fff700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 0x7f6ba8104b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0007d70 tx=0x7f6ba000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba4ff9700 1 -- 172.21.15.86:0/1639598078 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0016020 con 0x7f6ba8108410 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba81a8320 con 0x7f6ba8108410 2024-05-12T11:07:45.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba4ff9700 1 -- 172.21.15.86:0/1639598078 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba000ad40 con 0x7f6ba8108410 2024-05-12T11:07:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.068+0000 7f6ba4ff9700 1 -- 172.21.15.86:0/1639598078 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00115e0 con 0x7f6ba8108410 2024-05-12T11:07:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.069+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba81a8860 con 0x7f6ba8108410 2024-05-12T11:07:45.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.070+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba806a190 con 0x7f6ba8108410 2024-05-12T11:07:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.071+0000 7f6ba4ff9700 1 -- 172.21.15.86:0/1639598078 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6ba0019020 con 0x7f6ba8108410 2024-05-12T11:07:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.072+0000 7f6ba4ff9700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6b900b2900 0x7f6b900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.072+0000 7f6ba77fe700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6b900b2900 0x7f6b900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.072+0000 7f6ba4ff9700 1 -- 172.21.15.86:0/1639598078 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6ba00e2180 con 0x7f6ba8108410 2024-05-12T11:07:45.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.072+0000 7f6ba77fe700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6b900b2900 0x7f6b900b4dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b98006010 tx=0x7f6b9801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:45.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.076+0000 7f6ba4ff9700 1 -- 172.21.15.86:0/1639598078 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6ba0020020 con 0x7f6ba8108410 2024-05-12T11:07:45.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.629+0000 7f8717b67700 1 -- 172.21.15.86:0/1102880069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102630 msgr2=0x7f8710102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.629+0000 7f8717b67700 1 --2- 172.21.15.86:0/1102880069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102630 0x7f8710102a10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f870c0099c0 tx=0x7f870c009cd0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 -- 172.21.15.86:0/1102880069 shutdown_connections 2024-05-12T11:07:45.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 --2- 172.21.15.86:0/1102880069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87101076c0 0x7f871010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 --2- 172.21.15.86:0/1102880069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102630 0x7f8710102a10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 --2- 172.21.15.86:0/1102880069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8710102fe0 0x7f8710106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 -- 172.21.15.86:0/1102880069 >> 172.21.15.86:0/1102880069 conn(0x7f8710079350 msgr2=0x7f8710079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:45.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 -- 172.21.15.86:0/1102880069 shutdown_connections 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 -- 172.21.15.86:0/1102880069 wait complete. 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 Processor -- start 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 -- start start 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8710102630 0x7f871019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102fe0 0x7f871019af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87101076c0 0x7f87101a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8710112620 con 0x7f8710102fe0 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87101124a0 con 0x7f8710102630 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.630+0000 7f8717b67700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87101127a0 con 0x7f87101076c0 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102fe0 0x7f871019af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:45.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102fe0 0x7f871019af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52152/0 (socket says 172.21.15.86:52152) 2024-05-12T11:07:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 -- 172.21.15.86:0/776249087 learned_addr learned my addr 172.21.15.86:0/776249087 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8716104700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87101076c0 0x7f87101a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715903700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8710102630 0x7f871019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:45.155 INFO:teuthology.orchestra.run.smithi086.stdout:137438953544 2024-05-12T11:07:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 -- 172.21.15.86:0/776249087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87101076c0 msgr2=0x7f87101a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87101076c0 0x7f87101a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 -- 172.21.15.86:0/776249087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8710102630 msgr2=0x7f871019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8710102630 0x7f871019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 -- 172.21.15.86:0/776249087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87101a6000 con 0x7f8710102fe0 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8716104700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87101076c0 0x7f87101a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8715102700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102fe0 0x7f871019af80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f870000b500 tx=0x7f870000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8706ffd700 1 -- 172.21.15.86:0/776249087 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700015020 con 0x7f8710102fe0 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87101a6230 con 0x7f8710102fe0 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8706ffd700 1 -- 172.21.15.86:0/776249087 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8700011ce0 con 0x7f8710102fe0 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8706ffd700 1 -- 172.21.15.86:0/776249087 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700010d40 con 0x7f8710102fe0 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.631+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87101a6740 con 0x7f8710102fe0 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.632+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871006a190 con 0x7f8710102fe0 2024-05-12T11:07:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.634+0000 7f8706ffd700 1 -- 172.21.15.86:0/776249087 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8700018020 con 0x7f8710102fe0 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.634+0000 7f8706ffd700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f86fc0b2910 0x7f86fc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.634+0000 7f8715903700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f86fc0b2910 0x7f86fc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.634+0000 7f8706ffd700 1 -- 172.21.15.86:0/776249087 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f87000e2010 con 0x7f8710102fe0 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.635+0000 7f8715903700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f86fc0b2910 0x7f86fc0b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f870c009fd0 tx=0x7f870c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.638+0000 7f8706ffd700 1 -- 172.21.15.86:0/776249087 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f870001f020 con 0x7f8710102fe0 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.853+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f871006c1c0 con 0x7f8710102fe0 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.853+0000 7f8706ffd700 1 -- 172.21.15.86:0/776249087 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f87000a9cc0 con 0x7f8710102fe0 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f86fc0b2910 msgr2=0x7f86fc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f86fc0b2910 0x7f86fc0b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f870c009fd0 tx=0x7f870c01a040 comp rx=0 tx=0).stop 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102fe0 msgr2=0x7f871019af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102fe0 0x7f871019af80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f870000b500 tx=0x7f870000b8c0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 shutdown_connections 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f86fc0b2910 0x7f86fc0b4dd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87101076c0 0x7f87101a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8710102630 0x7f871019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 --2- 172.21.15.86:0/776249087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8710102fe0 0x7f871019af80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.855+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 >> 172.21.15.86:0/776249087 conn(0x7f8710079350 msgr2=0x7f8710101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:45.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.856+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 shutdown_connections 2024-05-12T11:07:45.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:43.856+0000 7f8717b67700 1 -- 172.21.15.86:0/776249087 wait complete. 2024-05-12T11:07:45.158 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:44 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/715560055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-12T11:07:45.158 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:44 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4152477914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-12T11:07:45.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:44 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/715560055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-12T11:07:45.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:44 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4152477914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-12T11:07:45.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:44 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/715560055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-12T11:07:45.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:44 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4152477914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-12T11:07:45.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.288+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6ba81a8af0 con 0x7f6ba8108410 2024-05-12T11:07:45.279 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.288+0000 7f6ba4ff9700 1 -- 172.21.15.86:0/1639598078 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ba00a9e80 con 0x7f6ba8108410 2024-05-12T11:07:45.279 INFO:teuthology.orchestra.run.smithi086.stdout:34359738460 2024-05-12T11:07:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.290+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6b900b2900 msgr2=0x7f6b900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.290+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6b900b2900 0x7f6b900b4dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b98006010 tx=0x7f6b9801a040 comp rx=0 tx=0).stop 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.290+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 msgr2=0x7f6ba8104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.290+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 0x7f6ba8104b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0007d70 tx=0x7f6ba000a340 comp rx=0 tx=0).stop 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.291+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 shutdown_connections 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.291+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6b900b2900 0x7f6b900b4dc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.291+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba8108410 0x7f6ba8104b00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.291+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ba81023a0 0x7f6ba8104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.291+0000 7f6badd8f700 1 --2- 172.21.15.86:0/1639598078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8102d60 0x7f6ba81045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.291+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 >> 172.21.15.86:0/1639598078 conn(0x7f6ba8079350 msgr2=0x7f6ba8101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.291+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 shutdown_connections 2024-05-12T11:07:45.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.291+0000 7f6badd8f700 1 -- 172.21.15.86:0/1639598078 wait complete. 2024-05-12T11:07:46.098 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:45 smithi086 ceph-mon[30110]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-12T11:07:46.098 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:45 smithi086 ceph-mon[30110]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-12T11:07:46.098 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:45 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2557466627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-12T11:07:46.098 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:45 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1639598078' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.969+0000 7fddc6e46700 1 -- 172.21.15.86:0/2414349889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 msgr2=0x7fddc010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.969+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2414349889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 0x7fddc010f250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fddb800b0a0 tx=0x7fddb800b3b0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.969+0000 7fddc6e46700 1 -- 172.21.15.86:0/2414349889 shutdown_connections 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.969+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2414349889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 0x7fddc010f250 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.969+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2414349889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc0108410 0x7fddc01087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2414349889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddc01023a0 0x7fddc0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 -- 172.21.15.86:0/2414349889 >> 172.21.15.86:0/2414349889 conn(0x7fddc0079350 msgr2=0x7fddc0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 -- 172.21.15.86:0/2414349889 shutdown_connections 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 -- 172.21.15.86:0/2414349889 wait complete. 2024-05-12T11:07:46.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 Processor -- start 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 -- start start 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc01023a0 0x7fddc019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 0x7fddc019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddc0108410 0x7fddc0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fddc01125b0 con 0x7fddc0102d60 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.970+0000 7fddc6e46700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddc0112430 con 0x7fddc01023a0 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddc6e46700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fddc0112730 con 0x7fddc0108410 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 0x7fddc019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 0x7fddc019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52196/0 (socket says 172.21.15.86:52196) 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 -- 172.21.15.86:0/2557466627 learned_addr learned my addr 172.21.15.86:0/2557466627 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddc4be2700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc01023a0 0x7fddc019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddc53e3700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddc0108410 0x7fddc0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:46.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 -- 172.21.15.86:0/2557466627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddc0108410 msgr2=0x7fddc0199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.181 INFO:teuthology.orchestra.run.smithi086.stdout:111669149771 2024-05-12T11:07:46.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddc0108410 0x7fddc0199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 -- 172.21.15.86:0/2557466627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc01023a0 msgr2=0x7fddc019f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc01023a0 0x7fddc019f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 -- 172.21.15.86:0/2557466627 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc019a080 con 0x7fddc0102d60 2024-05-12T11:07:46.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddc4be2700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc01023a0 0x7fddc019f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:46.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddc53e3700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddc0108410 0x7fddc0199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:46.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbffff700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 0x7fddc019fca0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c9b0 tx=0x7fddac00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbdffb700 1 -- 172.21.15.86:0/2557466627 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac007b00 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc019a370 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbdffb700 1 -- 172.21.15.86:0/2557466627 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddac007ca0 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddbdffb700 1 -- 172.21.15.86:0/2557466627 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac018730 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.971+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc0103fb0 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.973+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc006a190 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.974+0000 7fddbdffb700 1 -- 172.21.15.86:0/2557466627 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fddac00f450 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.974+0000 7fddbdffb700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddb00b6c90 0x7fddb00b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.975+0000 7fddc4be2700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddb00b6c90 0x7fddb00b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.975+0000 7fddbdffb700 1 -- 172.21.15.86:0/2557466627 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fddac0e22b0 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.975+0000 7fddc4be2700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddb00b6c90 0x7fddb00b9150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fddc019aa60 tx=0x7fddb4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.979+0000 7fddbdffb700 1 -- 172.21.15.86:0/2557466627 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fddac014030 con 0x7fddc0102d60 2024-05-12T11:07:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.193+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fddc00640b0 con 0x7fddc0102d60 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.193+0000 7fddbdffb700 1 -- 172.21.15.86:0/2557466627 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fddac0a9fb0 con 0x7fddc0102d60 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.195+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddb00b6c90 msgr2=0x7fddb00b9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddb00b6c90 0x7fddb00b9150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fddc019aa60 tx=0x7fddb4008040 comp rx=0 tx=0).stop 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 msgr2=0x7fddc019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 0x7fddc019fca0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c9b0 tx=0x7fddac00cd70 comp rx=0 tx=0).stop 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 shutdown_connections 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fddb00b6c90 0x7fddb00b9150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddc0108410 0x7fddc0199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc01023a0 0x7fddc019f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 --2- 172.21.15.86:0/2557466627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddc0102d60 0x7fddc019fca0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 >> 172.21.15.86:0/2557466627 conn(0x7fddc0079350 msgr2=0x7fddc01015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 shutdown_connections 2024-05-12T11:07:46.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:45.196+0000 7fddc6e46700 1 -- 172.21.15.86:0/2557466627 wait complete. 2024-05-12T11:07:46.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:45 smithi172 ceph-mon[34517]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-12T11:07:46.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:45 smithi172 ceph-mon[34517]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-12T11:07:46.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:45 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2557466627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-12T11:07:46.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:45 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1639598078' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-12T11:07:46.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:45 smithi176 ceph-mon[34357]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-12T11:07:46.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:45 smithi176 ceph-mon[34357]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-12T11:07:46.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:45 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2557466627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-12T11:07:46.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:45 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1639598078' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-12T11:07:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 -- 172.21.15.86:0/3346623404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 msgr2=0x7f10581098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 --2- 172.21.15.86:0/3346623404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 0x7f10581098e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f104c00b0a0 tx=0x7f104c00b3b0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 -- 172.21.15.86:0/3346623404 shutdown_connections 2024-05-12T11:07:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 --2- 172.21.15.86:0/3346623404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f105806c3d0 0x7f1058110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 --2- 172.21.15.86:0/3346623404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 0x7f10581098e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 --2- 172.21.15.86:0/3346623404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105806ba10 0x7f105806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 -- 172.21.15.86:0/3346623404 >> 172.21.15.86:0/3346623404 conn(0x7f1058079310 msgr2=0x7f1058079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 -- 172.21.15.86:0/3346623404 shutdown_connections 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.386+0000 7f105eb6e700 1 -- 172.21.15.86:0/3346623404 wait complete. 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105eb6e700 1 Processor -- start 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105eb6e700 1 -- start start 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105eb6e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f105806ba10 0x7f105819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105eb6e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105806c3d0 0x7f105819c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105eb6e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 0x7f10581a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105eb6e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1058113690 con 0x7f1058109500 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105eb6e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1058113510 con 0x7f105806c3d0 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105eb6e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1058113810 con 0x7f105806ba10 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105d10b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 0x7f10581a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105d10b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 0x7f10581a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52190/0 (socket says 172.21.15.86:52190) 2024-05-12T11:07:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105d10b700 1 -- 172.21.15.86:0/4152477914 learned_addr learned my addr 172.21.15.86:0/4152477914 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:46.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105c90a700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f105806ba10 0x7f105819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:46.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f1057fff700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105806c3d0 0x7f105819c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:46.508 INFO:teuthology.orchestra.run.smithi086.stdout:210453397560 2024-05-12T11:07:46.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105d10b700 1 -- 172.21.15.86:0/4152477914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f105806ba10 msgr2=0x7f105819be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105d10b700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f105806ba10 0x7f105819be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105d10b700 1 -- 172.21.15.86:0/4152477914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105806c3d0 msgr2=0x7f105819c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105d10b700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105806c3d0 0x7f105819c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.387+0000 7f105d10b700 1 -- 172.21.15.86:0/4152477914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10581a0e50 con 0x7f1058109500 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.388+0000 7f105d10b700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 0x7f10581a0710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f105000b550 tx=0x7f105000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.388+0000 7f1055ffb700 1 -- 172.21.15.86:0/4152477914 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050015020 con 0x7f1058109500 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.388+0000 7f1055ffb700 1 -- 172.21.15.86:0/4152477914 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1050011ce0 con 0x7f1058109500 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.388+0000 7f1055ffb700 1 -- 172.21.15.86:0/4152477914 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050010d40 con 0x7f1058109500 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.388+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10581a1140 con 0x7f1058109500 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.388+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10581a89c0 con 0x7f1058109500 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.389+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105806a190 con 0x7f1058109500 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.390+0000 7f1055ffb700 1 -- 172.21.15.86:0/4152477914 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1050018020 con 0x7f1058109500 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.391+0000 7f1055ffb700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f10480b2910 0x7f10480b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.391+0000 7f105c90a700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f10480b2910 0x7f10480b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:46.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.391+0000 7f1055ffb700 1 -- 172.21.15.86:0/4152477914 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f10500e1ff0 con 0x7f1058109500 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.392+0000 7f105c90a700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f10480b2910 0x7f10480b4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f104c00b070 tx=0x7f104c0060c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.395+0000 7f1055ffb700 1 -- 172.21.15.86:0/4152477914 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f105001f020 con 0x7f1058109500 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.605+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f10581a8bf0 con 0x7f1058109500 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.606+0000 7f1055ffb700 1 -- 172.21.15.86:0/4152477914 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f10500a9c60 con 0x7f1058109500 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f10480b2910 msgr2=0x7f10480b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f10480b2910 0x7f10480b4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f104c00b070 tx=0x7f104c0060c0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 msgr2=0x7f10581a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 0x7f10581a0710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f105000b550 tx=0x7f105000b910 comp rx=0 tx=0).stop 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 shutdown_connections 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f10480b2910 0x7f10480b4dd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1058109500 0x7f10581a0710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f105806ba10 0x7f105819be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 --2- 172.21.15.86:0/4152477914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105806c3d0 0x7f105819c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:46.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 >> 172.21.15.86:0/4152477914 conn(0x7f1058079310 msgr2=0x7f105810e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:46.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 shutdown_connections 2024-05-12T11:07:46.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:44.608+0000 7f105eb6e700 1 -- 172.21.15.86:0/4152477914 wait complete. 2024-05-12T11:07:47.085 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:46 smithi086 ceph-mon[30110]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-12T11:07:47.119 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397554 got 210453397560 for osd.7 2024-05-12T11:07:47.119 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:47.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:46 smithi172 ceph-mon[34517]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-12T11:07:47.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:46 smithi176 ceph-mon[34357]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-12T11:07:48.060 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841572 got 283467841575 for osd.10 2024-05-12T11:07:48.060 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:48.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 -- 172.21.15.86:0/1101926258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 msgr2=0x7f356410f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:48.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 --2- 172.21.15.86:0/1101926258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 0x7f356410f240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f355c00b0a0 tx=0x7f355c00b3b0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 -- 172.21.15.86:0/1101926258 shutdown_connections 2024-05-12T11:07:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 --2- 172.21.15.86:0/1101926258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 0x7f356410f240 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 --2- 172.21.15.86:0/1101926258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3564108400 0x7f35641087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 --2- 172.21.15.86:0/1101926258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3564102390 0x7f3564102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 -- 172.21.15.86:0/1101926258 >> 172.21.15.86:0/1101926258 conn(0x7f3564079310 msgr2=0x7f3564079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 -- 172.21.15.86:0/1101926258 shutdown_connections 2024-05-12T11:07:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.286+0000 7f356afcb700 1 -- 172.21.15.86:0/1101926258 wait complete. 2024-05-12T11:07:48.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f356afcb700 1 Processor -- start 2024-05-12T11:07:48.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f356afcb700 1 -- start start 2024-05-12T11:07:48.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f356afcb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3564102390 0x7f35641a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:48.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f356afcb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 0x7f35641a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:48.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f356afcb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3564108400 0x7f356419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:48.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f356afcb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3564112520 con 0x7f3564102d50 2024-05-12T11:07:48.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f356afcb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35641123a0 con 0x7f3564108400 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f356afcb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35641126a0 con 0x7f3564102390 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f3563fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 0x7f35641a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f3563fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 0x7f35641a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52244/0 (socket says 172.21.15.86:52244) 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f3563fff700 1 -- 172.21.15.86:0/1931873654 learned_addr learned my addr 172.21.15.86:0/1931873654 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.287+0000 7f3568d67700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3564102390 0x7f35641a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3569568700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3564108400 0x7f356419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3563fff700 1 -- 172.21.15.86:0/1931873654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3564102390 msgr2=0x7f35641a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3563fff700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3564102390 0x7f35641a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3563fff700 1 -- 172.21.15.86:0/1931873654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3564108400 msgr2=0x7f356419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3563fff700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3564108400 0x7f356419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3563fff700 1 -- 172.21.15.86:0/1931873654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356419c1c0 con 0x7f3564102d50 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3569568700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3564108400 0x7f356419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3563fff700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 0x7f35641a1de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f355000d950 tx=0x7f355000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:48.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3561ffb700 1 -- 172.21.15.86:0/1931873654 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550016070 con 0x7f3564102d50 2024-05-12T11:07:48.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356419c4b0 con 0x7f3564102d50 2024-05-12T11:07:48.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.288+0000 7f3561ffb700 1 -- 172.21.15.86:0/1931873654 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3550009df0 con 0x7f3564102d50 2024-05-12T11:07:48.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.289+0000 7f3561ffb700 1 -- 172.21.15.86:0/1931873654 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355000f3c0 con 0x7f3564102d50 2024-05-12T11:07:48.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.289+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35641a8770 con 0x7f3564102d50 2024-05-12T11:07:48.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.290+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356406a190 con 0x7f3564102d50 2024-05-12T11:07:48.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.291+0000 7f3561ffb700 1 -- 172.21.15.86:0/1931873654 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3550019070 con 0x7f3564102d50 2024-05-12T11:07:48.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.291+0000 7f3561ffb700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f35540b2880 0x7f35540b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:48.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.292+0000 7f3568d67700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f35540b2880 0x7f35540b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:48.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.292+0000 7f3561ffb700 1 -- 172.21.15.86:0/1931873654 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f35500e1e60 con 0x7f3564102d50 2024-05-12T11:07:48.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.292+0000 7f3568d67700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f35540b2880 0x7f35540b4d40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f356419cba0 tx=0x7f355800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:48.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.298+0000 7f3561ffb700 1 -- 172.21.15.86:0/1931873654 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f35500a9b60 con 0x7f3564102d50 2024-05-12T11:07:48.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.507+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f35641a89a0 con 0x7f3564102d50 2024-05-12T11:07:48.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.508+0000 7f3561ffb700 1 -- 172.21.15.86:0/1931873654 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f35500a9460 con 0x7f3564102d50 2024-05-12T11:07:48.499 INFO:teuthology.orchestra.run.smithi086.stdout:163208757316 2024-05-12T11:07:48.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f35540b2880 msgr2=0x7f35540b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:48.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f35540b2880 0x7f35540b4d40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f356419cba0 tx=0x7f355800b410 comp rx=0 tx=0).stop 2024-05-12T11:07:48.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 msgr2=0x7f35641a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:48.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 0x7f35641a1de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f355000d950 tx=0x7f355000dc60 comp rx=0 tx=0).stop 2024-05-12T11:07:48.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 shutdown_connections 2024-05-12T11:07:48.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f35540b2880 0x7f35540b4d40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3564108400 0x7f356419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3564102390 0x7f35641a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 --2- 172.21.15.86:0/1931873654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3564102d50 0x7f35641a1de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 >> 172.21.15.86:0/1931873654 conn(0x7f3564079310 msgr2=0x7f356406b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 shutdown_connections 2024-05-12T11:07:48.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:48.510+0000 7f356afcb700 1 -- 172.21.15.86:0/1931873654 wait complete. 2024-05-12T11:07:48.823 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149767 got 111669149771 for osd.3 2024-05-12T11:07:48.823 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:49.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:49 smithi086 ceph-mon[30110]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-12T11:07:49.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:49 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1931873654' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-12T11:07:49.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:49 smithi172 ceph-mon[34517]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-12T11:07:49.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:49 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1931873654' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-12T11:07:49.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:49 smithi176 ceph-mon[34357]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-12T11:07:49.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:49 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1931873654' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-12T11:07:49.606 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953538 got 137438953544 for osd.4 2024-05-12T11:07:49.606 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:50.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 -- 172.21.15.86:0/848749619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c1076c0 msgr2=0x7f972c10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 --2- 172.21.15.86:0/848749619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c1076c0 0x7f972c10f290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97240099c0 tx=0x7f9724009cd0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 -- 172.21.15.86:0/848749619 shutdown_connections 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 --2- 172.21.15.86:0/848749619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c1076c0 0x7f972c10f290 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 --2- 172.21.15.86:0/848749619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f972c102630 0x7f972c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 --2- 172.21.15.86:0/848749619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f972c102fe0 0x7f972c106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 -- 172.21.15.86:0/848749619 >> 172.21.15.86:0/848749619 conn(0x7f972c079370 msgr2=0x7f972c079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 -- 172.21.15.86:0/848749619 shutdown_connections 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 -- 172.21.15.86:0/848749619 wait complete. 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.120+0000 7f9731d71700 1 Processor -- start 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f9731d71700 1 -- start start 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f9731d71700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c102630 0x7f972c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f9731d71700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f972c102fe0 0x7f972c19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:50.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f9731d71700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f972c1076c0 0x7f972c1a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f9731d71700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f972c112650 con 0x7f972c102630 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f9731d71700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1124d0 con 0x7f972c102fe0 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f9731d71700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1127d0 con 0x7f972c1076c0 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c102630 0x7f972c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c102630 0x7f972c19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52268/0 (socket says 172.21.15.86:52268) 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 -- 172.21.15.86:0/3279119051 learned_addr learned my addr 172.21.15.86:0/3279119051 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972affd700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f972c102fe0 0x7f972c19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972bfff700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f972c1076c0 0x7f972c1a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 -- 172.21.15.86:0/3279119051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f972c1076c0 msgr2=0x7f972c1a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f972c1076c0 0x7f972c1a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 -- 172.21.15.86:0/3279119051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f972c102fe0 msgr2=0x7f972c19afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f972c102fe0 0x7f972c19afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 -- 172.21.15.86:0/3279119051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c1a6050 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972bfff700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f972c1076c0 0x7f972c1a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.121+0000 7f972b7fe700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c102630 0x7f972c19aa90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f971c00ba50 tx=0x7f971c00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.122+0000 7f9728ff9700 1 -- 172.21.15.86:0/3279119051 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c019070 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.122+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f972c1a6280 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.122+0000 7f9728ff9700 1 -- 172.21.15.86:0/3279119051 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f971c014440 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.122+0000 7f9728ff9700 1 -- 172.21.15.86:0/3279119051 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0075d0 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.122+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f972c1a67c0 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.123+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972c06a190 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.124+0000 7f9728ff9700 1 -- 172.21.15.86:0/3279119051 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f971c01c070 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.124+0000 7f9728ff9700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f97140b2880 0x7f97140b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.125+0000 7f972affd700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f97140b2880 0x7f97140b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.125+0000 7f9728ff9700 1 -- 172.21.15.86:0/3279119051 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f971c0e1b60 con 0x7f972c102630 2024-05-12T11:07:50.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.125+0000 7f972affd700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f97140b2880 0x7f97140b4d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9720006fd0 tx=0x7f9720008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:50.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.128+0000 7f9728ff9700 1 -- 172.21.15.86:0/3279119051 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f971c0a9860 con 0x7f972c102630 2024-05-12T11:07:50.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.338+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f972c02e510 con 0x7f972c102630 2024-05-12T11:07:50.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.339+0000 7f9728ff9700 1 -- 172.21.15.86:0/3279119051 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f971c0a9160 con 0x7f972c102630 2024-05-12T11:07:50.330 INFO:teuthology.orchestra.run.smithi086.stdout:188978561087 2024-05-12T11:07:50.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f97140b2880 msgr2=0x7f97140b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:50.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f97140b2880 0x7f97140b4d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9720006fd0 tx=0x7f9720008040 comp rx=0 tx=0).stop 2024-05-12T11:07:50.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c102630 msgr2=0x7f972c19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:50.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c102630 0x7f972c19aa90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f971c00ba50 tx=0x7f971c00be10 comp rx=0 tx=0).stop 2024-05-12T11:07:50.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 shutdown_connections 2024-05-12T11:07:50.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f97140b2880 0x7f97140b4d40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f972c1076c0 0x7f972c1a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f972c102630 0x7f972c19aa90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 --2- 172.21.15.86:0/3279119051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f972c102fe0 0x7f972c19afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:50.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 >> 172.21.15.86:0/3279119051 conn(0x7f972c079370 msgr2=0x7f972c101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:50.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 shutdown_connections 2024-05-12T11:07:50.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:50.341+0000 7f9731d71700 1 -- 172.21.15.86:0/3279119051 wait complete. 2024-05-12T11:07:50.991 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757310 got 163208757316 for osd.5 2024-05-12T11:07:50.992 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:51.319 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:51 smithi086 ceph-mon[30110]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-12T11:07:51.320 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:51 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3279119051' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-12T11:07:51.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:51 smithi172 ceph-mon[34517]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-12T11:07:51.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:51 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3279119051' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-12T11:07:51.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:51 smithi176 ceph-mon[34357]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-12T11:07:51.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:51 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3279119051' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-12T11:07:51.748 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561081 got 188978561087 for osd.6 2024-05-12T11:07:51.749 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:52.122 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:52.157 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645344 got 309237645348 for osd.11 2024-05-12T11:07:52.158 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:52.484 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:52.484 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:07:52.515 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738457 got 34359738460 for osd.0 2024-05-12T11:07:52.515 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:53.343 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:53 smithi086 ceph-mon[30110]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-12T11:07:53.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:53 smithi172 ceph-mon[34517]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-12T11:07:53.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:53 smithi176 ceph-mon[34357]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-12T11:07:55.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/3244700326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0108850 msgr2=0x7f3ba01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:55.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/3244700326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0108850 0x7f3ba01103d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800b0d0 tx=0x7f3b9800b3e0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/3244700326 shutdown_connections 2024-05-12T11:07:55.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/3244700326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0108850 0x7f3ba01103d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/3244700326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba0103750 0x7f3ba0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/3244700326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba0104100 0x7f3ba0108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/3244700326 >> 172.21.15.86:0/3244700326 conn(0x7f3ba007a600 msgr2=0x7f3ba007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:55.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/3244700326 shutdown_connections 2024-05-12T11:07:55.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.360+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/3244700326 wait complete. 2024-05-12T11:07:55.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.361+0000 7f3ba4ba6700 1 Processor -- start 2024-05-12T11:07:55.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.361+0000 7f3ba4ba6700 1 -- start start 2024-05-12T11:07:55.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.361+0000 7f3ba4ba6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0103750 0x7f3ba019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:55.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.361+0000 7f3ba4ba6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba0104100 0x7f3ba019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:55.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.361+0000 7f3ba4ba6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba0108850 0x7f3ba01998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3ba4ba6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0113690 con 0x7f3ba0103750 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3ba4ba6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0113510 con 0x7f3ba0108850 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3ba4ba6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0113810 con 0x7f3ba0104100 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0103750 0x7f3ba019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0103750 0x7f3ba019f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57796/0 (socket says 172.21.15.86:57796) 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 -- 172.21.15.86:0/4127197949 learned_addr learned my addr 172.21.15.86:0/4127197949 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9dd9b700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba0104100 0x7f3ba019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9ed9d700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba0108850 0x7f3ba01998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 -- 172.21.15.86:0/4127197949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba0104100 msgr2=0x7f3ba019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba0104100 0x7f3ba019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 -- 172.21.15.86:0/4127197949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba0108850 msgr2=0x7f3ba01998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba0108850 0x7f3ba01998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 -- 172.21.15.86:0/4127197949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba019a050 con 0x7f3ba0103750 2024-05-12T11:07:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b9e59c700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0103750 0x7f3ba019f730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000d950 tx=0x7f3b9000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b8f7fe700 1 -- 172.21.15.86:0/4127197949 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90016070 con 0x7f3ba0103750 2024-05-12T11:07:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b8f7fe700 1 -- 172.21.15.86:0/4127197949 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b90010460 con 0x7f3ba0103750 2024-05-12T11:07:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba019a340 con 0x7f3ba0103750 2024-05-12T11:07:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3b8f7fe700 1 -- 172.21.15.86:0/4127197949 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9000f620 con 0x7f3ba0103750 2024-05-12T11:07:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.362+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba01a6600 con 0x7f3ba0103750 2024-05-12T11:07:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.363+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba006a190 con 0x7f3ba0103750 2024-05-12T11:07:55.356 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:55 smithi086 ceph-mon[30110]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-12T11:07:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.365+0000 7f3b8f7fe700 1 -- 172.21.15.86:0/4127197949 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3b90019070 con 0x7f3ba0103750 2024-05-12T11:07:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.365+0000 7f3b8f7fe700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3b880b2900 0x7f3b880b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.366+0000 7f3b9dd9b700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3b880b2900 0x7f3b880b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.366+0000 7f3b8f7fe700 1 -- 172.21.15.86:0/4127197949 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3b900e1e50 con 0x7f3ba0103750 2024-05-12T11:07:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.366+0000 7f3b9dd9b700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3b880b2900 0x7f3b880b4dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ba01030a0 tx=0x7f3b94005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:55.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.369+0000 7f3b8f7fe700 1 -- 172.21.15.86:0/4127197949 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3b900a9b50 con 0x7f3ba0103750 2024-05-12T11:07:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:55 smithi172 ceph-mon[34517]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-12T11:07:55.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:55 smithi176 ceph-mon[34357]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-12T11:07:55.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.578+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f3ba002e510 con 0x7f3ba0103750 2024-05-12T11:07:55.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.579+0000 7f3b8f7fe700 1 -- 172.21.15.86:0/4127197949 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3b900a9450 con 0x7f3ba0103750 2024-05-12T11:07:55.570 INFO:teuthology.orchestra.run.smithi086.stdout:236223201334 2024-05-12T11:07:55.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3b880b2900 msgr2=0x7f3b880b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:55.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3b880b2900 0x7f3b880b4dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ba01030a0 tx=0x7f3b94005eb0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0103750 msgr2=0x7f3ba019f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:55.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0103750 0x7f3ba019f730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000d950 tx=0x7f3b9000dd10 comp rx=0 tx=0).stop 2024-05-12T11:07:55.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 shutdown_connections 2024-05-12T11:07:55.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3b880b2900 0x7f3b880b4dc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba0108850 0x7f3ba01998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba0103750 0x7f3ba019f730 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 --2- 172.21.15.86:0/4127197949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba0104100 0x7f3ba019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:55.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 >> 172.21.15.86:0/4127197949 conn(0x7f3ba007a600 msgr2=0x7f3ba0101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:55.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 shutdown_connections 2024-05-12T11:07:55.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:55.581+0000 7f3ba4ba6700 1 -- 172.21.15.86:0/4127197949 wait complete. 2024-05-12T11:07:56.417 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:56 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4127197949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-12T11:07:56.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:56 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4127197949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-12T11:07:56.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:56 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4127197949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-12T11:07:57.021 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201328 got 236223201334 for osd.8 2024-05-12T11:07:57.022 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:57.267 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:57 smithi086 ceph-mon[30110]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-12T11:07:57.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:57 smithi172 ceph-mon[34517]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-12T11:07:57.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:57 smithi176 ceph-mon[34357]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-12T11:07:57.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 -- 172.21.15.86:0/3468694871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898102450 msgr2=0x7f7898110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:57.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 --2- 172.21.15.86:0/3468694871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898102450 0x7f7898110340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f789000b0a0 tx=0x7f789000b3b0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 -- 172.21.15.86:0/3468694871 shutdown_connections 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 --2- 172.21.15.86:0/3468694871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898102450 0x7f7898110340 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 --2- 172.21.15.86:0/3468694871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7898109520 0x7f7898109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 --2- 172.21.15.86:0/3468694871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7898101a90 0x7f7898101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 -- 172.21.15.86:0/3468694871 >> 172.21.15.86:0/3468694871 conn(0x7f7898078a10 msgr2=0x7f78980ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 -- 172.21.15.86:0/3468694871 shutdown_connections 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 -- 172.21.15.86:0/3468694871 wait complete. 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 Processor -- start 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.582+0000 7f78a0781700 1 -- start start 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f78a0781700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898101a90 0x7f789819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f78a0781700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7898102450 0x7f789819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f78a0781700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7898109520 0x7f7898199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:57.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f78a0781700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7898113650 con 0x7f7898101a90 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f78a0781700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78981134d0 con 0x7f7898102450 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f78a0781700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78981137d0 con 0x7f7898109520 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898101a90 0x7f789819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898101a90 0x7f789819f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57840/0 (socket says 172.21.15.86:57840) 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 -- 172.21.15.86:0/615373634 learned_addr learned my addr 172.21.15.86:0/615373634 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789ed1e700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7898109520 0x7f7898199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789dd1c700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7898102450 0x7f789819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 -- 172.21.15.86:0/615373634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7898109520 msgr2=0x7f7898199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7898109520 0x7f7898199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 -- 172.21.15.86:0/615373634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7898102450 msgr2=0x7f789819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7898102450 0x7f789819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 -- 172.21.15.86:0/615373634 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789819a0b0 con 0x7f7898101a90 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789dd1c700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7898102450 0x7f789819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:57.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f789e51d700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898101a90 0x7f789819f790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f789400d980 tx=0x7f789400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:57.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f788f7fe700 1 -- 172.21.15.86:0/615373634 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894017070 con 0x7f7898101a90 2024-05-12T11:07:57.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f788f7fe700 1 -- 172.21.15.86:0/615373634 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7894005020 con 0x7f7898101a90 2024-05-12T11:07:57.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789819a3a0 con 0x7f7898101a90 2024-05-12T11:07:57.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f788f7fe700 1 -- 172.21.15.86:0/615373634 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894009b50 con 0x7f7898101a90 2024-05-12T11:07:57.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.583+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78981a6660 con 0x7f7898101a90 2024-05-12T11:07:57.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.584+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f789806a190 con 0x7f7898101a90 2024-05-12T11:07:57.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.586+0000 7f788f7fe700 1 -- 172.21.15.86:0/615373634 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f78940051d0 con 0x7f7898101a90 2024-05-12T11:07:57.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.587+0000 7f788f7fe700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f78840b2880 0x7f78840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:57.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.587+0000 7f789dd1c700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f78840b2880 0x7f78840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:57.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.587+0000 7f788f7fe700 1 -- 172.21.15.86:0/615373634 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f78940e2540 con 0x7f7898101a90 2024-05-12T11:07:57.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.587+0000 7f789dd1c700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f78840b2880 0x7f78840b4d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7888005fd0 tx=0x7f7888005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:57.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.590+0000 7f788f7fe700 1 -- 172.21.15.86:0/615373634 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7894020020 con 0x7f7898101a90 2024-05-12T11:07:57.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.805+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f789802e510 con 0x7f7898101a90 2024-05-12T11:07:57.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.805+0000 7f788f7fe700 1 -- 172.21.15.86:0/615373634 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f78940054f0 con 0x7f7898101a90 2024-05-12T11:07:57.797 INFO:teuthology.orchestra.run.smithi086.stdout:77309411413 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f78840b2880 msgr2=0x7f78840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f78840b2880 0x7f78840b4d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7888005fd0 tx=0x7f7888005ee0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898101a90 msgr2=0x7f789819f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898101a90 0x7f789819f790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f789400d980 tx=0x7f789400dc90 comp rx=0 tx=0).stop 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 shutdown_connections 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f78840b2880 0x7f78840b4d40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7898109520 0x7f7898199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7898101a90 0x7f789819f790 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 --2- 172.21.15.86:0/615373634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7898102450 0x7f789819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:57.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 >> 172.21.15.86:0/615373634 conn(0x7f7898078a10 msgr2=0x7f78981001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:57.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 shutdown_connections 2024-05-12T11:07:57.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.808+0000 7f78a0781700 1 -- 172.21.15.86:0/615373634 wait complete. 2024-05-12T11:07:58.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.275+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3143951333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c24108420 msgr2=0x7f6c24108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.275+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3143951333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c24108420 0x7f6c24108800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009990 tx=0x7f6c20009ca0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.276+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3143951333 shutdown_connections 2024-05-12T11:07:58.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.276+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3143951333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c24102d80 0x7f6c2410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.276+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3143951333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c24108420 0x7f6c24108800 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.276+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3143951333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c241023e0 0x7f6c24102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.276+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3143951333 >> 172.21.15.86:0/3143951333 conn(0x7f6c240792d0 msgr2=0x7f6c240796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:58.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.276+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3143951333 shutdown_connections 2024-05-12T11:07:58.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.276+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3143951333 wait complete. 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2bf82700 1 Processor -- start 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2bf82700 1 -- start start 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2bf82700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c241023e0 0x7f6c2419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2bf82700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c24102d80 0x7f6c2419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2bf82700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c24108420 0x7f6c24199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2bf82700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6c24112590 con 0x7f6c241023e0 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2bf82700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6c24112410 con 0x7f6c24102d80 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2bf82700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6c24112710 con 0x7f6c24108420 2024-05-12T11:07:58.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c29d1e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c241023e0 0x7f6c2419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c29d1e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c241023e0 0x7f6c2419f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57856/0 (socket says 172.21.15.86:57856) 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c29d1e700 1 -- 172.21.15.86:0/3490328063 learned_addr learned my addr 172.21.15.86:0/3490328063 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.277+0000 7f6c2a51f700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c24108420 0x7f6c24199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c2951d700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c24102d80 0x7f6c2419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c29d1e700 1 -- 172.21.15.86:0/3490328063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c24108420 msgr2=0x7f6c24199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c29d1e700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c24108420 0x7f6c24199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c29d1e700 1 -- 172.21.15.86:0/3490328063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c24102d80 msgr2=0x7f6c2419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c29d1e700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c24102d80 0x7f6c2419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c29d1e700 1 -- 172.21.15.86:0/3490328063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2419a1c0 con 0x7f6c241023e0 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c2a51f700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c24108420 0x7f6c24199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c2951d700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c24102d80 0x7f6c2419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c29d1e700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c241023e0 0x7f6c2419f850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6c20000c00 tx=0x7f6c200047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:58.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c1affd700 1 -- 172.21.15.86:0/3490328063 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20027070 con 0x7f6c241023e0 2024-05-12T11:07:58.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c1affd700 1 -- 172.21.15.86:0/3490328063 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c200041d0 con 0x7f6c241023e0 2024-05-12T11:07:58.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2419a450 con 0x7f6c241023e0 2024-05-12T11:07:58.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c1affd700 1 -- 172.21.15.86:0/3490328063 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000f460 con 0x7f6c241023e0 2024-05-12T11:07:58.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.278+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c24109230 con 0x7f6c241023e0 2024-05-12T11:07:58.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.279+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c24103ad0 con 0x7f6c241023e0 2024-05-12T11:07:58.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.281+0000 7f6c1affd700 1 -- 172.21.15.86:0/3490328063 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6c2002a070 con 0x7f6c241023e0 2024-05-12T11:07:58.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.281+0000 7f6c1affd700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6c100b2880 0x7f6c100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:58.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.282+0000 7f6c2951d700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6c100b2880 0x7f6c100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:58.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.282+0000 7f6c1affd700 1 -- 172.21.15.86:0/3490328063 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6c200e3670 con 0x7f6c241023e0 2024-05-12T11:07:58.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.282+0000 7f6c2951d700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6c100b2880 0x7f6c100b4d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c24079860 tx=0x7f6c14008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:58.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.285+0000 7f6c1affd700 1 -- 172.21.15.86:0/3490328063 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6c20031070 con 0x7f6c241023e0 2024-05-12T11:07:58.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:58 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2177625492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-12T11:07:58.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:58 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/615373634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-12T11:07:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:58 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2177625492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-12T11:07:58.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:58 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/615373634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-12T11:07:58.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.491+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6c2419af40 con 0x7f6c241023e0 2024-05-12T11:07:58.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.492+0000 7f6c1affd700 1 -- 172.21.15.86:0/3490328063 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c20013070 con 0x7f6c241023e0 2024-05-12T11:07:58.483 INFO:teuthology.orchestra.run.smithi086.stdout:55834574938 2024-05-12T11:07:58.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6c100b2880 msgr2=0x7f6c100b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6c100b2880 0x7f6c100b4d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c24079860 tx=0x7f6c14008040 comp rx=0 tx=0).stop 2024-05-12T11:07:58.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c241023e0 msgr2=0x7f6c2419f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c241023e0 0x7f6c2419f850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6c20000c00 tx=0x7f6c200047b0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 shutdown_connections 2024-05-12T11:07:58.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f6c100b2880 0x7f6c100b4d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c24108420 0x7f6c24199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c241023e0 0x7f6c2419f850 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 --2- 172.21.15.86:0/3490328063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c24102d80 0x7f6c2419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 >> 172.21.15.86:0/3490328063 conn(0x7f6c240792d0 msgr2=0x7f6c24100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:58.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 shutdown_connections 2024-05-12T11:07:58.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:58.494+0000 7f6c2bf82700 1 -- 172.21.15.86:0/3490328063 wait complete. 2024-05-12T11:07:58.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:58 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2177625492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-12T11:07:58.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:58 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/615373634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-12T11:07:58.709 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411406 got 77309411413 for osd.2 2024-05-12T11:07:58.710 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:58.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 -- 172.21.15.86:0/235076106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e701037b0 msgr2=0x7f7e70103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 --2- 172.21.15.86:0/235076106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e701037b0 0x7f7e70103b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e600099c0 tx=0x7f7e60009cd0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 -- 172.21.15.86:0/235076106 shutdown_connections 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 --2- 172.21.15.86:0/235076106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e70108880 0x7f7e70110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 --2- 172.21.15.86:0/235076106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e701037b0 0x7f7e70103b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 --2- 172.21.15.86:0/235076106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e70104160 0x7f7e70108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 -- 172.21.15.86:0/235076106 >> 172.21.15.86:0/235076106 conn(0x7f7e7007a530 msgr2=0x7f7e7007a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 -- 172.21.15.86:0/235076106 shutdown_connections 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.485+0000 7f7e74a29700 1 -- 172.21.15.86:0/235076106 wait complete. 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e74a29700 1 Processor -- start 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e74a29700 1 -- start start 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e74a29700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e701037b0 0x7f7e700757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e74a29700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e70104160 0x7f7e70075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e74a29700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e70108880 0x7f7e70076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e74a29700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e701136d0 con 0x7f7e70104160 2024-05-12T11:07:58.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e74a29700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70113550 con 0x7f7e70108880 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e74a29700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70113850 con 0x7f7e701037b0 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6dd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e70104160 0x7f7e70075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6dd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e70104160 0x7f7e70075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57820/0 (socket says 172.21.15.86:57820) 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6dd9b700 1 -- 172.21.15.86:0/2177625492 learned_addr learned my addr 172.21.15.86:0/2177625492 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6e59c700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e701037b0 0x7f7e700757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6ed9d700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e70108880 0x7f7e70076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6dd9b700 1 -- 172.21.15.86:0/2177625492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e701037b0 msgr2=0x7f7e700757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6dd9b700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e701037b0 0x7f7e700757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6dd9b700 1 -- 172.21.15.86:0/2177625492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e70108880 msgr2=0x7f7e70076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6dd9b700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e70108880 0x7f7e70076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.486+0000 7f7e6dd9b700 1 -- 172.21.15.86:0/2177625492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e701a7fe0 con 0x7f7e70104160 2024-05-12T11:07:58.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.487+0000 7f7e6dd9b700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e70104160 0x7f7e70075ce0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400c9b0 tx=0x7f7e6400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.487+0000 7f7e5f7fe700 1 -- 172.21.15.86:0/2177625492 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64007b00 con 0x7f7e70104160 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.487+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e701a82d0 con 0x7f7e70104160 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.487+0000 7f7e5f7fe700 1 -- 172.21.15.86:0/2177625492 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e6400ce50 con 0x7f7e70104160 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.487+0000 7f7e5f7fe700 1 -- 172.21.15.86:0/2177625492 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64018660 con 0x7f7e70104160 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.487+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e701a8860 con 0x7f7e70104160 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.488+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7010bac0 con 0x7f7e70104160 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.489+0000 7f7e5f7fe700 1 -- 172.21.15.86:0/2177625492 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7e6400f450 con 0x7f7e70104160 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.490+0000 7f7e5f7fe700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7e580b2880 0x7f7e580b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.490+0000 7f7e6e59c700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7e580b2880 0x7f7e580b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:07:58.812 INFO:teuthology.orchestra.run.smithi086.stdout:261993005105 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.490+0000 7f7e5f7fe700 1 -- 172.21.15.86:0/2177625492 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7e640e21c0 con 0x7f7e70104160 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.491+0000 7f7e6e59c700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7e580b2880 0x7f7e580b4d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009990 tx=0x7f7e60009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.494+0000 7f7e5f7fe700 1 -- 172.21.15.86:0/2177625492 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7e64014030 con 0x7f7e70104160 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.711+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f7e70076c80 con 0x7f7e70104160 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.711+0000 7f7e5f7fe700 1 -- 172.21.15.86:0/2177625492 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7e640a9e60 con 0x7f7e70104160 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.713+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7e580b2880 msgr2=0x7f7e580b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.713+0000 7f7e74a29700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7e580b2880 0x7f7e580b4d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009990 tx=0x7f7e60009650 comp rx=0 tx=0).stop 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e70104160 msgr2=0x7f7e70075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e70104160 0x7f7e70075ce0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400c9b0 tx=0x7f7e6400ccc0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 shutdown_connections 2024-05-12T11:07:58.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f7e580b2880 0x7f7e580b4d40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e70108880 0x7f7e70076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e701037b0 0x7f7e700757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 --2- 172.21.15.86:0/2177625492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e70104160 0x7f7e70075ce0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:07:58.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 >> 172.21.15.86:0/2177625492 conn(0x7f7e7007a530 msgr2=0x7f7e701015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:07:58.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 shutdown_connections 2024-05-12T11:07:58.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:07:57.714+0000 7f7e74a29700 1 -- 172.21.15.86:0/2177625492 wait complete. 2024-05-12T11:07:59.414 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:59 smithi086 ceph-mon[30110]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-12T11:07:59.414 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:07:59 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3490328063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-12T11:07:59.445 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005100 got 261993005105 for osd.9 2024-05-12T11:07:59.445 DEBUG:teuthology.parallel:result is None 2024-05-12T11:07:59.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:59 smithi172 ceph-mon[34517]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-12T11:07:59.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:07:59 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3490328063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-12T11:07:59.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:59 smithi176 ceph-mon[34357]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-12T11:07:59.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:07:59 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3490328063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-12T11:08:00.054 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574932 got 55834574938 for osd.1 2024-05-12T11:08:00.054 DEBUG:teuthology.parallel:result is None 2024-05-12T11:08:00.054 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-12T11:08:00.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-12T11:08:00.303 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:01.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:01 smithi086 ceph-mon[30110]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:08:01.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:01 smithi172 ceph-mon[34517]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:08:01.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:01 smithi176 ceph-mon[34357]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:08:02.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 -- 172.21.15.86:0/3205296110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 msgr2=0x7f5d701103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:02.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 --2- 172.21.15.86:0/3205296110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 0x7f5d701103d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800b0d0 tx=0x7f5d6800b3e0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 -- 172.21.15.86:0/3205296110 shutdown_connections 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 --2- 172.21.15.86:0/3205296110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 0x7f5d701103d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 --2- 172.21.15.86:0/3205296110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d70103750 0x7f5d70103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 --2- 172.21.15.86:0/3205296110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70104100 0x7f5d70108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 -- 172.21.15.86:0/3205296110 >> 172.21.15.86:0/3205296110 conn(0x7f5d7007a600 msgr2=0x7f5d7007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 -- 172.21.15.86:0/3205296110 shutdown_connections 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 -- 172.21.15.86:0/3205296110 wait complete. 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 Processor -- start 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.104+0000 7f5d777da700 1 -- start start 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d777da700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70103750 0x7f5d700757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d777da700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d70104100 0x7f5d70075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d777da700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 0x7f5d70076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:02.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d777da700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70113710 con 0x7f5d70108850 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d777da700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70113590 con 0x7f5d70103750 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d777da700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70113890 con 0x7f5d70104100 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 0x7f5d70076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 0x7f5d70076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36348/0 (socket says 172.21.15.86:36348) 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 -- 172.21.15.86:0/3565296802 learned_addr learned my addr 172.21.15.86:0/3565296802 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75576700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70103750 0x7f5d700757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d74d75700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d70104100 0x7f5d70075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 -- 172.21.15.86:0/3565296802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d70104100 msgr2=0x7f5d70075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d70104100 0x7f5d70075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 -- 172.21.15.86:0/3565296802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70103750 msgr2=0x7f5d700757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70103750 0x7f5d700757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 -- 172.21.15.86:0/3565296802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d701a80d0 con 0x7f5d70108850 2024-05-12T11:08:02.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d75d77700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 0x7f5d70076220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009fd0 tx=0x7f5d68007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:02.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d667fc700 1 -- 172.21.15.86:0/3565296802 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6801f070 con 0x7f5d70108850 2024-05-12T11:08:02.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d667fc700 1 -- 172.21.15.86:0/3565296802 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d68003c00 con 0x7f5d70108850 2024-05-12T11:08:02.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d667fc700 1 -- 172.21.15.86:0/3565296802 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6801b7b0 con 0x7f5d70108850 2024-05-12T11:08:02.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d701a8360 con 0x7f5d70108850 2024-05-12T11:08:02.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.105+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d701a87b0 con 0x7f5d70108850 2024-05-12T11:08:02.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.106+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7006a190 con 0x7f5d70108850 2024-05-12T11:08:02.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.108+0000 7f5d667fc700 1 -- 172.21.15.86:0/3565296802 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5d68022070 con 0x7f5d70108850 2024-05-12T11:08:02.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.108+0000 7f5d667fc700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5d5c0b2880 0x7f5d5c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:02.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.109+0000 7f5d75576700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5d5c0b2880 0x7f5d5c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:02.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.109+0000 7f5d667fc700 1 -- 172.21.15.86:0/3565296802 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f5d6800f020 con 0x7f5d70108850 2024-05-12T11:08:02.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.109+0000 7f5d75576700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5d5c0b2880 0x7f5d5c0b4d40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009a10 tx=0x7f5d6c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:02.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.112+0000 7f5d667fc700 1 -- 172.21.15.86:0/3565296802 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5d68029020 con 0x7f5d70108850 2024-05-12T11:08:02.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.316+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d7002e5f0 con 0x7f5d5c0b2880 2024-05-12T11:08:02.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.323+0000 7f5d667fc700 1 -- 172.21.15.86:0/3565296802 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259124 (secure 0 0 0) 0x7f5d7002e5f0 con 0x7f5d5c0b2880 2024-05-12T11:08:02.319 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5d5c0b2880 msgr2=0x7f5d5c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5d5c0b2880 0x7f5d5c0b4d40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009a10 tx=0x7f5d6c009190 comp rx=0 tx=0).stop 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 msgr2=0x7f5d70076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 0x7f5d70076220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009fd0 tx=0x7f5d68007a20 comp rx=0 tx=0).stop 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 shutdown_connections 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f5d5c0b2880 0x7f5d5c0b4d40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d70108850 0x7f5d70076220 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70103750 0x7f5d700757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 --2- 172.21.15.86:0/3565296802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d70104100 0x7f5d70075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.326+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 >> 172.21.15.86:0/3565296802 conn(0x7f5d7007a600 msgr2=0x7f5d70101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.327+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 shutdown_connections 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:02.327+0000 7f5d777da700 1 -- 172.21.15.86:0/3565296802 wait complete. 2024-05-12T11:08:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-05-12T11:08:02.920 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-05-12T11:08:02.099133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659631,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1095,"num_read_kb":651,"num_write":377,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":2952534,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":810,"ondisk_log_size":810,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372672,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569152,"statfs":{"total":1151940427776,"available":1151558811648,"internally_reserved":0,"allocated":11304960,"data_stored":7166193,"data_compressed":175989,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003207"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102988+0000","last_change":"2024-05-12T11:06:05.173542+0000","last_active":"2024-05-12T11:07:44.102988+0000","last_peered":"2024-05-12T11:07:44.102988+0000","last_clean":"2024-05-12T11:07:44.102988+0000","last_became_active":"2024-05-12T11:06:05.173221+0000","last_became_peered":"2024-05-12T11:06:05.173221+0000","last_unstale":"2024-05-12T11:07:44.102988+0000","last_undegraded":"2024-05-12T11:07:44.102988+0000","last_fullsized":"2024-05-12T11:07:44.102988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102967+0000","last_change":"2024-05-12T11:06:05.178626+0000","last_active":"2024-05-12T11:07:44.102967+0000","last_peered":"2024-05-12T11:07:44.102967+0000","last_clean":"2024-05-12T11:07:44.102967+0000","last_became_active":"2024-05-12T11:06:05.178313+0000","last_became_peered":"2024-05-12T11:06:05.178313+0000","last_unstale":"2024-05-12T11:07:44.102967+0000","last_undegraded":"2024-05-12T11:07:44.102967+0000","last_fullsized":"2024-05-12T11:07:44.102967+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:45:25.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105439+0000","last_change":"2024-05-12T11:06:05.175396+0000","last_active":"2024-05-12T11:07:44.105439+0000","last_peered":"2024-05-12T11:07:44.105439+0000","last_clean":"2024-05-12T11:07:44.105439+0000","last_became_active":"2024-05-12T11:06:05.175060+0000","last_became_peered":"2024-05-12T11:06:05.175060+0000","last_unstale":"2024-05-12T11:07:44.105439+0000","last_undegraded":"2024-05-12T11:07:44.105439+0000","last_fullsized":"2024-05-12T11:07:44.105439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:55:08.180220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.098904+0000","last_change":"2024-05-12T11:06:05.172900+0000","last_active":"2024-05-12T11:07:44.098904+0000","last_peered":"2024-05-12T11:07:44.098904+0000","last_clean":"2024-05-12T11:07:44.098904+0000","last_became_active":"2024-05-12T11:06:05.172549+0000","last_became_peered":"2024-05-12T11:06:05.172549+0000","last_unstale":"2024-05-12T11:07:44.098904+0000","last_undegraded":"2024-05-12T11:07:44.098904+0000","last_fullsized":"2024-05-12T11:07:44.098904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:07:39.683046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.092871+0000","last_change":"2024-05-12T11:06:05.168126+0000","last_active":"2024-05-12T11:07:44.092871+0000","last_peered":"2024-05-12T11:07:44.092871+0000","last_clean":"2024-05-12T11:07:44.092871+0000","last_became_active":"2024-05-12T11:06:05.167729+0000","last_became_peered":"2024-05-12T11:06:05.167729+0000","last_unstale":"2024-05-12T11:07:44.092871+0000","last_undegraded":"2024-05-12T11:07:44.092871+0000","last_fullsized":"2024-05-12T11:07:44.092871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:38.996242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.103135+0000","last_change":"2024-05-12T11:06:05.180165+0000","last_active":"2024-05-12T11:07:44.103135+0000","last_peered":"2024-05-12T11:07:44.103135+0000","last_clean":"2024-05-12T11:07:44.103135+0000","last_became_active":"2024-05-12T11:06:05.179589+0000","last_became_peered":"2024-05-12T11:06:05.179589+0000","last_unstale":"2024-05-12T11:07:44.103135+0000","last_undegraded":"2024-05-12T11:07:44.103135+0000","last_fullsized":"2024-05-12T11:07:44.103135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:51:53.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101511+0000","last_change":"2024-05-12T11:06:05.176052+0000","last_active":"2024-05-12T11:07:44.101511+0000","last_peered":"2024-05-12T11:07:44.101511+0000","last_clean":"2024-05-12T11:07:44.101511+0000","last_became_active":"2024-05-12T11:06:05.175703+0000","last_became_peered":"2024-05-12T11:06:05.175703+0000","last_unstale":"2024-05-12T11:07:44.101511+0000","last_undegraded":"2024-05-12T11:07:44.101511+0000","last_fullsized":"2024-05-12T11:07:44.101511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:51:11.008516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.098373+0000","last_change":"2024-05-12T11:06:05.179144+0000","last_active":"2024-05-12T11:07:44.098373+0000","last_peered":"2024-05-12T11:07:44.098373+0000","last_clean":"2024-05-12T11:07:44.098373+0000","last_became_active":"2024-05-12T11:06:05.177854+0000","last_became_peered":"2024-05-12T11:06:05.177854+0000","last_unstale":"2024-05-12T11:07:44.098373+0000","last_undegraded":"2024-05-12T11:07:44.098373+0000","last_fullsized":"2024-05-12T11:07:44.098373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:12.231086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.086230+0000","last_change":"2024-05-12T11:06:45.310743+0000","last_active":"2024-05-12T11:07:44.086230+0000","last_peered":"2024-05-12T11:07:44.086230+0000","last_clean":"2024-05-12T11:07:44.086230+0000","last_became_active":"2024-05-12T11:06:45.310358+0000","last_became_peered":"2024-05-12T11:06:45.310358+0000","last_unstale":"2024-05-12T11:07:44.086230+0000","last_undegraded":"2024-05-12T11:07:44.086230+0000","last_fullsized":"2024-05-12T11:07:44.086230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:22:30.862132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.103130+0000","last_change":"2024-05-12T11:06:05.176196+0000","last_active":"2024-05-12T11:07:44.103130+0000","last_peered":"2024-05-12T11:07:44.103130+0000","last_clean":"2024-05-12T11:07:44.103130+0000","last_became_active":"2024-05-12T11:06:05.175863+0000","last_became_peered":"2024-05-12T11:06:05.175863+0000","last_unstale":"2024-05-12T11:07:44.103130+0000","last_undegraded":"2024-05-12T11:07:44.103130+0000","last_fullsized":"2024-05-12T11:07:44.103130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:26:41.815661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104907+0000","last_change":"2024-05-12T11:06:05.175901+0000","last_active":"2024-05-12T11:07:44.104907+0000","last_peered":"2024-05-12T11:07:44.104907+0000","last_clean":"2024-05-12T11:07:44.104907+0000","last_became_active":"2024-05-12T11:06:05.175514+0000","last_became_peered":"2024-05-12T11:06:05.175514+0000","last_unstale":"2024-05-12T11:07:44.104907+0000","last_undegraded":"2024-05-12T11:07:44.104907+0000","last_fullsized":"2024-05-12T11:07:44.104907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:11.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.094212+0000","last_change":"2024-05-12T11:06:05.175474+0000","last_active":"2024-05-12T11:07:44.094212+0000","last_peered":"2024-05-12T11:07:44.094212+0000","last_clean":"2024-05-12T11:07:44.094212+0000","last_became_active":"2024-05-12T11:06:05.175082+0000","last_became_peered":"2024-05-12T11:06:05.175082+0000","last_unstale":"2024-05-12T11:07:44.094212+0000","last_undegraded":"2024-05-12T11:07:44.094212+0000","last_fullsized":"2024-05-12T11:07:44.094212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:10:53.548758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.094735+0000","last_change":"2024-05-12T11:06:05.170426+0000","last_active":"2024-05-12T11:07:44.094735+0000","last_peered":"2024-05-12T11:07:44.094735+0000","last_clean":"2024-05-12T11:07:44.094735+0000","last_became_active":"2024-05-12T11:06:05.170111+0000","last_became_peered":"2024-05-12T11:06:05.170111+0000","last_unstale":"2024-05-12T11:07:44.094735+0000","last_undegraded":"2024-05-12T11:07:44.094735+0000","last_fullsized":"2024-05-12T11:07:44.094735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:50.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096947+0000","last_change":"2024-05-12T11:06:05.178939+0000","last_active":"2024-05-12T11:07:44.096947+0000","last_peered":"2024-05-12T11:07:44.096947+0000","last_clean":"2024-05-12T11:07:44.096947+0000","last_became_active":"2024-05-12T11:06:05.178604+0000","last_became_peered":"2024-05-12T11:06:05.178604+0000","last_unstale":"2024-05-12T11:07:44.096947+0000","last_undegraded":"2024-05-12T11:07:44.096947+0000","last_fullsized":"2024-05-12T11:07:44.096947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:36.222841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104752+0000","last_change":"2024-05-12T11:06:45.312800+0000","last_active":"2024-05-12T11:07:44.104752+0000","last_peered":"2024-05-12T11:07:44.104752+0000","last_clean":"2024-05-12T11:07:44.104752+0000","last_became_active":"2024-05-12T11:06:45.312567+0000","last_became_peered":"2024-05-12T11:06:45.312567+0000","last_unstale":"2024-05-12T11:07:44.104752+0000","last_undegraded":"2024-05-12T11:07:44.104752+0000","last_fullsized":"2024-05-12T11:07:44.104752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:30:21.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104070+0000","last_change":"2024-05-12T11:06:05.170481+0000","last_active":"2024-05-12T11:07:44.104070+0000","last_peered":"2024-05-12T11:07:44.104070+0000","last_clean":"2024-05-12T11:07:44.104070+0000","last_became_active":"2024-05-12T11:06:05.170173+0000","last_became_peered":"2024-05-12T11:06:05.170173+0000","last_unstale":"2024-05-12T11:07:44.104070+0000","last_undegraded":"2024-05-12T11:07:44.104070+0000","last_fullsized":"2024-05-12T11:07:44.104070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:01:37.775287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.103123+0000","last_change":"2024-05-12T11:06:05.172942+0000","last_active":"2024-05-12T11:07:44.103123+0000","last_peered":"2024-05-12T11:07:44.103123+0000","last_clean":"2024-05-12T11:07:44.103123+0000","last_became_active":"2024-05-12T11:06:05.172612+0000","last_became_peered":"2024-05-12T11:06:05.172612+0000","last_unstale":"2024-05-12T11:07:44.103123+0000","last_undegraded":"2024-05-12T11:07:44.103123+0000","last_fullsized":"2024-05-12T11:07:44.103123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:26:51.548027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.089667+0000","last_change":"2024-05-12T11:06:05.175400+0000","last_active":"2024-05-12T11:07:44.089667+0000","last_peered":"2024-05-12T11:07:44.089667+0000","last_clean":"2024-05-12T11:07:44.089667+0000","last_became_active":"2024-05-12T11:06:05.174871+0000","last_became_peered":"2024-05-12T11:06:05.174871+0000","last_unstale":"2024-05-12T11:07:44.089667+0000","last_undegraded":"2024-05-12T11:07:44.089667+0000","last_fullsized":"2024-05-12T11:07:44.089667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:48:12.566540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101125+0000","last_change":"2024-05-12T11:06:05.172584+0000","last_active":"2024-05-12T11:07:44.101125+0000","last_peered":"2024-05-12T11:07:44.101125+0000","last_clean":"2024-05-12T11:07:44.101125+0000","last_became_active":"2024-05-12T11:06:05.171545+0000","last_became_peered":"2024-05-12T11:06:05.171545+0000","last_unstale":"2024-05-12T11:07:44.101125+0000","last_undegraded":"2024-05-12T11:07:44.101125+0000","last_fullsized":"2024-05-12T11:07:44.101125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:34:45.950231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:57.375373+0000","last_change":"2024-05-12T11:06:02.148890+0000","last_active":"2024-05-12T11:07:57.375373+0000","last_peered":"2024-05-12T11:07:57.375373+0000","last_clean":"2024-05-12T11:07:57.375373+0000","last_became_active":"2024-05-12T11:06:02.148544+0000","last_became_peered":"2024-05-12T11:06:02.148544+0000","last_unstale":"2024-05-12T11:07:57.375373+0000","last_undegraded":"2024-05-12T11:07:57.375373+0000","last_fullsized":"2024-05-12T11:07:57.375373+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:34.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104796+0000","last_change":"2024-05-12T11:06:05.175214+0000","last_active":"2024-05-12T11:07:44.104796+0000","last_peered":"2024-05-12T11:07:44.104796+0000","last_clean":"2024-05-12T11:07:44.104796+0000","last_became_active":"2024-05-12T11:06:05.174920+0000","last_became_peered":"2024-05-12T11:06:05.174920+0000","last_unstale":"2024-05-12T11:07:44.104796+0000","last_undegraded":"2024-05-12T11:07:44.104796+0000","last_fullsized":"2024-05-12T11:07:44.104796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:30:36.277975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307920+0000","last_change":"2024-05-12T11:06:02.246073+0000","last_active":"2024-05-12T11:06:45.307920+0000","last_peered":"2024-05-12T11:06:45.307920+0000","last_clean":"2024-05-12T11:06:45.307920+0000","last_became_active":"2024-05-12T11:06:02.245728+0000","last_became_peered":"2024-05-12T11:06:02.245728+0000","last_unstale":"2024-05-12T11:06:45.307920+0000","last_undegraded":"2024-05-12T11:06:45.307920+0000","last_fullsized":"2024-05-12T11:06:45.307920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:43:03.273179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105198+0000","last_change":"2024-05-12T11:06:05.170448+0000","last_active":"2024-05-12T11:07:44.105198+0000","last_peered":"2024-05-12T11:07:44.105198+0000","last_clean":"2024-05-12T11:07:44.105198+0000","last_became_active":"2024-05-12T11:06:05.170133+0000","last_became_peered":"2024-05-12T11:06:05.170133+0000","last_unstale":"2024-05-12T11:07:44.105198+0000","last_undegraded":"2024-05-12T11:07:44.105198+0000","last_fullsized":"2024-05-12T11:07:44.105198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:17:30.669009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307324+0000","last_change":"2024-05-12T11:06:02.155137+0000","last_active":"2024-05-12T11:06:45.307324+0000","last_peered":"2024-05-12T11:06:45.307324+0000","last_clean":"2024-05-12T11:06:45.307324+0000","last_became_active":"2024-05-12T11:06:02.154467+0000","last_became_peered":"2024-05-12T11:06:02.154467+0000","last_unstale":"2024-05-12T11:06:45.307324+0000","last_undegraded":"2024-05-12T11:06:45.307324+0000","last_fullsized":"2024-05-12T11:06:45.307324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:38.708094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105057+0000","last_change":"2024-05-12T11:06:05.180903+0000","last_active":"2024-05-12T11:07:44.105057+0000","last_peered":"2024-05-12T11:07:44.105057+0000","last_clean":"2024-05-12T11:07:44.105057+0000","last_became_active":"2024-05-12T11:06:05.180519+0000","last_became_peered":"2024-05-12T11:06:05.180519+0000","last_unstale":"2024-05-12T11:07:44.105057+0000","last_undegraded":"2024-05-12T11:07:44.105057+0000","last_fullsized":"2024-05-12T11:07:44.105057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:57:47.535714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.325802+0000","last_change":"2024-05-12T11:06:45.325333+0000","last_active":"2024-05-12T11:06:45.325802+0000","last_peered":"2024-05-12T11:06:45.325802+0000","last_clean":"2024-05-12T11:06:45.325802+0000","last_became_active":"2024-05-12T11:06:45.312552+0000","last_became_peered":"2024-05-12T11:06:45.312552+0000","last_unstale":"2024-05-12T11:06:45.325802+0000","last_undegraded":"2024-05-12T11:06:45.325802+0000","last_fullsized":"2024-05-12T11:06:45.325802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:45.862620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.100090+0000","last_change":"2024-05-12T11:06:05.167052+0000","last_active":"2024-05-12T11:07:44.100090+0000","last_peered":"2024-05-12T11:07:44.100090+0000","last_clean":"2024-05-12T11:07:44.100090+0000","last_became_active":"2024-05-12T11:06:05.166689+0000","last_became_peered":"2024-05-12T11:06:05.166689+0000","last_unstale":"2024-05-12T11:07:44.100090+0000","last_undegraded":"2024-05-12T11:07:44.100090+0000","last_fullsized":"2024-05-12T11:07:44.100090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:34:05.008336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:59.380007+0000","last_change":"2024-05-12T11:06:02.154630+0000","last_active":"2024-05-12T11:07:59.380007+0000","last_peered":"2024-05-12T11:07:59.380007+0000","last_clean":"2024-05-12T11:07:59.380007+0000","last_became_active":"2024-05-12T11:06:02.154254+0000","last_became_peered":"2024-05-12T11:06:02.154254+0000","last_unstale":"2024-05-12T11:07:59.380007+0000","last_undegraded":"2024-05-12T11:07:59.380007+0000","last_fullsized":"2024-05-12T11:07:59.380007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:54.294058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.086011+0000","last_change":"2024-05-12T11:06:05.176582+0000","last_active":"2024-05-12T11:07:44.086011+0000","last_peered":"2024-05-12T11:07:44.086011+0000","last_clean":"2024-05-12T11:07:44.086011+0000","last_became_active":"2024-05-12T11:06:05.176241+0000","last_became_peered":"2024-05-12T11:06:05.176241+0000","last_unstale":"2024-05-12T11:07:44.086011+0000","last_undegraded":"2024-05-12T11:07:44.086011+0000","last_fullsized":"2024-05-12T11:07:44.086011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:09:00.020166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304182+0000","last_change":"2024-05-12T11:06:02.148534+0000","last_active":"2024-05-12T11:06:45.304182+0000","last_peered":"2024-05-12T11:06:45.304182+0000","last_clean":"2024-05-12T11:06:45.304182+0000","last_became_active":"2024-05-12T11:06:02.148155+0000","last_became_peered":"2024-05-12T11:06:02.148155+0000","last_unstale":"2024-05-12T11:06:45.304182+0000","last_undegraded":"2024-05-12T11:06:45.304182+0000","last_fullsized":"2024-05-12T11:06:45.304182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:52:21.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.091275+0000","last_change":"2024-05-12T11:06:05.169944+0000","last_active":"2024-05-12T11:07:44.091275+0000","last_peered":"2024-05-12T11:07:44.091275+0000","last_clean":"2024-05-12T11:07:44.091275+0000","last_became_active":"2024-05-12T11:06:05.169597+0000","last_became_peered":"2024-05-12T11:06:05.169597+0000","last_unstale":"2024-05-12T11:07:44.091275+0000","last_undegraded":"2024-05-12T11:07:44.091275+0000","last_fullsized":"2024-05-12T11:07:44.091275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:05:17.724037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305926+0000","last_change":"2024-05-12T11:06:02.154539+0000","last_active":"2024-05-12T11:06:45.305926+0000","last_peered":"2024-05-12T11:06:45.305926+0000","last_clean":"2024-05-12T11:06:45.305926+0000","last_became_active":"2024-05-12T11:06:02.154040+0000","last_became_peered":"2024-05-12T11:06:02.154040+0000","last_unstale":"2024-05-12T11:06:45.305926+0000","last_undegraded":"2024-05-12T11:06:45.305926+0000","last_fullsized":"2024-05-12T11:06:45.305926+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:10:23.875273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.081916+0000","last_change":"2024-05-12T11:06:45.308950+0000","last_active":"2024-05-12T11:07:44.081916+0000","last_peered":"2024-05-12T11:07:44.081916+0000","last_clean":"2024-05-12T11:07:44.081916+0000","last_became_active":"2024-05-12T11:06:45.308579+0000","last_became_peered":"2024-05-12T11:06:45.308579+0000","last_unstale":"2024-05-12T11:07:44.081916+0000","last_undegraded":"2024-05-12T11:07:44.081916+0000","last_fullsized":"2024-05-12T11:07:44.081916+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:01:08.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306812+0000","last_change":"2024-05-12T11:06:02.151341+0000","last_active":"2024-05-12T11:06:45.306812+0000","last_peered":"2024-05-12T11:06:45.306812+0000","last_clean":"2024-05-12T11:06:45.306812+0000","last_became_active":"2024-05-12T11:06:02.150949+0000","last_became_peered":"2024-05-12T11:06:02.150949+0000","last_unstale":"2024-05-12T11:06:45.306812+0000","last_undegraded":"2024-05-12T11:06:45.306812+0000","last_fullsized":"2024-05-12T11:06:45.306812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:07:26.699269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.094624+0000","last_change":"2024-05-12T11:06:05.173060+0000","last_active":"2024-05-12T11:07:44.094624+0000","last_peered":"2024-05-12T11:07:44.094624+0000","last_clean":"2024-05-12T11:07:44.094624+0000","last_became_active":"2024-05-12T11:06:05.172756+0000","last_became_peered":"2024-05-12T11:06:05.172756+0000","last_unstale":"2024-05-12T11:07:44.094624+0000","last_undegraded":"2024-05-12T11:07:44.094624+0000","last_fullsized":"2024-05-12T11:07:44.094624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:15:12.797466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":225,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:59.378861+0000","last_change":"2024-05-12T11:06:02.152219+0000","last_active":"2024-05-12T11:07:59.378861+0000","last_peered":"2024-05-12T11:07:59.378861+0000","last_clean":"2024-05-12T11:07:59.378861+0000","last_became_active":"2024-05-12T11:06:02.151707+0000","last_became_peered":"2024-05-12T11:06:02.151707+0000","last_unstale":"2024-05-12T11:07:59.378861+0000","last_undegraded":"2024-05-12T11:07:59.378861+0000","last_fullsized":"2024-05-12T11:07:59.378861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:43.047957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105153+0000","last_change":"2024-05-12T11:06:05.173436+0000","last_active":"2024-05-12T11:07:44.105153+0000","last_peered":"2024-05-12T11:07:44.105153+0000","last_clean":"2024-05-12T11:07:44.105153+0000","last_became_active":"2024-05-12T11:06:05.173057+0000","last_became_peered":"2024-05-12T11:06:05.173057+0000","last_unstale":"2024-05-12T11:07:44.105153+0000","last_undegraded":"2024-05-12T11:07:44.105153+0000","last_fullsized":"2024-05-12T11:07:44.105153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.408017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351515+0000","last_change":"2024-05-12T11:06:02.155037+0000","last_active":"2024-05-12T11:06:45.351515+0000","last_peered":"2024-05-12T11:06:45.351515+0000","last_clean":"2024-05-12T11:06:45.351515+0000","last_became_active":"2024-05-12T11:06:02.154658+0000","last_became_peered":"2024-05-12T11:06:02.154658+0000","last_unstale":"2024-05-12T11:06:45.351515+0000","last_undegraded":"2024-05-12T11:06:45.351515+0000","last_fullsized":"2024-05-12T11:06:45.351515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:58:16.633636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.095974+0000","last_change":"2024-05-12T11:06:05.176100+0000","last_active":"2024-05-12T11:07:44.095974+0000","last_peered":"2024-05-12T11:07:44.095974+0000","last_clean":"2024-05-12T11:07:44.095974+0000","last_became_active":"2024-05-12T11:06:05.175385+0000","last_became_peered":"2024-05-12T11:06:05.175385+0000","last_unstale":"2024-05-12T11:07:44.095974+0000","last_undegraded":"2024-05-12T11:07:44.095974+0000","last_fullsized":"2024-05-12T11:07:44.095974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:10.627583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310308+0000","last_change":"2024-05-12T11:06:02.246427+0000","last_active":"2024-05-12T11:06:45.310308+0000","last_peered":"2024-05-12T11:06:45.310308+0000","last_clean":"2024-05-12T11:06:45.310308+0000","last_became_active":"2024-05-12T11:06:02.246068+0000","last_became_peered":"2024-05-12T11:06:02.246068+0000","last_unstale":"2024-05-12T11:06:45.310308+0000","last_undegraded":"2024-05-12T11:06:45.310308+0000","last_fullsized":"2024-05-12T11:06:45.310308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:40:25.533391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.093782+0000","last_change":"2024-05-12T11:06:45.310358+0000","last_active":"2024-05-12T11:07:44.093782+0000","last_peered":"2024-05-12T11:07:44.093782+0000","last_clean":"2024-05-12T11:07:44.093782+0000","last_became_active":"2024-05-12T11:06:45.309960+0000","last_became_peered":"2024-05-12T11:06:45.309960+0000","last_unstale":"2024-05-12T11:07:44.093782+0000","last_undegraded":"2024-05-12T11:07:44.093782+0000","last_fullsized":"2024-05-12T11:07:44.093782+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:28.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'35","reported_seq":265,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:59.378853+0000","last_change":"2024-05-12T11:06:02.151099+0000","last_active":"2024-05-12T11:07:59.378853+0000","last_peered":"2024-05-12T11:07:59.378853+0000","last_clean":"2024-05-12T11:07:59.378853+0000","last_became_active":"2024-05-12T11:06:02.150702+0000","last_became_peered":"2024-05-12T11:06:02.150702+0000","last_unstale":"2024-05-12T11:07:59.378853+0000","last_undegraded":"2024-05-12T11:07:59.378853+0000","last_fullsized":"2024-05-12T11:07:59.378853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:14:00.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62075,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":162,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.084473+0000","last_change":"2024-05-12T11:06:05.171016+0000","last_active":"2024-05-12T11:07:44.084473+0000","last_peered":"2024-05-12T11:07:44.084473+0000","last_clean":"2024-05-12T11:07:44.084473+0000","last_became_active":"2024-05-12T11:06:05.170659+0000","last_became_peered":"2024-05-12T11:06:05.170659+0000","last_unstale":"2024-05-12T11:07:44.084473+0000","last_undegraded":"2024-05-12T11:07:44.084473+0000","last_fullsized":"2024-05-12T11:07:44.084473+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:13:00.756621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306762+0000","last_change":"2024-05-12T11:06:02.153854+0000","last_active":"2024-05-12T11:06:45.306762+0000","last_peered":"2024-05-12T11:06:45.306762+0000","last_clean":"2024-05-12T11:06:45.306762+0000","last_became_active":"2024-05-12T11:06:02.153501+0000","last_became_peered":"2024-05-12T11:06:02.153501+0000","last_unstale":"2024-05-12T11:06:45.306762+0000","last_undegraded":"2024-05-12T11:06:45.306762+0000","last_fullsized":"2024-05-12T11:06:45.306762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:42:37.608641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096971+0000","last_change":"2024-05-12T11:06:05.169348+0000","last_active":"2024-05-12T11:07:44.096971+0000","last_peered":"2024-05-12T11:07:44.096971+0000","last_clean":"2024-05-12T11:07:44.096971+0000","last_became_active":"2024-05-12T11:06:05.169031+0000","last_became_peered":"2024-05-12T11:06:05.169031+0000","last_unstale":"2024-05-12T11:07:44.096971+0000","last_undegraded":"2024-05-12T11:07:44.096971+0000","last_fullsized":"2024-05-12T11:07:44.096971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:07:13.104465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308102+0000","last_change":"2024-05-12T11:06:02.152482+0000","last_active":"2024-05-12T11:06:45.308102+0000","last_peered":"2024-05-12T11:06:45.308102+0000","last_clean":"2024-05-12T11:06:45.308102+0000","last_became_active":"2024-05-12T11:06:02.152077+0000","last_became_peered":"2024-05-12T11:06:02.152077+0000","last_unstale":"2024-05-12T11:06:45.308102+0000","last_undegraded":"2024-05-12T11:06:45.308102+0000","last_fullsized":"2024-05-12T11:06:45.308102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:42.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104312+0000","last_change":"2024-05-12T11:06:05.175228+0000","last_active":"2024-05-12T11:07:44.104312+0000","last_peered":"2024-05-12T11:07:44.104312+0000","last_clean":"2024-05-12T11:07:44.104312+0000","last_became_active":"2024-05-12T11:06:05.174892+0000","last_became_peered":"2024-05-12T11:06:05.174892+0000","last_unstale":"2024-05-12T11:07:44.104312+0000","last_undegraded":"2024-05-12T11:07:44.104312+0000","last_fullsized":"2024-05-12T11:07:44.104312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:34.581296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:08:00.380009+0000","last_change":"2024-05-12T11:06:02.149923+0000","last_active":"2024-05-12T11:08:00.380009+0000","last_peered":"2024-05-12T11:08:00.380009+0000","last_clean":"2024-05-12T11:08:00.380009+0000","last_became_active":"2024-05-12T11:06:02.149571+0000","last_became_peered":"2024-05-12T11:06:02.149571+0000","last_unstale":"2024-05-12T11:08:00.380009+0000","last_undegraded":"2024-05-12T11:08:00.380009+0000","last_fullsized":"2024-05-12T11:08:00.380009+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:23:36.118502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.099965+0000","last_change":"2024-05-12T11:06:05.178843+0000","last_active":"2024-05-12T11:07:44.099965+0000","last_peered":"2024-05-12T11:07:44.099965+0000","last_clean":"2024-05-12T11:07:44.099965+0000","last_became_active":"2024-05-12T11:06:05.178526+0000","last_became_peered":"2024-05-12T11:06:05.178526+0000","last_unstale":"2024-05-12T11:07:44.099965+0000","last_undegraded":"2024-05-12T11:07:44.099965+0000","last_fullsized":"2024-05-12T11:07:44.099965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:57.760329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.512231+0000","last_change":"2024-05-12T11:06:45.512231+0000","last_active":"2024-05-12T11:06:45.512231+0000","last_peered":"2024-05-12T11:06:45.512231+0000","last_clean":"2024-05-12T11:06:45.512231+0000","last_became_active":"2024-05-12T11:06:45.499482+0000","last_became_peered":"2024-05-12T11:06:45.499482+0000","last_unstale":"2024-05-12T11:06:45.512231+0000","last_undegraded":"2024-05-12T11:06:45.512231+0000","last_fullsized":"2024-05-12T11:06:45.512231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:34:43.986131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.093913+0000","last_change":"2024-05-12T11:06:05.168307+0000","last_active":"2024-05-12T11:07:44.093913+0000","last_peered":"2024-05-12T11:07:44.093913+0000","last_clean":"2024-05-12T11:07:44.093913+0000","last_became_active":"2024-05-12T11:06:05.167606+0000","last_became_peered":"2024-05-12T11:06:05.167606+0000","last_unstale":"2024-05-12T11:07:44.093913+0000","last_undegraded":"2024-05-12T11:07:44.093913+0000","last_fullsized":"2024-05-12T11:07:44.093913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:25:09.384425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308010+0000","last_change":"2024-05-12T11:06:02.156201+0000","last_active":"2024-05-12T11:06:45.308010+0000","last_peered":"2024-05-12T11:06:45.308010+0000","last_clean":"2024-05-12T11:06:45.308010+0000","last_became_active":"2024-05-12T11:06:02.155398+0000","last_became_peered":"2024-05-12T11:06:02.155398+0000","last_unstale":"2024-05-12T11:06:45.308010+0000","last_undegraded":"2024-05-12T11:06:45.308010+0000","last_fullsized":"2024-05-12T11:06:45.308010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:23:01.157554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105374+0000","last_change":"2024-05-12T11:06:05.176837+0000","last_active":"2024-05-12T11:07:44.105374+0000","last_peered":"2024-05-12T11:07:44.105374+0000","last_clean":"2024-05-12T11:07:44.105374+0000","last_became_active":"2024-05-12T11:06:05.176450+0000","last_became_peered":"2024-05-12T11:06:05.176450+0000","last_unstale":"2024-05-12T11:07:44.105374+0000","last_undegraded":"2024-05-12T11:07:44.105374+0000","last_fullsized":"2024-05-12T11:07:44.105374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:36:17.654259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305632+0000","last_change":"2024-05-12T11:06:02.246999+0000","last_active":"2024-05-12T11:06:45.305632+0000","last_peered":"2024-05-12T11:06:45.305632+0000","last_clean":"2024-05-12T11:06:45.305632+0000","last_became_active":"2024-05-12T11:06:02.246063+0000","last_became_peered":"2024-05-12T11:06:02.246063+0000","last_unstale":"2024-05-12T11:06:45.305632+0000","last_undegraded":"2024-05-12T11:06:45.305632+0000","last_fullsized":"2024-05-12T11:06:45.305632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:39.303069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.082831+0000","last_change":"2024-05-12T11:06:05.175333+0000","last_active":"2024-05-12T11:07:44.082831+0000","last_peered":"2024-05-12T11:07:44.082831+0000","last_clean":"2024-05-12T11:07:44.082831+0000","last_became_active":"2024-05-12T11:06:05.175011+0000","last_became_peered":"2024-05-12T11:06:05.175011+0000","last_unstale":"2024-05-12T11:07:44.082831+0000","last_undegraded":"2024-05-12T11:07:44.082831+0000","last_fullsized":"2024-05-12T11:07:44.082831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:51:57.025941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:56.374816+0000","last_change":"2024-05-12T11:06:02.151044+0000","last_active":"2024-05-12T11:07:56.374816+0000","last_peered":"2024-05-12T11:07:56.374816+0000","last_clean":"2024-05-12T11:07:56.374816+0000","last_became_active":"2024-05-12T11:06:02.150011+0000","last_became_peered":"2024-05-12T11:06:02.150011+0000","last_unstale":"2024-05-12T11:07:56.374816+0000","last_undegraded":"2024-05-12T11:07:56.374816+0000","last_fullsized":"2024-05-12T11:07:56.374816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:16:14.058893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101341+0000","last_change":"2024-05-12T11:06:05.179210+0000","last_active":"2024-05-12T11:07:44.101341+0000","last_peered":"2024-05-12T11:07:44.101341+0000","last_clean":"2024-05-12T11:07:44.101341+0000","last_became_active":"2024-05-12T11:06:05.178853+0000","last_became_peered":"2024-05-12T11:06:05.178853+0000","last_unstale":"2024-05-12T11:07:44.101341+0000","last_undegraded":"2024-05-12T11:07:44.101341+0000","last_fullsized":"2024-05-12T11:07:44.101341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:50:05.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104216+0000","last_change":"2024-05-12T11:06:05.170860+0000","last_active":"2024-05-12T11:07:44.104216+0000","last_peered":"2024-05-12T11:07:44.104216+0000","last_clean":"2024-05-12T11:07:44.104216+0000","last_became_active":"2024-05-12T11:06:05.170502+0000","last_became_peered":"2024-05-12T11:06:05.170502+0000","last_unstale":"2024-05-12T11:07:44.104216+0000","last_undegraded":"2024-05-12T11:07:44.104216+0000","last_fullsized":"2024-05-12T11:07:44.104216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:26:46.495176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:08:00.379526+0000","last_change":"2024-05-12T11:06:02.245996+0000","last_active":"2024-05-12T11:08:00.379526+0000","last_peered":"2024-05-12T11:08:00.379526+0000","last_clean":"2024-05-12T11:08:00.379526+0000","last_became_active":"2024-05-12T11:06:02.245629+0000","last_became_peered":"2024-05-12T11:06:02.245629+0000","last_unstale":"2024-05-12T11:08:00.379526+0000","last_undegraded":"2024-05-12T11:08:00.379526+0000","last_fullsized":"2024-05-12T11:08:00.379526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:02:54.794852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.098583+0000","last_change":"2024-05-12T11:06:05.174731+0000","last_active":"2024-05-12T11:07:44.098583+0000","last_peered":"2024-05-12T11:07:44.098583+0000","last_clean":"2024-05-12T11:07:44.098583+0000","last_became_active":"2024-05-12T11:06:05.174396+0000","last_became_peered":"2024-05-12T11:06:05.174396+0000","last_unstale":"2024-05-12T11:07:44.098583+0000","last_undegraded":"2024-05-12T11:07:44.098583+0000","last_fullsized":"2024-05-12T11:07:44.098583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:30:48.352011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498237+0000","last_change":"2024-05-12T11:06:02.153635+0000","last_active":"2024-05-12T11:06:45.498237+0000","last_peered":"2024-05-12T11:06:45.498237+0000","last_clean":"2024-05-12T11:06:45.498237+0000","last_became_active":"2024-05-12T11:06:02.153268+0000","last_became_peered":"2024-05-12T11:06:02.153268+0000","last_unstale":"2024-05-12T11:06:45.498237+0000","last_undegraded":"2024-05-12T11:06:45.498237+0000","last_fullsized":"2024-05-12T11:06:45.498237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:55.245138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351120+0000","last_change":"2024-05-12T11:04:37.106045+0000","last_active":"2024-05-12T11:06:45.351120+0000","last_peered":"2024-05-12T11:06:45.351120+0000","last_clean":"2024-05-12T11:06:45.351120+0000","last_became_active":"2024-05-12T11:04:37.101364+0000","last_became_peered":"2024-05-12T11:04:37.101364+0000","last_unstale":"2024-05-12T11:06:45.351120+0000","last_undegraded":"2024-05-12T11:06:45.351120+0000","last_fullsized":"2024-05-12T11:06:45.351120+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_clean_scrub_stamp":"2024-05-12T11:01:12.632157+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:53:22.531168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.089599+0000","last_change":"2024-05-12T11:06:05.163927+0000","last_active":"2024-05-12T11:07:44.089599+0000","last_peered":"2024-05-12T11:07:44.089599+0000","last_clean":"2024-05-12T11:07:44.089599+0000","last_became_active":"2024-05-12T11:06:05.163610+0000","last_became_peered":"2024-05-12T11:06:05.163610+0000","last_unstale":"2024-05-12T11:07:44.089599+0000","last_undegraded":"2024-05-12T11:07:44.089599+0000","last_fullsized":"2024-05-12T11:07:44.089599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:58:31.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351125+0000","last_change":"2024-05-12T11:06:02.152658+0000","last_active":"2024-05-12T11:06:45.351125+0000","last_peered":"2024-05-12T11:06:45.351125+0000","last_clean":"2024-05-12T11:06:45.351125+0000","last_became_active":"2024-05-12T11:06:02.151770+0000","last_became_peered":"2024-05-12T11:06:02.151770+0000","last_unstale":"2024-05-12T11:06:45.351125+0000","last_undegraded":"2024-05-12T11:06:45.351125+0000","last_fullsized":"2024-05-12T11:06:45.351125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:18.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307050+0000","last_change":"2024-05-12T11:06:02.246421+0000","last_active":"2024-05-12T11:06:45.307050+0000","last_peered":"2024-05-12T11:06:45.307050+0000","last_clean":"2024-05-12T11:06:45.307050+0000","last_became_active":"2024-05-12T11:06:02.246065+0000","last_became_peered":"2024-05-12T11:06:02.246065+0000","last_unstale":"2024-05-12T11:06:45.307050+0000","last_undegraded":"2024-05-12T11:06:45.307050+0000","last_fullsized":"2024-05-12T11:06:45.307050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:34:28.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.083451+0000","last_change":"2024-05-12T11:06:05.166916+0000","last_active":"2024-05-12T11:07:44.083451+0000","last_peered":"2024-05-12T11:07:44.083451+0000","last_clean":"2024-05-12T11:07:44.083451+0000","last_became_active":"2024-05-12T11:06:05.165877+0000","last_became_peered":"2024-05-12T11:06:05.165877+0000","last_unstale":"2024-05-12T11:07:44.083451+0000","last_undegraded":"2024-05-12T11:07:44.083451+0000","last_fullsized":"2024-05-12T11:07:44.083451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:46:47.935159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:47.179614+0000","last_change":"2024-05-12T11:06:02.151339+0000","last_active":"2024-05-12T11:06:47.179614+0000","last_peered":"2024-05-12T11:06:47.179614+0000","last_clean":"2024-05-12T11:06:47.179614+0000","last_became_active":"2024-05-12T11:06:02.150968+0000","last_became_peered":"2024-05-12T11:06:02.150968+0000","last_unstale":"2024-05-12T11:06:47.179614+0000","last_undegraded":"2024-05-12T11:06:47.179614+0000","last_fullsized":"2024-05-12T11:06:47.179614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:22:39.625972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096323+0000","last_change":"2024-05-12T11:06:05.165277+0000","last_active":"2024-05-12T11:07:44.096323+0000","last_peered":"2024-05-12T11:07:44.096323+0000","last_clean":"2024-05-12T11:07:44.096323+0000","last_became_active":"2024-05-12T11:06:05.164992+0000","last_became_peered":"2024-05-12T11:06:05.164992+0000","last_unstale":"2024-05-12T11:07:44.096323+0000","last_undegraded":"2024-05-12T11:07:44.096323+0000","last_fullsized":"2024-05-12T11:07:44.096323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:18.193170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498226+0000","last_change":"2024-05-12T11:06:02.151167+0000","last_active":"2024-05-12T11:06:45.498226+0000","last_peered":"2024-05-12T11:06:45.498226+0000","last_clean":"2024-05-12T11:06:45.498226+0000","last_became_active":"2024-05-12T11:06:02.150815+0000","last_became_peered":"2024-05-12T11:06:02.150815+0000","last_unstale":"2024-05-12T11:06:45.498226+0000","last_undegraded":"2024-05-12T11:06:45.498226+0000","last_fullsized":"2024-05-12T11:06:45.498226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:50.811297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102087+0000","last_change":"2024-05-12T11:06:45.352790+0000","last_active":"2024-05-12T11:07:44.102087+0000","last_peered":"2024-05-12T11:07:44.102087+0000","last_clean":"2024-05-12T11:07:44.102087+0000","last_became_active":"2024-05-12T11:06:45.352409+0000","last_became_peered":"2024-05-12T11:06:45.352409+0000","last_unstale":"2024-05-12T11:07:44.102087+0000","last_undegraded":"2024-05-12T11:07:44.102087+0000","last_fullsized":"2024-05-12T11:07:44.102087+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:16.535709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305794+0000","last_change":"2024-05-12T11:06:02.246676+0000","last_active":"2024-05-12T11:06:45.305794+0000","last_peered":"2024-05-12T11:06:45.305794+0000","last_clean":"2024-05-12T11:06:45.305794+0000","last_became_active":"2024-05-12T11:06:02.246344+0000","last_became_peered":"2024-05-12T11:06:02.246344+0000","last_unstale":"2024-05-12T11:06:45.305794+0000","last_undegraded":"2024-05-12T11:06:45.305794+0000","last_fullsized":"2024-05-12T11:06:45.305794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:17.805058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.082939+0000","last_change":"2024-05-12T11:06:05.175597+0000","last_active":"2024-05-12T11:07:44.082939+0000","last_peered":"2024-05-12T11:07:44.082939+0000","last_clean":"2024-05-12T11:07:44.082939+0000","last_became_active":"2024-05-12T11:06:05.175237+0000","last_became_peered":"2024-05-12T11:06:05.175237+0000","last_unstale":"2024-05-12T11:07:44.082939+0000","last_undegraded":"2024-05-12T11:07:44.082939+0000","last_fullsized":"2024-05-12T11:07:44.082939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:50:12.872570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306976+0000","last_change":"2024-05-12T11:06:02.148706+0000","last_active":"2024-05-12T11:06:45.306976+0000","last_peered":"2024-05-12T11:06:45.306976+0000","last_clean":"2024-05-12T11:06:45.306976+0000","last_became_active":"2024-05-12T11:06:02.148437+0000","last_became_peered":"2024-05-12T11:06:02.148437+0000","last_unstale":"2024-05-12T11:06:45.306976+0000","last_undegraded":"2024-05-12T11:06:45.306976+0000","last_fullsized":"2024-05-12T11:06:45.306976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:54:39.969677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102452+0000","last_change":"2024-05-12T11:06:05.174248+0000","last_active":"2024-05-12T11:07:44.102452+0000","last_peered":"2024-05-12T11:07:44.102452+0000","last_clean":"2024-05-12T11:07:44.102452+0000","last_became_active":"2024-05-12T11:06:05.173934+0000","last_became_peered":"2024-05-12T11:06:05.173934+0000","last_unstale":"2024-05-12T11:07:44.102452+0000","last_undegraded":"2024-05-12T11:07:44.102452+0000","last_fullsized":"2024-05-12T11:07:44.102452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:04:58.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.316925+0000","last_change":"2024-05-12T11:06:45.316406+0000","last_active":"2024-05-12T11:06:45.316925+0000","last_peered":"2024-05-12T11:06:45.316925+0000","last_clean":"2024-05-12T11:06:45.316925+0000","last_became_active":"2024-05-12T11:06:45.310351+0000","last_became_peered":"2024-05-12T11:06:45.310351+0000","last_unstale":"2024-05-12T11:06:45.316925+0000","last_undegraded":"2024-05-12T11:06:45.316925+0000","last_fullsized":"2024-05-12T11:06:45.316925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:11.687974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.095241+0000","last_change":"2024-05-12T11:06:05.177548+0000","last_active":"2024-05-12T11:07:44.095241+0000","last_peered":"2024-05-12T11:07:44.095241+0000","last_clean":"2024-05-12T11:07:44.095241+0000","last_became_active":"2024-05-12T11:06:05.176871+0000","last_became_peered":"2024-05-12T11:06:05.176871+0000","last_unstale":"2024-05-12T11:07:44.095241+0000","last_undegraded":"2024-05-12T11:07:44.095241+0000","last_fullsized":"2024-05-12T11:07:44.095241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:38:08.347801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307748+0000","last_change":"2024-05-12T11:06:02.155096+0000","last_active":"2024-05-12T11:06:45.307748+0000","last_peered":"2024-05-12T11:06:45.307748+0000","last_clean":"2024-05-12T11:06:45.307748+0000","last_became_active":"2024-05-12T11:06:02.154721+0000","last_became_peered":"2024-05-12T11:06:02.154721+0000","last_unstale":"2024-05-12T11:06:45.307748+0000","last_undegraded":"2024-05-12T11:06:45.307748+0000","last_fullsized":"2024-05-12T11:06:45.307748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:01.407453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105378+0000","last_change":"2024-05-12T11:06:05.170305+0000","last_active":"2024-05-12T11:07:44.105378+0000","last_peered":"2024-05-12T11:07:44.105378+0000","last_clean":"2024-05-12T11:07:44.105378+0000","last_became_active":"2024-05-12T11:06:05.169970+0000","last_became_peered":"2024-05-12T11:06:05.169970+0000","last_unstale":"2024-05-12T11:07:44.105378+0000","last_undegraded":"2024-05-12T11:07:44.105378+0000","last_fullsized":"2024-05-12T11:07:44.105378+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:48:11.680873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:59.379481+0000","last_change":"2024-05-12T11:06:02.246541+0000","last_active":"2024-05-12T11:07:59.379481+0000","last_peered":"2024-05-12T11:07:59.379481+0000","last_clean":"2024-05-12T11:07:59.379481+0000","last_became_active":"2024-05-12T11:06:02.246071+0000","last_became_peered":"2024-05-12T11:06:02.246071+0000","last_unstale":"2024-05-12T11:07:59.379481+0000","last_undegraded":"2024-05-12T11:07:59.379481+0000","last_fullsized":"2024-05-12T11:07:59.379481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:27:16.649146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104848+0000","last_change":"2024-05-12T11:06:05.170566+0000","last_active":"2024-05-12T11:07:44.104848+0000","last_peered":"2024-05-12T11:07:44.104848+0000","last_clean":"2024-05-12T11:07:44.104848+0000","last_became_active":"2024-05-12T11:06:05.170225+0000","last_became_peered":"2024-05-12T11:06:05.170225+0000","last_unstale":"2024-05-12T11:07:44.104848+0000","last_undegraded":"2024-05-12T11:07:44.104848+0000","last_fullsized":"2024-05-12T11:07:44.104848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:42.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310170+0000","last_change":"2024-05-12T11:06:02.151920+0000","last_active":"2024-05-12T11:06:45.310170+0000","last_peered":"2024-05-12T11:06:45.310170+0000","last_clean":"2024-05-12T11:06:45.310170+0000","last_became_active":"2024-05-12T11:06:02.151551+0000","last_became_peered":"2024-05-12T11:06:02.151551+0000","last_unstale":"2024-05-12T11:06:45.310170+0000","last_undegraded":"2024-05-12T11:06:45.310170+0000","last_fullsized":"2024-05-12T11:06:45.310170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:11:10.230956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102435+0000","last_change":"2024-05-12T11:06:05.174964+0000","last_active":"2024-05-12T11:07:44.102435+0000","last_peered":"2024-05-12T11:07:44.102435+0000","last_clean":"2024-05-12T11:07:44.102435+0000","last_became_active":"2024-05-12T11:06:05.174562+0000","last_became_peered":"2024-05-12T11:06:05.174562+0000","last_unstale":"2024-05-12T11:07:44.102435+0000","last_undegraded":"2024-05-12T11:07:44.102435+0000","last_fullsized":"2024-05-12T11:07:44.102435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:37:22.252200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.319312+0000","last_change":"2024-05-12T11:06:45.319312+0000","last_active":"2024-05-12T11:06:45.319312+0000","last_peered":"2024-05-12T11:06:45.319312+0000","last_clean":"2024-05-12T11:06:45.319312+0000","last_became_active":"2024-05-12T11:06:45.310683+0000","last_became_peered":"2024-05-12T11:06:45.310683+0000","last_unstale":"2024-05-12T11:06:45.319312+0000","last_undegraded":"2024-05-12T11:06:45.319312+0000","last_fullsized":"2024-05-12T11:06:45.319312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:24:21.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096629+0000","last_change":"2024-05-12T11:06:05.176798+0000","last_active":"2024-05-12T11:07:44.096629+0000","last_peered":"2024-05-12T11:07:44.096629+0000","last_clean":"2024-05-12T11:07:44.096629+0000","last_became_active":"2024-05-12T11:06:05.176476+0000","last_became_peered":"2024-05-12T11:06:05.176476+0000","last_unstale":"2024-05-12T11:07:44.096629+0000","last_undegraded":"2024-05-12T11:07:44.096629+0000","last_fullsized":"2024-05-12T11:07:44.096629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:16.111038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.103777+0000","last_change":"2024-05-12T11:06:05.180278+0000","last_active":"2024-05-12T11:07:44.103777+0000","last_peered":"2024-05-12T11:07:44.103777+0000","last_clean":"2024-05-12T11:07:44.103777+0000","last_became_active":"2024-05-12T11:06:05.179863+0000","last_became_peered":"2024-05-12T11:06:05.179863+0000","last_unstale":"2024-05-12T11:07:44.103777+0000","last_undegraded":"2024-05-12T11:07:44.103777+0000","last_fullsized":"2024-05-12T11:07:44.103777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:13:32.588753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105194+0000","last_change":"2024-05-12T11:06:45.499552+0000","last_active":"2024-05-12T11:07:44.105194+0000","last_peered":"2024-05-12T11:07:44.105194+0000","last_clean":"2024-05-12T11:07:44.105194+0000","last_became_active":"2024-05-12T11:06:45.499078+0000","last_became_peered":"2024-05-12T11:06:45.499078+0000","last_unstale":"2024-05-12T11:07:44.105194+0000","last_undegraded":"2024-05-12T11:07:44.105194+0000","last_fullsized":"2024-05-12T11:07:44.105194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:41:37.019535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104213+0000","last_change":"2024-05-12T11:06:05.172282+0000","last_active":"2024-05-12T11:07:44.104213+0000","last_peered":"2024-05-12T11:07:44.104213+0000","last_clean":"2024-05-12T11:07:44.104213+0000","last_became_active":"2024-05-12T11:06:05.171930+0000","last_became_peered":"2024-05-12T11:06:05.171930+0000","last_unstale":"2024-05-12T11:07:44.104213+0000","last_undegraded":"2024-05-12T11:07:44.104213+0000","last_fullsized":"2024-05-12T11:07:44.104213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:20:56.314181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.093380+0000","last_change":"2024-05-12T11:06:05.173726+0000","last_active":"2024-05-12T11:07:44.093380+0000","last_peered":"2024-05-12T11:07:44.093380+0000","last_clean":"2024-05-12T11:07:44.093380+0000","last_became_active":"2024-05-12T11:06:05.173195+0000","last_became_peered":"2024-05-12T11:06:05.173195+0000","last_unstale":"2024-05-12T11:07:44.093380+0000","last_undegraded":"2024-05-12T11:07:44.093380+0000","last_fullsized":"2024-05-12T11:07:44.093380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:19.397213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.084186+0000","last_change":"2024-05-12T11:06:05.167841+0000","last_active":"2024-05-12T11:07:44.084186+0000","last_peered":"2024-05-12T11:07:44.084186+0000","last_clean":"2024-05-12T11:07:44.084186+0000","last_became_active":"2024-05-12T11:06:05.166577+0000","last_became_peered":"2024-05-12T11:06:05.166577+0000","last_unstale":"2024-05-12T11:07:44.084186+0000","last_undegraded":"2024-05-12T11:07:44.084186+0000","last_fullsized":"2024-05-12T11:07:44.084186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:01.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096534+0000","last_change":"2024-05-12T11:06:05.170753+0000","last_active":"2024-05-12T11:07:44.096534+0000","last_peered":"2024-05-12T11:07:44.096534+0000","last_clean":"2024-05-12T11:07:44.096534+0000","last_became_active":"2024-05-12T11:06:05.169410+0000","last_became_peered":"2024-05-12T11:06:05.169410+0000","last_unstale":"2024-05-12T11:07:44.096534+0000","last_undegraded":"2024-05-12T11:07:44.096534+0000","last_fullsized":"2024-05-12T11:07:44.096534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:42:30.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105561+0000","last_change":"2024-05-12T11:06:05.170692+0000","last_active":"2024-05-12T11:07:44.105561+0000","last_peered":"2024-05-12T11:07:44.105561+0000","last_clean":"2024-05-12T11:07:44.105561+0000","last_became_active":"2024-05-12T11:06:05.170349+0000","last_became_peered":"2024-05-12T11:06:05.170349+0000","last_unstale":"2024-05-12T11:07:44.105561+0000","last_undegraded":"2024-05-12T11:07:44.105561+0000","last_fullsized":"2024-05-12T11:07:44.105561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:13:19.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101477+0000","last_change":"2024-05-12T11:06:05.173600+0000","last_active":"2024-05-12T11:07:44.101477+0000","last_peered":"2024-05-12T11:07:44.101477+0000","last_clean":"2024-05-12T11:07:44.101477+0000","last_became_active":"2024-05-12T11:06:05.173288+0000","last_became_peered":"2024-05-12T11:06:05.173288+0000","last_unstale":"2024-05-12T11:07:44.101477+0000","last_undegraded":"2024-05-12T11:07:44.101477+0000","last_fullsized":"2024-05-12T11:07:44.101477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:06:45.082031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.094865+0000","last_change":"2024-05-12T11:06:05.169864+0000","last_active":"2024-05-12T11:07:44.094865+0000","last_peered":"2024-05-12T11:07:44.094865+0000","last_clean":"2024-05-12T11:07:44.094865+0000","last_became_active":"2024-05-12T11:06:05.169521+0000","last_became_peered":"2024-05-12T11:06:05.169521+0000","last_unstale":"2024-05-12T11:07:44.094865+0000","last_undegraded":"2024-05-12T11:07:44.094865+0000","last_fullsized":"2024-05-12T11:07:44.094865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.825436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101816+0000","last_change":"2024-05-12T11:06:05.176370+0000","last_active":"2024-05-12T11:07:44.101816+0000","last_peered":"2024-05-12T11:07:44.101816+0000","last_clean":"2024-05-12T11:07:44.101816+0000","last_became_active":"2024-05-12T11:06:05.176031+0000","last_became_peered":"2024-05-12T11:06:05.176031+0000","last_unstale":"2024-05-12T11:07:44.101816+0000","last_undegraded":"2024-05-12T11:07:44.101816+0000","last_fullsized":"2024-05-12T11:07:44.101816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:32:52.893909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.100369+0000","last_change":"2024-05-12T11:06:05.170708+0000","last_active":"2024-05-12T11:07:44.100369+0000","last_peered":"2024-05-12T11:07:44.100369+0000","last_clean":"2024-05-12T11:07:44.100369+0000","last_became_active":"2024-05-12T11:06:05.169591+0000","last_became_peered":"2024-05-12T11:06:05.169591+0000","last_unstale":"2024-05-12T11:07:44.100369+0000","last_undegraded":"2024-05-12T11:07:44.100369+0000","last_fullsized":"2024-05-12T11:07:44.100369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:08.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.097234+0000","last_change":"2024-05-12T11:06:05.172614+0000","last_active":"2024-05-12T11:07:44.097234+0000","last_peered":"2024-05-12T11:07:44.097234+0000","last_clean":"2024-05-12T11:07:44.097234+0000","last_became_active":"2024-05-12T11:06:05.172290+0000","last_became_peered":"2024-05-12T11:06:05.172290+0000","last_unstale":"2024-05-12T11:07:44.097234+0000","last_undegraded":"2024-05-12T11:07:44.097234+0000","last_fullsized":"2024-05-12T11:07:44.097234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:32.169139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104940+0000","last_change":"2024-05-12T11:06:05.171333+0000","last_active":"2024-05-12T11:07:44.104940+0000","last_peered":"2024-05-12T11:07:44.104940+0000","last_clean":"2024-05-12T11:07:44.104940+0000","last_became_active":"2024-05-12T11:06:05.170035+0000","last_became_peered":"2024-05-12T11:06:05.170035+0000","last_unstale":"2024-05-12T11:07:44.104940+0000","last_undegraded":"2024-05-12T11:07:44.104940+0000","last_fullsized":"2024-05-12T11:07:44.104940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:18.852851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280976,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69029,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1014,"num_read_kb":582,"num_write":252,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645352,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":434049,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841580,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1048576,"data_stored":1086571,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005106,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":433397,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201335,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":909312,"data_stored":433193,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1026434,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":433114,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":962560,"data_stored":496102,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":434453,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":496742,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149775,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":917504,"data_stored":432939,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":909312,"data_stored":433087,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757319,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":978944,"data_stored":1026112,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T11:08:02.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-12T11:08:03.170 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:03.445 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:03 smithi086 ceph-mon[30110]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:03.445 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:03 smithi086 ceph-mon[30110]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:08:03.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:03 smithi172 ceph-mon[34517]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:03.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:03 smithi172 ceph-mon[34517]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:08:03.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:03 smithi176 ceph-mon[34357]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:03.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:03 smithi176 ceph-mon[34357]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:08:04.357 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:04 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:08:04.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:04 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:08:04.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:04 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:08:04.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 -- 172.21.15.86:0/3137114748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 msgr2=0x7f3ec81103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:04.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/3137114748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 0x7f3ec81103d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000b0d0 tx=0x7f3ec000b3e0 comp rx=0 tx=0).stop 2024-05-12T11:08:04.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 -- 172.21.15.86:0/3137114748 shutdown_connections 2024-05-12T11:08:04.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/3137114748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 0x7f3ec81103d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:04.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/3137114748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ec8103750 0x7f3ec8103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:04.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/3137114748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8104100 0x7f3ec8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:04.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 -- 172.21.15.86:0/3137114748 >> 172.21.15.86:0/3137114748 conn(0x7f3ec807a600 msgr2=0x7f3ec807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:04.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 -- 172.21.15.86:0/3137114748 shutdown_connections 2024-05-12T11:08:04.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.880+0000 7f3ecd31e700 1 -- 172.21.15.86:0/3137114748 wait complete. 2024-05-12T11:08:04.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.881+0000 7f3ecd31e700 1 Processor -- start 2024-05-12T11:08:04.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.881+0000 7f3ecd31e700 1 -- start start 2024-05-12T11:08:04.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.881+0000 7f3ecd31e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8103750 0x7f3ec81a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:04.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.881+0000 7f3ecd31e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ec8104100 0x7f3ec81a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.881+0000 7f3ecd31e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 0x7f3ec819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.881+0000 7f3ecd31e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec8113640 con 0x7f3ec8108850 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.881+0000 7f3ecd31e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec81134c0 con 0x7f3ec8103750 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.881+0000 7f3ecd31e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec81137c0 con 0x7f3ec8104100 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec67fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ec8104100 0x7f3ec81a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 0x7f3ec819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec67fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ec8104100 0x7f3ec81a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.86:34362/0 (socket says 172.21.15.86:34362) 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 0x7f3ec819ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36360/0 (socket says 172.21.15.86:36360) 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec67fc700 1 -- 172.21.15.86:0/1269701082 learned_addr learned my addr 172.21.15.86:0/1269701082 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec6ffd700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8103750 0x7f3ec81a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec77fe700 1 -- 172.21.15.86:0/1269701082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ec8104100 msgr2=0x7f3ec81a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec77fe700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ec8104100 0x7f3ec81a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec77fe700 1 -- 172.21.15.86:0/1269701082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8103750 msgr2=0x7f3ec81a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec77fe700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8103750 0x7f3ec81a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec77fe700 1 -- 172.21.15.86:0/1269701082 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec819c1d0 con 0x7f3ec8108850 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ec77fe700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 0x7f3ec819ba70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009fd0 tx=0x7f3ec0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3eaffff700 1 -- 172.21.15.86:0/1269701082 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0021020 con 0x7f3ec8108850 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3eaffff700 1 -- 172.21.15.86:0/1269701082 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ec0007e40 con 0x7f3ec8108850 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec819c460 con 0x7f3ec8108850 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3eaffff700 1 -- 172.21.15.86:0/1269701082 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0005050 con 0x7f3ec8108850 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.882+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec81a8780 con 0x7f3ec8108850 2024-05-12T11:08:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.883+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec806a190 con 0x7f3ec8108850 2024-05-12T11:08:04.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.885+0000 7f3eaffff700 1 -- 172.21.15.86:0/1269701082 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3ec0024020 con 0x7f3ec8108850 2024-05-12T11:08:04.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.885+0000 7f3eaffff700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3eb00b2880 0x7f3eb00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:04.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.885+0000 7f3ec6ffd700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3eb00b2880 0x7f3eb00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:04.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.885+0000 7f3eaffff700 1 -- 172.21.15.86:0/1269701082 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3ec000f020 con 0x7f3ec8108850 2024-05-12T11:08:04.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.886+0000 7f3ec6ffd700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3eb00b2880 0x7f3eb00b4d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3ec819cbb0 tx=0x7f3eb800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:04.889+0000 7f3eaffff700 1 -- 172.21.15.86:0/1269701082 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3ec00ab410 con 0x7f3ec8108850 2024-05-12T11:08:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.104+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ec810f730 con 0x7f3eb00b2880 2024-05-12T11:08:05.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.111+0000 7f3eaffff700 1 -- 172.21.15.86:0/1269701082 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259127 (secure 0 0 0) 0x7f3ec810f730 con 0x7f3eb00b2880 2024-05-12T11:08:05.105 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3eb00b2880 msgr2=0x7f3eb00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3eb00b2880 0x7f3eb00b4d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3ec819cbb0 tx=0x7f3eb800b3c0 comp rx=0 tx=0).stop 2024-05-12T11:08:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 msgr2=0x7f3ec819ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 0x7f3ec819ba70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009fd0 tx=0x7f3ec0007a00 comp rx=0 tx=0).stop 2024-05-12T11:08:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 shutdown_connections 2024-05-12T11:08:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3eb00b2880 0x7f3eb00b4d40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec8108850 0x7f3ec819ba70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8103750 0x7f3ec81a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 --2- 172.21.15.86:0/1269701082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ec8104100 0x7f3ec81a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 >> 172.21.15.86:0/1269701082 conn(0x7f3ec807a600 msgr2=0x7f3ec81017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 shutdown_connections 2024-05-12T11:08:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:05.114+0000 7f3ecd31e700 1 -- 172.21.15.86:0/1269701082 wait complete. 2024-05-12T11:08:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-05-12T11:08:05.912 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-05-12T11:08:04.099552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659631,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1105,"num_read_kb":656,"num_write":377,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":2952534,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":810,"ondisk_log_size":810,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372672,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569152,"statfs":{"total":1151940427776,"available":1151558811648,"internally_reserved":0,"allocated":11304960,"data_stored":7166193,"data_compressed":175989,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003153"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102988+0000","last_change":"2024-05-12T11:06:05.173542+0000","last_active":"2024-05-12T11:07:44.102988+0000","last_peered":"2024-05-12T11:07:44.102988+0000","last_clean":"2024-05-12T11:07:44.102988+0000","last_became_active":"2024-05-12T11:06:05.173221+0000","last_became_peered":"2024-05-12T11:06:05.173221+0000","last_unstale":"2024-05-12T11:07:44.102988+0000","last_undegraded":"2024-05-12T11:07:44.102988+0000","last_fullsized":"2024-05-12T11:07:44.102988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102967+0000","last_change":"2024-05-12T11:06:05.178626+0000","last_active":"2024-05-12T11:07:44.102967+0000","last_peered":"2024-05-12T11:07:44.102967+0000","last_clean":"2024-05-12T11:07:44.102967+0000","last_became_active":"2024-05-12T11:06:05.178313+0000","last_became_peered":"2024-05-12T11:06:05.178313+0000","last_unstale":"2024-05-12T11:07:44.102967+0000","last_undegraded":"2024-05-12T11:07:44.102967+0000","last_fullsized":"2024-05-12T11:07:44.102967+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:45:25.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105439+0000","last_change":"2024-05-12T11:06:05.175396+0000","last_active":"2024-05-12T11:07:44.105439+0000","last_peered":"2024-05-12T11:07:44.105439+0000","last_clean":"2024-05-12T11:07:44.105439+0000","last_became_active":"2024-05-12T11:06:05.175060+0000","last_became_peered":"2024-05-12T11:06:05.175060+0000","last_unstale":"2024-05-12T11:07:44.105439+0000","last_undegraded":"2024-05-12T11:07:44.105439+0000","last_fullsized":"2024-05-12T11:07:44.105439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:55:08.180220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.098904+0000","last_change":"2024-05-12T11:06:05.172900+0000","last_active":"2024-05-12T11:07:44.098904+0000","last_peered":"2024-05-12T11:07:44.098904+0000","last_clean":"2024-05-12T11:07:44.098904+0000","last_became_active":"2024-05-12T11:06:05.172549+0000","last_became_peered":"2024-05-12T11:06:05.172549+0000","last_unstale":"2024-05-12T11:07:44.098904+0000","last_undegraded":"2024-05-12T11:07:44.098904+0000","last_fullsized":"2024-05-12T11:07:44.098904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:07:39.683046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.092871+0000","last_change":"2024-05-12T11:06:05.168126+0000","last_active":"2024-05-12T11:07:44.092871+0000","last_peered":"2024-05-12T11:07:44.092871+0000","last_clean":"2024-05-12T11:07:44.092871+0000","last_became_active":"2024-05-12T11:06:05.167729+0000","last_became_peered":"2024-05-12T11:06:05.167729+0000","last_unstale":"2024-05-12T11:07:44.092871+0000","last_undegraded":"2024-05-12T11:07:44.092871+0000","last_fullsized":"2024-05-12T11:07:44.092871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:38.996242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.103135+0000","last_change":"2024-05-12T11:06:05.180165+0000","last_active":"2024-05-12T11:07:44.103135+0000","last_peered":"2024-05-12T11:07:44.103135+0000","last_clean":"2024-05-12T11:07:44.103135+0000","last_became_active":"2024-05-12T11:06:05.179589+0000","last_became_peered":"2024-05-12T11:06:05.179589+0000","last_unstale":"2024-05-12T11:07:44.103135+0000","last_undegraded":"2024-05-12T11:07:44.103135+0000","last_fullsized":"2024-05-12T11:07:44.103135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:51:53.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101511+0000","last_change":"2024-05-12T11:06:05.176052+0000","last_active":"2024-05-12T11:07:44.101511+0000","last_peered":"2024-05-12T11:07:44.101511+0000","last_clean":"2024-05-12T11:07:44.101511+0000","last_became_active":"2024-05-12T11:06:05.175703+0000","last_became_peered":"2024-05-12T11:06:05.175703+0000","last_unstale":"2024-05-12T11:07:44.101511+0000","last_undegraded":"2024-05-12T11:07:44.101511+0000","last_fullsized":"2024-05-12T11:07:44.101511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:51:11.008516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.098373+0000","last_change":"2024-05-12T11:06:05.179144+0000","last_active":"2024-05-12T11:07:44.098373+0000","last_peered":"2024-05-12T11:07:44.098373+0000","last_clean":"2024-05-12T11:07:44.098373+0000","last_became_active":"2024-05-12T11:06:05.177854+0000","last_became_peered":"2024-05-12T11:06:05.177854+0000","last_unstale":"2024-05-12T11:07:44.098373+0000","last_undegraded":"2024-05-12T11:07:44.098373+0000","last_fullsized":"2024-05-12T11:07:44.098373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:12.231086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.086230+0000","last_change":"2024-05-12T11:06:45.310743+0000","last_active":"2024-05-12T11:07:44.086230+0000","last_peered":"2024-05-12T11:07:44.086230+0000","last_clean":"2024-05-12T11:07:44.086230+0000","last_became_active":"2024-05-12T11:06:45.310358+0000","last_became_peered":"2024-05-12T11:06:45.310358+0000","last_unstale":"2024-05-12T11:07:44.086230+0000","last_undegraded":"2024-05-12T11:07:44.086230+0000","last_fullsized":"2024-05-12T11:07:44.086230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:22:30.862132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.103130+0000","last_change":"2024-05-12T11:06:05.176196+0000","last_active":"2024-05-12T11:07:44.103130+0000","last_peered":"2024-05-12T11:07:44.103130+0000","last_clean":"2024-05-12T11:07:44.103130+0000","last_became_active":"2024-05-12T11:06:05.175863+0000","last_became_peered":"2024-05-12T11:06:05.175863+0000","last_unstale":"2024-05-12T11:07:44.103130+0000","last_undegraded":"2024-05-12T11:07:44.103130+0000","last_fullsized":"2024-05-12T11:07:44.103130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:26:41.815661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104907+0000","last_change":"2024-05-12T11:06:05.175901+0000","last_active":"2024-05-12T11:07:44.104907+0000","last_peered":"2024-05-12T11:07:44.104907+0000","last_clean":"2024-05-12T11:07:44.104907+0000","last_became_active":"2024-05-12T11:06:05.175514+0000","last_became_peered":"2024-05-12T11:06:05.175514+0000","last_unstale":"2024-05-12T11:07:44.104907+0000","last_undegraded":"2024-05-12T11:07:44.104907+0000","last_fullsized":"2024-05-12T11:07:44.104907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:11.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.094212+0000","last_change":"2024-05-12T11:06:05.175474+0000","last_active":"2024-05-12T11:07:44.094212+0000","last_peered":"2024-05-12T11:07:44.094212+0000","last_clean":"2024-05-12T11:07:44.094212+0000","last_became_active":"2024-05-12T11:06:05.175082+0000","last_became_peered":"2024-05-12T11:06:05.175082+0000","last_unstale":"2024-05-12T11:07:44.094212+0000","last_undegraded":"2024-05-12T11:07:44.094212+0000","last_fullsized":"2024-05-12T11:07:44.094212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:10:53.548758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.094735+0000","last_change":"2024-05-12T11:06:05.170426+0000","last_active":"2024-05-12T11:07:44.094735+0000","last_peered":"2024-05-12T11:07:44.094735+0000","last_clean":"2024-05-12T11:07:44.094735+0000","last_became_active":"2024-05-12T11:06:05.170111+0000","last_became_peered":"2024-05-12T11:06:05.170111+0000","last_unstale":"2024-05-12T11:07:44.094735+0000","last_undegraded":"2024-05-12T11:07:44.094735+0000","last_fullsized":"2024-05-12T11:07:44.094735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:50.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096947+0000","last_change":"2024-05-12T11:06:05.178939+0000","last_active":"2024-05-12T11:07:44.096947+0000","last_peered":"2024-05-12T11:07:44.096947+0000","last_clean":"2024-05-12T11:07:44.096947+0000","last_became_active":"2024-05-12T11:06:05.178604+0000","last_became_peered":"2024-05-12T11:06:05.178604+0000","last_unstale":"2024-05-12T11:07:44.096947+0000","last_undegraded":"2024-05-12T11:07:44.096947+0000","last_fullsized":"2024-05-12T11:07:44.096947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:36.222841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104752+0000","last_change":"2024-05-12T11:06:45.312800+0000","last_active":"2024-05-12T11:07:44.104752+0000","last_peered":"2024-05-12T11:07:44.104752+0000","last_clean":"2024-05-12T11:07:44.104752+0000","last_became_active":"2024-05-12T11:06:45.312567+0000","last_became_peered":"2024-05-12T11:06:45.312567+0000","last_unstale":"2024-05-12T11:07:44.104752+0000","last_undegraded":"2024-05-12T11:07:44.104752+0000","last_fullsized":"2024-05-12T11:07:44.104752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:30:21.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104070+0000","last_change":"2024-05-12T11:06:05.170481+0000","last_active":"2024-05-12T11:07:44.104070+0000","last_peered":"2024-05-12T11:07:44.104070+0000","last_clean":"2024-05-12T11:07:44.104070+0000","last_became_active":"2024-05-12T11:06:05.170173+0000","last_became_peered":"2024-05-12T11:06:05.170173+0000","last_unstale":"2024-05-12T11:07:44.104070+0000","last_undegraded":"2024-05-12T11:07:44.104070+0000","last_fullsized":"2024-05-12T11:07:44.104070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:01:37.775287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.103123+0000","last_change":"2024-05-12T11:06:05.172942+0000","last_active":"2024-05-12T11:07:44.103123+0000","last_peered":"2024-05-12T11:07:44.103123+0000","last_clean":"2024-05-12T11:07:44.103123+0000","last_became_active":"2024-05-12T11:06:05.172612+0000","last_became_peered":"2024-05-12T11:06:05.172612+0000","last_unstale":"2024-05-12T11:07:44.103123+0000","last_undegraded":"2024-05-12T11:07:44.103123+0000","last_fullsized":"2024-05-12T11:07:44.103123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:26:51.548027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.089667+0000","last_change":"2024-05-12T11:06:05.175400+0000","last_active":"2024-05-12T11:07:44.089667+0000","last_peered":"2024-05-12T11:07:44.089667+0000","last_clean":"2024-05-12T11:07:44.089667+0000","last_became_active":"2024-05-12T11:06:05.174871+0000","last_became_peered":"2024-05-12T11:06:05.174871+0000","last_unstale":"2024-05-12T11:07:44.089667+0000","last_undegraded":"2024-05-12T11:07:44.089667+0000","last_fullsized":"2024-05-12T11:07:44.089667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:48:12.566540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101125+0000","last_change":"2024-05-12T11:06:05.172584+0000","last_active":"2024-05-12T11:07:44.101125+0000","last_peered":"2024-05-12T11:07:44.101125+0000","last_clean":"2024-05-12T11:07:44.101125+0000","last_became_active":"2024-05-12T11:06:05.171545+0000","last_became_peered":"2024-05-12T11:06:05.171545+0000","last_unstale":"2024-05-12T11:07:44.101125+0000","last_undegraded":"2024-05-12T11:07:44.101125+0000","last_fullsized":"2024-05-12T11:07:44.101125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:34:45.950231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":141,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:08:02.381434+0000","last_change":"2024-05-12T11:06:02.148890+0000","last_active":"2024-05-12T11:08:02.381434+0000","last_peered":"2024-05-12T11:08:02.381434+0000","last_clean":"2024-05-12T11:08:02.381434+0000","last_became_active":"2024-05-12T11:06:02.148544+0000","last_became_peered":"2024-05-12T11:06:02.148544+0000","last_unstale":"2024-05-12T11:08:02.381434+0000","last_undegraded":"2024-05-12T11:08:02.381434+0000","last_fullsized":"2024-05-12T11:08:02.381434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:34.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104796+0000","last_change":"2024-05-12T11:06:05.175214+0000","last_active":"2024-05-12T11:07:44.104796+0000","last_peered":"2024-05-12T11:07:44.104796+0000","last_clean":"2024-05-12T11:07:44.104796+0000","last_became_active":"2024-05-12T11:06:05.174920+0000","last_became_peered":"2024-05-12T11:06:05.174920+0000","last_unstale":"2024-05-12T11:07:44.104796+0000","last_undegraded":"2024-05-12T11:07:44.104796+0000","last_fullsized":"2024-05-12T11:07:44.104796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:30:36.277975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307920+0000","last_change":"2024-05-12T11:06:02.246073+0000","last_active":"2024-05-12T11:06:45.307920+0000","last_peered":"2024-05-12T11:06:45.307920+0000","last_clean":"2024-05-12T11:06:45.307920+0000","last_became_active":"2024-05-12T11:06:02.245728+0000","last_became_peered":"2024-05-12T11:06:02.245728+0000","last_unstale":"2024-05-12T11:06:45.307920+0000","last_undegraded":"2024-05-12T11:06:45.307920+0000","last_fullsized":"2024-05-12T11:06:45.307920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:43:03.273179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105198+0000","last_change":"2024-05-12T11:06:05.170448+0000","last_active":"2024-05-12T11:07:44.105198+0000","last_peered":"2024-05-12T11:07:44.105198+0000","last_clean":"2024-05-12T11:07:44.105198+0000","last_became_active":"2024-05-12T11:06:05.170133+0000","last_became_peered":"2024-05-12T11:06:05.170133+0000","last_unstale":"2024-05-12T11:07:44.105198+0000","last_undegraded":"2024-05-12T11:07:44.105198+0000","last_fullsized":"2024-05-12T11:07:44.105198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:17:30.669009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307324+0000","last_change":"2024-05-12T11:06:02.155137+0000","last_active":"2024-05-12T11:06:45.307324+0000","last_peered":"2024-05-12T11:06:45.307324+0000","last_clean":"2024-05-12T11:06:45.307324+0000","last_became_active":"2024-05-12T11:06:02.154467+0000","last_became_peered":"2024-05-12T11:06:02.154467+0000","last_unstale":"2024-05-12T11:06:45.307324+0000","last_undegraded":"2024-05-12T11:06:45.307324+0000","last_fullsized":"2024-05-12T11:06:45.307324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:38.708094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105057+0000","last_change":"2024-05-12T11:06:05.180903+0000","last_active":"2024-05-12T11:07:44.105057+0000","last_peered":"2024-05-12T11:07:44.105057+0000","last_clean":"2024-05-12T11:07:44.105057+0000","last_became_active":"2024-05-12T11:06:05.180519+0000","last_became_peered":"2024-05-12T11:06:05.180519+0000","last_unstale":"2024-05-12T11:07:44.105057+0000","last_undegraded":"2024-05-12T11:07:44.105057+0000","last_fullsized":"2024-05-12T11:07:44.105057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:57:47.535714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.325802+0000","last_change":"2024-05-12T11:06:45.325333+0000","last_active":"2024-05-12T11:06:45.325802+0000","last_peered":"2024-05-12T11:06:45.325802+0000","last_clean":"2024-05-12T11:06:45.325802+0000","last_became_active":"2024-05-12T11:06:45.312552+0000","last_became_peered":"2024-05-12T11:06:45.312552+0000","last_unstale":"2024-05-12T11:06:45.325802+0000","last_undegraded":"2024-05-12T11:06:45.325802+0000","last_fullsized":"2024-05-12T11:06:45.325802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:45.862620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.100090+0000","last_change":"2024-05-12T11:06:05.167052+0000","last_active":"2024-05-12T11:07:44.100090+0000","last_peered":"2024-05-12T11:07:44.100090+0000","last_clean":"2024-05-12T11:07:44.100090+0000","last_became_active":"2024-05-12T11:06:05.166689+0000","last_became_peered":"2024-05-12T11:06:05.166689+0000","last_unstale":"2024-05-12T11:07:44.100090+0000","last_undegraded":"2024-05-12T11:07:44.100090+0000","last_fullsized":"2024-05-12T11:07:44.100090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:34:05.008336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:59.380007+0000","last_change":"2024-05-12T11:06:02.154630+0000","last_active":"2024-05-12T11:07:59.380007+0000","last_peered":"2024-05-12T11:07:59.380007+0000","last_clean":"2024-05-12T11:07:59.380007+0000","last_became_active":"2024-05-12T11:06:02.154254+0000","last_became_peered":"2024-05-12T11:06:02.154254+0000","last_unstale":"2024-05-12T11:07:59.380007+0000","last_undegraded":"2024-05-12T11:07:59.380007+0000","last_fullsized":"2024-05-12T11:07:59.380007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:54.294058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.086011+0000","last_change":"2024-05-12T11:06:05.176582+0000","last_active":"2024-05-12T11:07:44.086011+0000","last_peered":"2024-05-12T11:07:44.086011+0000","last_clean":"2024-05-12T11:07:44.086011+0000","last_became_active":"2024-05-12T11:06:05.176241+0000","last_became_peered":"2024-05-12T11:06:05.176241+0000","last_unstale":"2024-05-12T11:07:44.086011+0000","last_undegraded":"2024-05-12T11:07:44.086011+0000","last_fullsized":"2024-05-12T11:07:44.086011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:09:00.020166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.304182+0000","last_change":"2024-05-12T11:06:02.148534+0000","last_active":"2024-05-12T11:06:45.304182+0000","last_peered":"2024-05-12T11:06:45.304182+0000","last_clean":"2024-05-12T11:06:45.304182+0000","last_became_active":"2024-05-12T11:06:02.148155+0000","last_became_peered":"2024-05-12T11:06:02.148155+0000","last_unstale":"2024-05-12T11:06:45.304182+0000","last_undegraded":"2024-05-12T11:06:45.304182+0000","last_fullsized":"2024-05-12T11:06:45.304182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:52:21.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.091275+0000","last_change":"2024-05-12T11:06:05.169944+0000","last_active":"2024-05-12T11:07:44.091275+0000","last_peered":"2024-05-12T11:07:44.091275+0000","last_clean":"2024-05-12T11:07:44.091275+0000","last_became_active":"2024-05-12T11:06:05.169597+0000","last_became_peered":"2024-05-12T11:06:05.169597+0000","last_unstale":"2024-05-12T11:07:44.091275+0000","last_undegraded":"2024-05-12T11:07:44.091275+0000","last_fullsized":"2024-05-12T11:07:44.091275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:05:17.724037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305926+0000","last_change":"2024-05-12T11:06:02.154539+0000","last_active":"2024-05-12T11:06:45.305926+0000","last_peered":"2024-05-12T11:06:45.305926+0000","last_clean":"2024-05-12T11:06:45.305926+0000","last_became_active":"2024-05-12T11:06:02.154040+0000","last_became_peered":"2024-05-12T11:06:02.154040+0000","last_unstale":"2024-05-12T11:06:45.305926+0000","last_undegraded":"2024-05-12T11:06:45.305926+0000","last_fullsized":"2024-05-12T11:06:45.305926+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:10:23.875273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.081916+0000","last_change":"2024-05-12T11:06:45.308950+0000","last_active":"2024-05-12T11:07:44.081916+0000","last_peered":"2024-05-12T11:07:44.081916+0000","last_clean":"2024-05-12T11:07:44.081916+0000","last_became_active":"2024-05-12T11:06:45.308579+0000","last_became_peered":"2024-05-12T11:06:45.308579+0000","last_unstale":"2024-05-12T11:07:44.081916+0000","last_undegraded":"2024-05-12T11:07:44.081916+0000","last_fullsized":"2024-05-12T11:07:44.081916+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:01:08.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306812+0000","last_change":"2024-05-12T11:06:02.151341+0000","last_active":"2024-05-12T11:06:45.306812+0000","last_peered":"2024-05-12T11:06:45.306812+0000","last_clean":"2024-05-12T11:06:45.306812+0000","last_became_active":"2024-05-12T11:06:02.150949+0000","last_became_peered":"2024-05-12T11:06:02.150949+0000","last_unstale":"2024-05-12T11:06:45.306812+0000","last_undegraded":"2024-05-12T11:06:45.306812+0000","last_fullsized":"2024-05-12T11:06:45.306812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:07:26.699269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.094624+0000","last_change":"2024-05-12T11:06:05.173060+0000","last_active":"2024-05-12T11:07:44.094624+0000","last_peered":"2024-05-12T11:07:44.094624+0000","last_clean":"2024-05-12T11:07:44.094624+0000","last_became_active":"2024-05-12T11:06:05.172756+0000","last_became_peered":"2024-05-12T11:06:05.172756+0000","last_unstale":"2024-05-12T11:07:44.094624+0000","last_undegraded":"2024-05-12T11:07:44.094624+0000","last_fullsized":"2024-05-12T11:07:44.094624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:15:12.797466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":225,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:59.378861+0000","last_change":"2024-05-12T11:06:02.152219+0000","last_active":"2024-05-12T11:07:59.378861+0000","last_peered":"2024-05-12T11:07:59.378861+0000","last_clean":"2024-05-12T11:07:59.378861+0000","last_became_active":"2024-05-12T11:06:02.151707+0000","last_became_peered":"2024-05-12T11:06:02.151707+0000","last_unstale":"2024-05-12T11:07:59.378861+0000","last_undegraded":"2024-05-12T11:07:59.378861+0000","last_fullsized":"2024-05-12T11:07:59.378861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:43.047957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105153+0000","last_change":"2024-05-12T11:06:05.173436+0000","last_active":"2024-05-12T11:07:44.105153+0000","last_peered":"2024-05-12T11:07:44.105153+0000","last_clean":"2024-05-12T11:07:44.105153+0000","last_became_active":"2024-05-12T11:06:05.173057+0000","last_became_peered":"2024-05-12T11:06:05.173057+0000","last_unstale":"2024-05-12T11:07:44.105153+0000","last_undegraded":"2024-05-12T11:07:44.105153+0000","last_fullsized":"2024-05-12T11:07:44.105153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.408017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351515+0000","last_change":"2024-05-12T11:06:02.155037+0000","last_active":"2024-05-12T11:06:45.351515+0000","last_peered":"2024-05-12T11:06:45.351515+0000","last_clean":"2024-05-12T11:06:45.351515+0000","last_became_active":"2024-05-12T11:06:02.154658+0000","last_became_peered":"2024-05-12T11:06:02.154658+0000","last_unstale":"2024-05-12T11:06:45.351515+0000","last_undegraded":"2024-05-12T11:06:45.351515+0000","last_fullsized":"2024-05-12T11:06:45.351515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:58:16.633636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.095974+0000","last_change":"2024-05-12T11:06:05.176100+0000","last_active":"2024-05-12T11:07:44.095974+0000","last_peered":"2024-05-12T11:07:44.095974+0000","last_clean":"2024-05-12T11:07:44.095974+0000","last_became_active":"2024-05-12T11:06:05.175385+0000","last_became_peered":"2024-05-12T11:06:05.175385+0000","last_unstale":"2024-05-12T11:07:44.095974+0000","last_undegraded":"2024-05-12T11:07:44.095974+0000","last_fullsized":"2024-05-12T11:07:44.095974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:10.627583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310308+0000","last_change":"2024-05-12T11:06:02.246427+0000","last_active":"2024-05-12T11:06:45.310308+0000","last_peered":"2024-05-12T11:06:45.310308+0000","last_clean":"2024-05-12T11:06:45.310308+0000","last_became_active":"2024-05-12T11:06:02.246068+0000","last_became_peered":"2024-05-12T11:06:02.246068+0000","last_unstale":"2024-05-12T11:06:45.310308+0000","last_undegraded":"2024-05-12T11:06:45.310308+0000","last_fullsized":"2024-05-12T11:06:45.310308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:40:25.533391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.093782+0000","last_change":"2024-05-12T11:06:45.310358+0000","last_active":"2024-05-12T11:07:44.093782+0000","last_peered":"2024-05-12T11:07:44.093782+0000","last_clean":"2024-05-12T11:07:44.093782+0000","last_became_active":"2024-05-12T11:06:45.309960+0000","last_became_peered":"2024-05-12T11:06:45.309960+0000","last_unstale":"2024-05-12T11:07:44.093782+0000","last_undegraded":"2024-05-12T11:07:44.093782+0000","last_fullsized":"2024-05-12T11:07:44.093782+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:28.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'35","reported_seq":265,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:59.378853+0000","last_change":"2024-05-12T11:06:02.151099+0000","last_active":"2024-05-12T11:07:59.378853+0000","last_peered":"2024-05-12T11:07:59.378853+0000","last_clean":"2024-05-12T11:07:59.378853+0000","last_became_active":"2024-05-12T11:06:02.150702+0000","last_became_peered":"2024-05-12T11:06:02.150702+0000","last_unstale":"2024-05-12T11:07:59.378853+0000","last_undegraded":"2024-05-12T11:07:59.378853+0000","last_fullsized":"2024-05-12T11:07:59.378853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:14:00.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62075,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":162,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.084473+0000","last_change":"2024-05-12T11:06:05.171016+0000","last_active":"2024-05-12T11:07:44.084473+0000","last_peered":"2024-05-12T11:07:44.084473+0000","last_clean":"2024-05-12T11:07:44.084473+0000","last_became_active":"2024-05-12T11:06:05.170659+0000","last_became_peered":"2024-05-12T11:06:05.170659+0000","last_unstale":"2024-05-12T11:07:44.084473+0000","last_undegraded":"2024-05-12T11:07:44.084473+0000","last_fullsized":"2024-05-12T11:07:44.084473+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:13:00.756621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306762+0000","last_change":"2024-05-12T11:06:02.153854+0000","last_active":"2024-05-12T11:06:45.306762+0000","last_peered":"2024-05-12T11:06:45.306762+0000","last_clean":"2024-05-12T11:06:45.306762+0000","last_became_active":"2024-05-12T11:06:02.153501+0000","last_became_peered":"2024-05-12T11:06:02.153501+0000","last_unstale":"2024-05-12T11:06:45.306762+0000","last_undegraded":"2024-05-12T11:06:45.306762+0000","last_fullsized":"2024-05-12T11:06:45.306762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:42:37.608641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096971+0000","last_change":"2024-05-12T11:06:05.169348+0000","last_active":"2024-05-12T11:07:44.096971+0000","last_peered":"2024-05-12T11:07:44.096971+0000","last_clean":"2024-05-12T11:07:44.096971+0000","last_became_active":"2024-05-12T11:06:05.169031+0000","last_became_peered":"2024-05-12T11:06:05.169031+0000","last_unstale":"2024-05-12T11:07:44.096971+0000","last_undegraded":"2024-05-12T11:07:44.096971+0000","last_fullsized":"2024-05-12T11:07:44.096971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:07:13.104465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308102+0000","last_change":"2024-05-12T11:06:02.152482+0000","last_active":"2024-05-12T11:06:45.308102+0000","last_peered":"2024-05-12T11:06:45.308102+0000","last_clean":"2024-05-12T11:06:45.308102+0000","last_became_active":"2024-05-12T11:06:02.152077+0000","last_became_peered":"2024-05-12T11:06:02.152077+0000","last_unstale":"2024-05-12T11:06:45.308102+0000","last_undegraded":"2024-05-12T11:06:45.308102+0000","last_fullsized":"2024-05-12T11:06:45.308102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:42.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104312+0000","last_change":"2024-05-12T11:06:05.175228+0000","last_active":"2024-05-12T11:07:44.104312+0000","last_peered":"2024-05-12T11:07:44.104312+0000","last_clean":"2024-05-12T11:07:44.104312+0000","last_became_active":"2024-05-12T11:06:05.174892+0000","last_became_peered":"2024-05-12T11:06:05.174892+0000","last_unstale":"2024-05-12T11:07:44.104312+0000","last_undegraded":"2024-05-12T11:07:44.104312+0000","last_fullsized":"2024-05-12T11:07:44.104312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:34.581296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:08:00.380009+0000","last_change":"2024-05-12T11:06:02.149923+0000","last_active":"2024-05-12T11:08:00.380009+0000","last_peered":"2024-05-12T11:08:00.380009+0000","last_clean":"2024-05-12T11:08:00.380009+0000","last_became_active":"2024-05-12T11:06:02.149571+0000","last_became_peered":"2024-05-12T11:06:02.149571+0000","last_unstale":"2024-05-12T11:08:00.380009+0000","last_undegraded":"2024-05-12T11:08:00.380009+0000","last_fullsized":"2024-05-12T11:08:00.380009+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:23:36.118502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.099965+0000","last_change":"2024-05-12T11:06:05.178843+0000","last_active":"2024-05-12T11:07:44.099965+0000","last_peered":"2024-05-12T11:07:44.099965+0000","last_clean":"2024-05-12T11:07:44.099965+0000","last_became_active":"2024-05-12T11:06:05.178526+0000","last_became_peered":"2024-05-12T11:06:05.178526+0000","last_unstale":"2024-05-12T11:07:44.099965+0000","last_undegraded":"2024-05-12T11:07:44.099965+0000","last_fullsized":"2024-05-12T11:07:44.099965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:57.760329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.512231+0000","last_change":"2024-05-12T11:06:45.512231+0000","last_active":"2024-05-12T11:06:45.512231+0000","last_peered":"2024-05-12T11:06:45.512231+0000","last_clean":"2024-05-12T11:06:45.512231+0000","last_became_active":"2024-05-12T11:06:45.499482+0000","last_became_peered":"2024-05-12T11:06:45.499482+0000","last_unstale":"2024-05-12T11:06:45.512231+0000","last_undegraded":"2024-05-12T11:06:45.512231+0000","last_fullsized":"2024-05-12T11:06:45.512231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:34:43.986131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.093913+0000","last_change":"2024-05-12T11:06:05.168307+0000","last_active":"2024-05-12T11:07:44.093913+0000","last_peered":"2024-05-12T11:07:44.093913+0000","last_clean":"2024-05-12T11:07:44.093913+0000","last_became_active":"2024-05-12T11:06:05.167606+0000","last_became_peered":"2024-05-12T11:06:05.167606+0000","last_unstale":"2024-05-12T11:07:44.093913+0000","last_undegraded":"2024-05-12T11:07:44.093913+0000","last_fullsized":"2024-05-12T11:07:44.093913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:25:09.384425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.308010+0000","last_change":"2024-05-12T11:06:02.156201+0000","last_active":"2024-05-12T11:06:45.308010+0000","last_peered":"2024-05-12T11:06:45.308010+0000","last_clean":"2024-05-12T11:06:45.308010+0000","last_became_active":"2024-05-12T11:06:02.155398+0000","last_became_peered":"2024-05-12T11:06:02.155398+0000","last_unstale":"2024-05-12T11:06:45.308010+0000","last_undegraded":"2024-05-12T11:06:45.308010+0000","last_fullsized":"2024-05-12T11:06:45.308010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:23:01.157554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105374+0000","last_change":"2024-05-12T11:06:05.176837+0000","last_active":"2024-05-12T11:07:44.105374+0000","last_peered":"2024-05-12T11:07:44.105374+0000","last_clean":"2024-05-12T11:07:44.105374+0000","last_became_active":"2024-05-12T11:06:05.176450+0000","last_became_peered":"2024-05-12T11:06:05.176450+0000","last_unstale":"2024-05-12T11:07:44.105374+0000","last_undegraded":"2024-05-12T11:07:44.105374+0000","last_fullsized":"2024-05-12T11:07:44.105374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:36:17.654259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305632+0000","last_change":"2024-05-12T11:06:02.246999+0000","last_active":"2024-05-12T11:06:45.305632+0000","last_peered":"2024-05-12T11:06:45.305632+0000","last_clean":"2024-05-12T11:06:45.305632+0000","last_became_active":"2024-05-12T11:06:02.246063+0000","last_became_peered":"2024-05-12T11:06:02.246063+0000","last_unstale":"2024-05-12T11:06:45.305632+0000","last_undegraded":"2024-05-12T11:06:45.305632+0000","last_fullsized":"2024-05-12T11:06:45.305632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:39.303069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.082831+0000","last_change":"2024-05-12T11:06:05.175333+0000","last_active":"2024-05-12T11:07:44.082831+0000","last_peered":"2024-05-12T11:07:44.082831+0000","last_clean":"2024-05-12T11:07:44.082831+0000","last_became_active":"2024-05-12T11:06:05.175011+0000","last_became_peered":"2024-05-12T11:06:05.175011+0000","last_unstale":"2024-05-12T11:07:44.082831+0000","last_undegraded":"2024-05-12T11:07:44.082831+0000","last_fullsized":"2024-05-12T11:07:44.082831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:51:57.025941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:08:01.380836+0000","last_change":"2024-05-12T11:06:02.151044+0000","last_active":"2024-05-12T11:08:01.380836+0000","last_peered":"2024-05-12T11:08:01.380836+0000","last_clean":"2024-05-12T11:08:01.380836+0000","last_became_active":"2024-05-12T11:06:02.150011+0000","last_became_peered":"2024-05-12T11:06:02.150011+0000","last_unstale":"2024-05-12T11:08:01.380836+0000","last_undegraded":"2024-05-12T11:08:01.380836+0000","last_fullsized":"2024-05-12T11:08:01.380836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:16:14.058893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101341+0000","last_change":"2024-05-12T11:06:05.179210+0000","last_active":"2024-05-12T11:07:44.101341+0000","last_peered":"2024-05-12T11:07:44.101341+0000","last_clean":"2024-05-12T11:07:44.101341+0000","last_became_active":"2024-05-12T11:06:05.178853+0000","last_became_peered":"2024-05-12T11:06:05.178853+0000","last_unstale":"2024-05-12T11:07:44.101341+0000","last_undegraded":"2024-05-12T11:07:44.101341+0000","last_fullsized":"2024-05-12T11:07:44.101341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:50:05.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104216+0000","last_change":"2024-05-12T11:06:05.170860+0000","last_active":"2024-05-12T11:07:44.104216+0000","last_peered":"2024-05-12T11:07:44.104216+0000","last_clean":"2024-05-12T11:07:44.104216+0000","last_became_active":"2024-05-12T11:06:05.170502+0000","last_became_peered":"2024-05-12T11:06:05.170502+0000","last_unstale":"2024-05-12T11:07:44.104216+0000","last_undegraded":"2024-05-12T11:07:44.104216+0000","last_fullsized":"2024-05-12T11:07:44.104216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:26:46.495176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:08:00.379526+0000","last_change":"2024-05-12T11:06:02.245996+0000","last_active":"2024-05-12T11:08:00.379526+0000","last_peered":"2024-05-12T11:08:00.379526+0000","last_clean":"2024-05-12T11:08:00.379526+0000","last_became_active":"2024-05-12T11:06:02.245629+0000","last_became_peered":"2024-05-12T11:06:02.245629+0000","last_unstale":"2024-05-12T11:08:00.379526+0000","last_undegraded":"2024-05-12T11:08:00.379526+0000","last_fullsized":"2024-05-12T11:08:00.379526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:02:54.794852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.098583+0000","last_change":"2024-05-12T11:06:05.174731+0000","last_active":"2024-05-12T11:07:44.098583+0000","last_peered":"2024-05-12T11:07:44.098583+0000","last_clean":"2024-05-12T11:07:44.098583+0000","last_became_active":"2024-05-12T11:06:05.174396+0000","last_became_peered":"2024-05-12T11:06:05.174396+0000","last_unstale":"2024-05-12T11:07:44.098583+0000","last_undegraded":"2024-05-12T11:07:44.098583+0000","last_fullsized":"2024-05-12T11:07:44.098583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:30:48.352011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498237+0000","last_change":"2024-05-12T11:06:02.153635+0000","last_active":"2024-05-12T11:06:45.498237+0000","last_peered":"2024-05-12T11:06:45.498237+0000","last_clean":"2024-05-12T11:06:45.498237+0000","last_became_active":"2024-05-12T11:06:02.153268+0000","last_became_peered":"2024-05-12T11:06:02.153268+0000","last_unstale":"2024-05-12T11:06:45.498237+0000","last_undegraded":"2024-05-12T11:06:45.498237+0000","last_fullsized":"2024-05-12T11:06:45.498237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:55.245138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351120+0000","last_change":"2024-05-12T11:04:37.106045+0000","last_active":"2024-05-12T11:06:45.351120+0000","last_peered":"2024-05-12T11:06:45.351120+0000","last_clean":"2024-05-12T11:06:45.351120+0000","last_became_active":"2024-05-12T11:04:37.101364+0000","last_became_peered":"2024-05-12T11:04:37.101364+0000","last_unstale":"2024-05-12T11:06:45.351120+0000","last_undegraded":"2024-05-12T11:06:45.351120+0000","last_fullsized":"2024-05-12T11:06:45.351120+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_clean_scrub_stamp":"2024-05-12T11:01:12.632157+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:53:22.531168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.089599+0000","last_change":"2024-05-12T11:06:05.163927+0000","last_active":"2024-05-12T11:07:44.089599+0000","last_peered":"2024-05-12T11:07:44.089599+0000","last_clean":"2024-05-12T11:07:44.089599+0000","last_became_active":"2024-05-12T11:06:05.163610+0000","last_became_peered":"2024-05-12T11:06:05.163610+0000","last_unstale":"2024-05-12T11:07:44.089599+0000","last_undegraded":"2024-05-12T11:07:44.089599+0000","last_fullsized":"2024-05-12T11:07:44.089599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:58:31.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.351237+0000","last_change":"2024-05-12T11:06:02.152658+0000","last_active":"2024-05-12T11:06:45.351237+0000","last_peered":"2024-05-12T11:06:45.351237+0000","last_clean":"2024-05-12T11:06:45.351237+0000","last_became_active":"2024-05-12T11:06:02.151770+0000","last_became_peered":"2024-05-12T11:06:02.151770+0000","last_unstale":"2024-05-12T11:06:45.351237+0000","last_undegraded":"2024-05-12T11:06:45.351237+0000","last_fullsized":"2024-05-12T11:06:45.351237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:18.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307050+0000","last_change":"2024-05-12T11:06:02.246421+0000","last_active":"2024-05-12T11:06:45.307050+0000","last_peered":"2024-05-12T11:06:45.307050+0000","last_clean":"2024-05-12T11:06:45.307050+0000","last_became_active":"2024-05-12T11:06:02.246065+0000","last_became_peered":"2024-05-12T11:06:02.246065+0000","last_unstale":"2024-05-12T11:06:45.307050+0000","last_undegraded":"2024-05-12T11:06:45.307050+0000","last_fullsized":"2024-05-12T11:06:45.307050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:34:28.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.083451+0000","last_change":"2024-05-12T11:06:05.166916+0000","last_active":"2024-05-12T11:07:44.083451+0000","last_peered":"2024-05-12T11:07:44.083451+0000","last_clean":"2024-05-12T11:07:44.083451+0000","last_became_active":"2024-05-12T11:06:05.165877+0000","last_became_peered":"2024-05-12T11:06:05.165877+0000","last_unstale":"2024-05-12T11:07:44.083451+0000","last_undegraded":"2024-05-12T11:07:44.083451+0000","last_fullsized":"2024-05-12T11:07:44.083451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:46:47.935159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:47.179614+0000","last_change":"2024-05-12T11:06:02.151339+0000","last_active":"2024-05-12T11:06:47.179614+0000","last_peered":"2024-05-12T11:06:47.179614+0000","last_clean":"2024-05-12T11:06:47.179614+0000","last_became_active":"2024-05-12T11:06:02.150968+0000","last_became_peered":"2024-05-12T11:06:02.150968+0000","last_unstale":"2024-05-12T11:06:47.179614+0000","last_undegraded":"2024-05-12T11:06:47.179614+0000","last_fullsized":"2024-05-12T11:06:47.179614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:22:39.625972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096323+0000","last_change":"2024-05-12T11:06:05.165277+0000","last_active":"2024-05-12T11:07:44.096323+0000","last_peered":"2024-05-12T11:07:44.096323+0000","last_clean":"2024-05-12T11:07:44.096323+0000","last_became_active":"2024-05-12T11:06:05.164992+0000","last_became_peered":"2024-05-12T11:06:05.164992+0000","last_unstale":"2024-05-12T11:07:44.096323+0000","last_undegraded":"2024-05-12T11:07:44.096323+0000","last_fullsized":"2024-05-12T11:07:44.096323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:18.193170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.498226+0000","last_change":"2024-05-12T11:06:02.151167+0000","last_active":"2024-05-12T11:06:45.498226+0000","last_peered":"2024-05-12T11:06:45.498226+0000","last_clean":"2024-05-12T11:06:45.498226+0000","last_became_active":"2024-05-12T11:06:02.150815+0000","last_became_peered":"2024-05-12T11:06:02.150815+0000","last_unstale":"2024-05-12T11:06:45.498226+0000","last_undegraded":"2024-05-12T11:06:45.498226+0000","last_fullsized":"2024-05-12T11:06:45.498226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:50.811297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102087+0000","last_change":"2024-05-12T11:06:45.352790+0000","last_active":"2024-05-12T11:07:44.102087+0000","last_peered":"2024-05-12T11:07:44.102087+0000","last_clean":"2024-05-12T11:07:44.102087+0000","last_became_active":"2024-05-12T11:06:45.352409+0000","last_became_peered":"2024-05-12T11:06:45.352409+0000","last_unstale":"2024-05-12T11:07:44.102087+0000","last_undegraded":"2024-05-12T11:07:44.102087+0000","last_fullsized":"2024-05-12T11:07:44.102087+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:16.535709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.305794+0000","last_change":"2024-05-12T11:06:02.246676+0000","last_active":"2024-05-12T11:06:45.305794+0000","last_peered":"2024-05-12T11:06:45.305794+0000","last_clean":"2024-05-12T11:06:45.305794+0000","last_became_active":"2024-05-12T11:06:02.246344+0000","last_became_peered":"2024-05-12T11:06:02.246344+0000","last_unstale":"2024-05-12T11:06:45.305794+0000","last_undegraded":"2024-05-12T11:06:45.305794+0000","last_fullsized":"2024-05-12T11:06:45.305794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:17.805058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.082939+0000","last_change":"2024-05-12T11:06:05.175597+0000","last_active":"2024-05-12T11:07:44.082939+0000","last_peered":"2024-05-12T11:07:44.082939+0000","last_clean":"2024-05-12T11:07:44.082939+0000","last_became_active":"2024-05-12T11:06:05.175237+0000","last_became_peered":"2024-05-12T11:06:05.175237+0000","last_unstale":"2024-05-12T11:07:44.082939+0000","last_undegraded":"2024-05-12T11:07:44.082939+0000","last_fullsized":"2024-05-12T11:07:44.082939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:50:12.872570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.306976+0000","last_change":"2024-05-12T11:06:02.148706+0000","last_active":"2024-05-12T11:06:45.306976+0000","last_peered":"2024-05-12T11:06:45.306976+0000","last_clean":"2024-05-12T11:06:45.306976+0000","last_became_active":"2024-05-12T11:06:02.148437+0000","last_became_peered":"2024-05-12T11:06:02.148437+0000","last_unstale":"2024-05-12T11:06:45.306976+0000","last_undegraded":"2024-05-12T11:06:45.306976+0000","last_fullsized":"2024-05-12T11:06:45.306976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:54:39.969677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102452+0000","last_change":"2024-05-12T11:06:05.174248+0000","last_active":"2024-05-12T11:07:44.102452+0000","last_peered":"2024-05-12T11:07:44.102452+0000","last_clean":"2024-05-12T11:07:44.102452+0000","last_became_active":"2024-05-12T11:06:05.173934+0000","last_became_peered":"2024-05-12T11:06:05.173934+0000","last_unstale":"2024-05-12T11:07:44.102452+0000","last_undegraded":"2024-05-12T11:07:44.102452+0000","last_fullsized":"2024-05-12T11:07:44.102452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:04:58.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.316925+0000","last_change":"2024-05-12T11:06:45.316406+0000","last_active":"2024-05-12T11:06:45.316925+0000","last_peered":"2024-05-12T11:06:45.316925+0000","last_clean":"2024-05-12T11:06:45.316925+0000","last_became_active":"2024-05-12T11:06:45.310351+0000","last_became_peered":"2024-05-12T11:06:45.310351+0000","last_unstale":"2024-05-12T11:06:45.316925+0000","last_undegraded":"2024-05-12T11:06:45.316925+0000","last_fullsized":"2024-05-12T11:06:45.316925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:11.687974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.095241+0000","last_change":"2024-05-12T11:06:05.177548+0000","last_active":"2024-05-12T11:07:44.095241+0000","last_peered":"2024-05-12T11:07:44.095241+0000","last_clean":"2024-05-12T11:07:44.095241+0000","last_became_active":"2024-05-12T11:06:05.176871+0000","last_became_peered":"2024-05-12T11:06:05.176871+0000","last_unstale":"2024-05-12T11:07:44.095241+0000","last_undegraded":"2024-05-12T11:07:44.095241+0000","last_fullsized":"2024-05-12T11:07:44.095241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:38:08.347801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.307748+0000","last_change":"2024-05-12T11:06:02.155096+0000","last_active":"2024-05-12T11:06:45.307748+0000","last_peered":"2024-05-12T11:06:45.307748+0000","last_clean":"2024-05-12T11:06:45.307748+0000","last_became_active":"2024-05-12T11:06:02.154721+0000","last_became_peered":"2024-05-12T11:06:02.154721+0000","last_unstale":"2024-05-12T11:06:45.307748+0000","last_undegraded":"2024-05-12T11:06:45.307748+0000","last_fullsized":"2024-05-12T11:06:45.307748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:01.407453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105378+0000","last_change":"2024-05-12T11:06:05.170305+0000","last_active":"2024-05-12T11:07:44.105378+0000","last_peered":"2024-05-12T11:07:44.105378+0000","last_clean":"2024-05-12T11:07:44.105378+0000","last_became_active":"2024-05-12T11:06:05.169970+0000","last_became_peered":"2024-05-12T11:06:05.169970+0000","last_unstale":"2024-05-12T11:07:44.105378+0000","last_undegraded":"2024-05-12T11:07:44.105378+0000","last_fullsized":"2024-05-12T11:07:44.105378+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:48:11.680873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:59.379481+0000","last_change":"2024-05-12T11:06:02.246541+0000","last_active":"2024-05-12T11:07:59.379481+0000","last_peered":"2024-05-12T11:07:59.379481+0000","last_clean":"2024-05-12T11:07:59.379481+0000","last_became_active":"2024-05-12T11:06:02.246071+0000","last_became_peered":"2024-05-12T11:06:02.246071+0000","last_unstale":"2024-05-12T11:07:59.379481+0000","last_undegraded":"2024-05-12T11:07:59.379481+0000","last_fullsized":"2024-05-12T11:07:59.379481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:27:16.649146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104848+0000","last_change":"2024-05-12T11:06:05.170566+0000","last_active":"2024-05-12T11:07:44.104848+0000","last_peered":"2024-05-12T11:07:44.104848+0000","last_clean":"2024-05-12T11:07:44.104848+0000","last_became_active":"2024-05-12T11:06:05.170225+0000","last_became_peered":"2024-05-12T11:06:05.170225+0000","last_unstale":"2024-05-12T11:07:44.104848+0000","last_undegraded":"2024-05-12T11:07:44.104848+0000","last_fullsized":"2024-05-12T11:07:44.104848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:42.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.310170+0000","last_change":"2024-05-12T11:06:02.151920+0000","last_active":"2024-05-12T11:06:45.310170+0000","last_peered":"2024-05-12T11:06:45.310170+0000","last_clean":"2024-05-12T11:06:45.310170+0000","last_became_active":"2024-05-12T11:06:02.151551+0000","last_became_peered":"2024-05-12T11:06:02.151551+0000","last_unstale":"2024-05-12T11:06:45.310170+0000","last_undegraded":"2024-05-12T11:06:45.310170+0000","last_fullsized":"2024-05-12T11:06:45.310170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:11:10.230956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.102435+0000","last_change":"2024-05-12T11:06:05.174964+0000","last_active":"2024-05-12T11:07:44.102435+0000","last_peered":"2024-05-12T11:07:44.102435+0000","last_clean":"2024-05-12T11:07:44.102435+0000","last_became_active":"2024-05-12T11:06:05.174562+0000","last_became_peered":"2024-05-12T11:06:05.174562+0000","last_unstale":"2024-05-12T11:07:44.102435+0000","last_undegraded":"2024-05-12T11:07:44.102435+0000","last_fullsized":"2024-05-12T11:07:44.102435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:37:22.252200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:06:45.319312+0000","last_change":"2024-05-12T11:06:45.319312+0000","last_active":"2024-05-12T11:06:45.319312+0000","last_peered":"2024-05-12T11:06:45.319312+0000","last_clean":"2024-05-12T11:06:45.319312+0000","last_became_active":"2024-05-12T11:06:45.310683+0000","last_became_peered":"2024-05-12T11:06:45.310683+0000","last_unstale":"2024-05-12T11:06:45.319312+0000","last_undegraded":"2024-05-12T11:06:45.319312+0000","last_fullsized":"2024-05-12T11:06:45.319312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:24:21.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096629+0000","last_change":"2024-05-12T11:06:05.176798+0000","last_active":"2024-05-12T11:07:44.096629+0000","last_peered":"2024-05-12T11:07:44.096629+0000","last_clean":"2024-05-12T11:07:44.096629+0000","last_became_active":"2024-05-12T11:06:05.176476+0000","last_became_peered":"2024-05-12T11:06:05.176476+0000","last_unstale":"2024-05-12T11:07:44.096629+0000","last_undegraded":"2024-05-12T11:07:44.096629+0000","last_fullsized":"2024-05-12T11:07:44.096629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:16.111038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.103777+0000","last_change":"2024-05-12T11:06:05.180278+0000","last_active":"2024-05-12T11:07:44.103777+0000","last_peered":"2024-05-12T11:07:44.103777+0000","last_clean":"2024-05-12T11:07:44.103777+0000","last_became_active":"2024-05-12T11:06:05.179863+0000","last_became_peered":"2024-05-12T11:06:05.179863+0000","last_unstale":"2024-05-12T11:07:44.103777+0000","last_undegraded":"2024-05-12T11:07:44.103777+0000","last_fullsized":"2024-05-12T11:07:44.103777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:13:32.588753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105194+0000","last_change":"2024-05-12T11:06:45.499552+0000","last_active":"2024-05-12T11:07:44.105194+0000","last_peered":"2024-05-12T11:07:44.105194+0000","last_clean":"2024-05-12T11:07:44.105194+0000","last_became_active":"2024-05-12T11:06:45.499078+0000","last_became_peered":"2024-05-12T11:06:45.499078+0000","last_unstale":"2024-05-12T11:07:44.105194+0000","last_undegraded":"2024-05-12T11:07:44.105194+0000","last_fullsized":"2024-05-12T11:07:44.105194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:41:37.019535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104213+0000","last_change":"2024-05-12T11:06:05.172282+0000","last_active":"2024-05-12T11:07:44.104213+0000","last_peered":"2024-05-12T11:07:44.104213+0000","last_clean":"2024-05-12T11:07:44.104213+0000","last_became_active":"2024-05-12T11:06:05.171930+0000","last_became_peered":"2024-05-12T11:06:05.171930+0000","last_unstale":"2024-05-12T11:07:44.104213+0000","last_undegraded":"2024-05-12T11:07:44.104213+0000","last_fullsized":"2024-05-12T11:07:44.104213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:20:56.314181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.093380+0000","last_change":"2024-05-12T11:06:05.173726+0000","last_active":"2024-05-12T11:07:44.093380+0000","last_peered":"2024-05-12T11:07:44.093380+0000","last_clean":"2024-05-12T11:07:44.093380+0000","last_became_active":"2024-05-12T11:06:05.173195+0000","last_became_peered":"2024-05-12T11:06:05.173195+0000","last_unstale":"2024-05-12T11:07:44.093380+0000","last_undegraded":"2024-05-12T11:07:44.093380+0000","last_fullsized":"2024-05-12T11:07:44.093380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:19.397213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.084186+0000","last_change":"2024-05-12T11:06:05.167841+0000","last_active":"2024-05-12T11:07:44.084186+0000","last_peered":"2024-05-12T11:07:44.084186+0000","last_clean":"2024-05-12T11:07:44.084186+0000","last_became_active":"2024-05-12T11:06:05.166577+0000","last_became_peered":"2024-05-12T11:06:05.166577+0000","last_unstale":"2024-05-12T11:07:44.084186+0000","last_undegraded":"2024-05-12T11:07:44.084186+0000","last_fullsized":"2024-05-12T11:07:44.084186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:01.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.096534+0000","last_change":"2024-05-12T11:06:05.170753+0000","last_active":"2024-05-12T11:07:44.096534+0000","last_peered":"2024-05-12T11:07:44.096534+0000","last_clean":"2024-05-12T11:07:44.096534+0000","last_became_active":"2024-05-12T11:06:05.169410+0000","last_became_peered":"2024-05-12T11:06:05.169410+0000","last_unstale":"2024-05-12T11:07:44.096534+0000","last_undegraded":"2024-05-12T11:07:44.096534+0000","last_fullsized":"2024-05-12T11:07:44.096534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:42:30.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.105561+0000","last_change":"2024-05-12T11:06:05.170692+0000","last_active":"2024-05-12T11:07:44.105561+0000","last_peered":"2024-05-12T11:07:44.105561+0000","last_clean":"2024-05-12T11:07:44.105561+0000","last_became_active":"2024-05-12T11:06:05.170349+0000","last_became_peered":"2024-05-12T11:06:05.170349+0000","last_unstale":"2024-05-12T11:07:44.105561+0000","last_undegraded":"2024-05-12T11:07:44.105561+0000","last_fullsized":"2024-05-12T11:07:44.105561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:13:19.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101477+0000","last_change":"2024-05-12T11:06:05.173600+0000","last_active":"2024-05-12T11:07:44.101477+0000","last_peered":"2024-05-12T11:07:44.101477+0000","last_clean":"2024-05-12T11:07:44.101477+0000","last_became_active":"2024-05-12T11:06:05.173288+0000","last_became_peered":"2024-05-12T11:06:05.173288+0000","last_unstale":"2024-05-12T11:07:44.101477+0000","last_undegraded":"2024-05-12T11:07:44.101477+0000","last_fullsized":"2024-05-12T11:07:44.101477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:06:45.082031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.094865+0000","last_change":"2024-05-12T11:06:05.169864+0000","last_active":"2024-05-12T11:07:44.094865+0000","last_peered":"2024-05-12T11:07:44.094865+0000","last_clean":"2024-05-12T11:07:44.094865+0000","last_became_active":"2024-05-12T11:06:05.169521+0000","last_became_peered":"2024-05-12T11:06:05.169521+0000","last_unstale":"2024-05-12T11:07:44.094865+0000","last_undegraded":"2024-05-12T11:07:44.094865+0000","last_fullsized":"2024-05-12T11:07:44.094865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.825436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.101816+0000","last_change":"2024-05-12T11:06:05.176370+0000","last_active":"2024-05-12T11:07:44.101816+0000","last_peered":"2024-05-12T11:07:44.101816+0000","last_clean":"2024-05-12T11:07:44.101816+0000","last_became_active":"2024-05-12T11:06:05.176031+0000","last_became_peered":"2024-05-12T11:06:05.176031+0000","last_unstale":"2024-05-12T11:07:44.101816+0000","last_undegraded":"2024-05-12T11:07:44.101816+0000","last_fullsized":"2024-05-12T11:07:44.101816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:32:52.893909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.100369+0000","last_change":"2024-05-12T11:06:05.170708+0000","last_active":"2024-05-12T11:07:44.100369+0000","last_peered":"2024-05-12T11:07:44.100369+0000","last_clean":"2024-05-12T11:07:44.100369+0000","last_became_active":"2024-05-12T11:06:05.169591+0000","last_became_peered":"2024-05-12T11:06:05.169591+0000","last_unstale":"2024-05-12T11:07:44.100369+0000","last_undegraded":"2024-05-12T11:07:44.100369+0000","last_fullsized":"2024-05-12T11:07:44.100369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:08.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.097234+0000","last_change":"2024-05-12T11:06:05.172614+0000","last_active":"2024-05-12T11:07:44.097234+0000","last_peered":"2024-05-12T11:07:44.097234+0000","last_clean":"2024-05-12T11:07:44.097234+0000","last_became_active":"2024-05-12T11:06:05.172290+0000","last_became_peered":"2024-05-12T11:06:05.172290+0000","last_unstale":"2024-05-12T11:07:44.097234+0000","last_undegraded":"2024-05-12T11:07:44.097234+0000","last_fullsized":"2024-05-12T11:07:44.097234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:32.169139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-12T11:07:44.104940+0000","last_change":"2024-05-12T11:06:05.171333+0000","last_active":"2024-05-12T11:07:44.104940+0000","last_peered":"2024-05-12T11:07:44.104940+0000","last_clean":"2024-05-12T11:07:44.104940+0000","last_became_active":"2024-05-12T11:06:05.170035+0000","last_became_peered":"2024-05-12T11:06:05.170035+0000","last_unstale":"2024-05-12T11:07:44.104940+0000","last_undegraded":"2024-05-12T11:07:44.104940+0000","last_fullsized":"2024-05-12T11:07:44.104940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:18.852851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280976,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69029,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1024,"num_read_kb":587,"num_write":252,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645352,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":434049,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841580,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1048576,"data_stored":1086571,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005107,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":433397,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201336,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":909312,"data_stored":433193,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397565,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1026434,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":433114,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":962560,"data_stored":496102,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":434453,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":496742,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149775,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":917504,"data_stored":432939,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":909312,"data_stored":433087,"data_compressed":5733,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757319,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":978944,"data_stored":1026112,"data_compressed":41464,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34107,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T11:08:05.916 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-12T11:08:05.916 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-12T11:08:05.916 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-12T11:08:05.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph health --format=json 2024-05-12T11:08:06.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:05 smithi086 ceph-mon[30110]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:06.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:05 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:05 smithi172 ceph-mon[34517]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:06.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:05 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:05 smithi176 ceph-mon[34357]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:06.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:05 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:06.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:06 smithi086 ceph-mon[30110]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:08:07.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:06 smithi172 ceph-mon[34517]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:08:07.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:06 smithi176 ceph-mon[34357]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:08:07.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1321818840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54109520 msgr2=0x7f3f54109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:07.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1321818840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54109520 0x7f3f54109900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009990 tx=0x7f3f48009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1321818840 shutdown_connections 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1321818840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f54102450 0x7f3f54110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1321818840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54109520 0x7f3f54109900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1321818840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54101a90 0x7f3f54101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1321818840 >> 172.21.15.86:0/1321818840 conn(0x7f3f54078a10 msgr2=0x7f3f540ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1321818840 shutdown_connections 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.895+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1321818840 wait complete. 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f5ae3e700 1 Processor -- start 2024-05-12T11:08:07.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f5ae3e700 1 -- start start 2024-05-12T11:08:07.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f5ae3e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54101a90 0x7f3f5419f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:07.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f5ae3e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f54102450 0x7f3f5419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f5ae3e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109520 0x7f3f54199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f5ae3e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3f541136b0 con 0x7f3f54101a90 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f5ae3e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f54113530 con 0x7f3f54109520 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f5ae3e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f54113830 con 0x7f3f54102450 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f58bda700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54101a90 0x7f3f5419f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f58bda700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54101a90 0x7f3f5419f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36366/0 (socket says 172.21.15.86:36366) 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f58bda700 1 -- 172.21.15.86:0/1987736326 learned_addr learned my addr 172.21.15.86:0/1987736326 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f53fff700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f54102450 0x7f3f5419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.896+0000 7f3f593db700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109520 0x7f3f54199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f58bda700 1 -- 172.21.15.86:0/1987736326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f54102450 msgr2=0x7f3f5419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f58bda700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f54102450 0x7f3f5419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f58bda700 1 -- 172.21.15.86:0/1987736326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109520 msgr2=0x7f3f54199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f58bda700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109520 0x7f3f54199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:07.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f58bda700 1 -- 172.21.15.86:0/1987736326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5419a070 con 0x7f3f54101a90 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f53fff700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f54102450 0x7f3f5419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f593db700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109520 0x7f3f54199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f58bda700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54101a90 0x7f3f5419f750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3f48000c00 tx=0x7f3f480047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f51ffb700 1 -- 172.21.15.86:0/1987736326 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48027070 con 0x7f3f54101a90 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5419a300 con 0x7f3f54101a90 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f51ffb700 1 -- 172.21.15.86:0/1987736326 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f480041d0 con 0x7f3f54101a90 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f51ffb700 1 -- 172.21.15.86:0/1987736326 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800f460 con 0x7f3f54101a90 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.897+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f541a6620 con 0x7f3f54101a90 2024-05-12T11:08:07.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.898+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5410ba00 con 0x7f3f54101a90 2024-05-12T11:08:07.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.900+0000 7f3f51ffb700 1 -- 172.21.15.86:0/1987736326 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3f4802a070 con 0x7f3f54101a90 2024-05-12T11:08:07.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.901+0000 7f3f51ffb700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3f440b2880 0x7f3f440b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:07.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.901+0000 7f3f53fff700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3f440b2880 0x7f3f440b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:07.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.901+0000 7f3f51ffb700 1 -- 172.21.15.86:0/1987736326 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3f480e3670 con 0x7f3f54101a90 2024-05-12T11:08:07.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.902+0000 7f3f53fff700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3f440b2880 0x7f3f440b4d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3f40005fd0 tx=0x7f3f40005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:07.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:07.904+0000 7f3f51ffb700 1 -- 172.21.15.86:0/1987736326 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3f48031070 con 0x7f3f54101a90 2024-05-12T11:08:07.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:07 smithi086 ceph-mon[30110]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:08.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.204+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3f5406a190 con 0x7f3f54101a90 2024-05-12T11:08:08.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.205+0000 7f3f51ffb700 1 -- 172.21.15.86:0/1987736326 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3f5406a190 con 0x7f3f54101a90 2024-05-12T11:08:08.196 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:08.196 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3f440b2880 msgr2=0x7f3f440b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3f440b2880 0x7f3f440b4d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3f40005fd0 tx=0x7f3f40005e20 comp rx=0 tx=0).stop 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54101a90 msgr2=0x7f3f5419f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54101a90 0x7f3f5419f750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3f48000c00 tx=0x7f3f480047b0 comp rx=0 tx=0).stop 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 shutdown_connections 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f3f440b2880 0x7f3f440b4d40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109520 0x7f3f54199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f54101a90 0x7f3f5419f750 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:08.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 --2- 172.21.15.86:0/1987736326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f54102450 0x7f3f5419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:08.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 >> 172.21.15.86:0/1987736326 conn(0x7f3f54078a10 msgr2=0x7f3f540fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:08.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 shutdown_connections 2024-05-12T11:08:08.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:08.207+0000 7f3f5ae3e700 1 -- 172.21.15.86:0/1987736326 wait complete. 2024-05-12T11:08:08.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:07 smithi172 ceph-mon[34517]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:08.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:07 smithi176 ceph-mon[34357]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:08.989 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-12T11:08:08.990 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:08:09.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:08 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1987736326' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-12T11:08:09.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:08 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:09.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:08 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:09.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:08 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1987736326' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-12T11:08:09.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:08 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:09.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:08 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:09.242 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:09.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:08 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1987736326' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-12T11:08:09.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:08 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:09.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:08 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:09.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:09 smithi086 ceph-mon[30110]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:09.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:08:09.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:08:09.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:09 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:10.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:09 smithi172 ceph-mon[34517]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:10.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:08:10.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:08:10.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:09 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:09 smithi176 ceph-mon[34357]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:08:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:08:10.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:09 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:08:10.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 -- 172.21.15.86:0/666640976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9150102690 msgr2=0x7f9150102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 --2- 172.21.15.86:0/666640976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9150102690 0x7f9150102a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f914c009990 tx=0x7f914c009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 -- 172.21.15.86:0/666640976 shutdown_connections 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 --2- 172.21.15.86:0/666640976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91501076e0 0x7f915006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 --2- 172.21.15.86:0/666640976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9150102690 0x7f9150102a70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 --2- 172.21.15.86:0/666640976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150103040 0x7f9150107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 -- 172.21.15.86:0/666640976 >> 172.21.15.86:0/666640976 conn(0x7f91500783f0 msgr2=0x7f9150078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 -- 172.21.15.86:0/666640976 shutdown_connections 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.944+0000 7f9157f6e700 1 -- 172.21.15.86:0/666640976 wait complete. 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f9157f6e700 1 Processor -- start 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f9157f6e700 1 -- start start 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f9157f6e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150102690 0x7f915019bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f9157f6e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9150103040 0x7f915019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f9157f6e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91501076e0 0x7f91501a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f9157f6e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91501158d0 con 0x7f91501076e0 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f9157f6e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9150115a50 con 0x7f9150103040 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f9157f6e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9150115bd0 con 0x7f9150102690 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.945+0000 7f915650b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91501076e0 0x7f91501a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f915650b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91501076e0 0x7f91501a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36378/0 (socket says 172.21.15.86:36378) 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f915650b700 1 -- 172.21.15.86:0/1140250449 learned_addr learned my addr 172.21.15.86:0/1140250449 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f9155d0a700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150102690 0x7f915019bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f9155509700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9150103040 0x7f915019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f915650b700 1 -- 172.21.15.86:0/1140250449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150102690 msgr2=0x7f915019bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f915650b700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150102690 0x7f915019bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f915650b700 1 -- 172.21.15.86:0/1140250449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9150103040 msgr2=0x7f915019c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f915650b700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9150103040 0x7f915019c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:10.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f915650b700 1 -- 172.21.15.86:0/1140250449 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91501a0f50 con 0x7f91501076e0 2024-05-12T11:08:10.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f9155509700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9150103040 0x7f915019c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:08:10.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f915650b700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91501076e0 0x7f91501a0810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9148007d70 tx=0x7f914800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:10.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f9146ffd700 1 -- 172.21.15.86:0/1140250449 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148016020 con 0x7f91501076e0 2024-05-12T11:08:10.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f9146ffd700 1 -- 172.21.15.86:0/1140250449 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f914800ad40 con 0x7f91501076e0 2024-05-12T11:08:10.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91501a1240 con 0x7f91501076e0 2024-05-12T11:08:10.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f9146ffd700 1 -- 172.21.15.86:0/1140250449 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91480115e0 con 0x7f91501076e0 2024-05-12T11:08:10.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.946+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91501a8ac0 con 0x7f91501076e0 2024-05-12T11:08:10.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.947+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9150103ae0 con 0x7f91501076e0 2024-05-12T11:08:10.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.949+0000 7f9146ffd700 1 -- 172.21.15.86:0/1140250449 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9148019020 con 0x7f91501076e0 2024-05-12T11:08:10.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.950+0000 7f9146ffd700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f913c0b2900 0x7f913c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:10.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.950+0000 7f9155d0a700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f913c0b2900 0x7f913c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:10.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.950+0000 7f9146ffd700 1 -- 172.21.15.86:0/1140250449 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f91480e2700 con 0x7f91501076e0 2024-05-12T11:08:10.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.950+0000 7f9155d0a700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f913c0b2900 0x7f913c0b4dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098e0 tx=0x7f914c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:10.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:10.953+0000 7f9146ffd700 1 -- 172.21.15.86:0/1140250449 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9148020020 con 0x7f91501076e0 2024-05-12T11:08:11.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.197+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f915006a190 con 0x7f91501076e0 2024-05-12T11:08:11.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.198+0000 7f9146ffd700 1 -- 172.21.15.86:0/1140250449 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11935 (secure 0 0 0) 0x7f91480aa3a0 con 0x7f91501076e0 2024-05-12T11:08:11.200 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:11.200 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:06:25.320260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24422,24436,24443,24442,24466]},"id":1}]} 2024-05-12T11:08:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.200+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f913c0b2900 msgr2=0x7f913c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.200+0000 7f9157f6e700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f913c0b2900 0x7f913c0b4dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098e0 tx=0x7f914c005960 comp rx=0 tx=0).stop 2024-05-12T11:08:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.200+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91501076e0 msgr2=0x7f91501a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.200+0000 7f9157f6e700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91501076e0 0x7f91501a0810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9148007d70 tx=0x7f914800a340 comp rx=0 tx=0).stop 2024-05-12T11:08:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.201+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 shutdown_connections 2024-05-12T11:08:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.201+0000 7f9157f6e700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f913c0b2900 0x7f913c0b4dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.201+0000 7f9157f6e700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91501076e0 0x7f91501a0810 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.201+0000 7f9157f6e700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150102690 0x7f915019bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.201+0000 7f9157f6e700 1 --2- 172.21.15.86:0/1140250449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9150103040 0x7f915019c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.201+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 >> 172.21.15.86:0/1140250449 conn(0x7f91500783f0 msgr2=0x7f9150103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.201+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 shutdown_connections 2024-05-12T11:08:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:11.201+0000 7f9157f6e700 1 -- 172.21.15.86:0/1140250449 wait complete. 2024-05-12T11:08:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 28 2024-05-12T11:08:11.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:08:12.097 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:12.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:11 smithi086 ceph-mon[30110]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:12.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:11 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1140250449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:12.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:11 smithi172 ceph-mon[34517]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:12.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:11 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1140250449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:12.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:11 smithi176 ceph-mon[34357]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:12.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:11 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1140250449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:13.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.811+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3459014949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a1406c110 msgr2=0x7f9a1406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.811+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3459014949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a1406c110 0x7f9a1406c590 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009990 tx=0x7f9a00009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.811+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3459014949 shutdown_connections 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.811+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3459014949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a14105ed0 0x7f9a14106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.811+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3459014949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a141083c0 0x7f9a1406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.811+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3459014949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a1406c110 0x7f9a1406c590 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3459014949 >> 172.21.15.86:0/3459014949 conn(0x7f9a14079350 msgr2=0x7f9a14079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3459014949 shutdown_connections 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3459014949 wait complete. 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 Processor -- start 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 -- start start 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1406c110 0x7f9a141a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:13.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a14105ed0 0x7f9a141a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a141083c0 0x7f9a141a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a14119c20 con 0x7f9a141083c0 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9a14119aa0 con 0x7f9a14105ed0 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.812+0000 7f9a1adb7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9a14119da0 con 0x7f9a1406c110 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a141083c0 0x7f9a141a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a141083c0 0x7f9a141a4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58310/0 (socket says 172.21.15.86:58310) 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 -- 172.21.15.86:0/3613144661 learned_addr learned my addr 172.21.15.86:0/3613144661 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a18b53700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1406c110 0x7f9a141a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a13fff700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a14105ed0 0x7f9a141a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 -- 172.21.15.86:0/3613144661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1406c110 msgr2=0x7f9a141a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1406c110 0x7f9a141a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:13.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 -- 172.21.15.86:0/3613144661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a14105ed0 msgr2=0x7f9a141a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:13.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a14105ed0 0x7f9a141a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:13.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 -- 172.21.15.86:0/3613144661 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a141a5140 con 0x7f9a141083c0 2024-05-12T11:08:13.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a19354700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a141083c0 0x7f9a141a4a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c007d70 tx=0x7f9a0c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:13.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a11ffb700 1 -- 172.21.15.86:0/3613144661 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c016020 con 0x7f9a141083c0 2024-05-12T11:08:13.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a11ffb700 1 -- 172.21.15.86:0/3613144661 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a0c00ad40 con 0x7f9a141083c0 2024-05-12T11:08:13.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a141a5430 con 0x7f9a141083c0 2024-05-12T11:08:13.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.813+0000 7f9a11ffb700 1 -- 172.21.15.86:0/3613144661 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0115e0 con 0x7f9a141083c0 2024-05-12T11:08:13.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.814+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a141accb0 con 0x7f9a141083c0 2024-05-12T11:08:13.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.814+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1406a190 con 0x7f9a141083c0 2024-05-12T11:08:13.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.816+0000 7f9a11ffb700 1 -- 172.21.15.86:0/3613144661 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9a0c019020 con 0x7f9a141083c0 2024-05-12T11:08:13.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.816+0000 7f9a11ffb700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9a040b2880 0x7f9a040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:13.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.816+0000 7f9a18b53700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9a040b2880 0x7f9a040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:13.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.816+0000 7f9a11ffb700 1 -- 172.21.15.86:0/3613144661 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9a0c0e21d0 con 0x7f9a141083c0 2024-05-12T11:08:13.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.817+0000 7f9a18b53700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9a040b2880 0x7f9a040b4d40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9a08005950 tx=0x7f9a0800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:13.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:13.821+0000 7f9a11ffb700 1 -- 172.21.15.86:0/3613144661 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9a0c020020 con 0x7f9a141083c0 2024-05-12T11:08:14.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.067+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a141ace80 con 0x7f9a141083c0 2024-05-12T11:08:14.058 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:13 smithi086 ceph-mon[30110]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:14.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.068+0000 7f9a11ffb700 1 -- 172.21.15.86:0/3613144661 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11935 (secure 0 0 0) 0x7f9a0c0a9ed0 con 0x7f9a141083c0 2024-05-12T11:08:14.059 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:14.059 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:06:25.320260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24422,24436,24443,24442,24466]},"id":1}]} 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9a040b2880 msgr2=0x7f9a040b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9a040b2880 0x7f9a040b4d40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9a08005950 tx=0x7f9a0800a300 comp rx=0 tx=0).stop 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a141083c0 msgr2=0x7f9a141a4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a141083c0 0x7f9a141a4a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c007d70 tx=0x7f9a0c00a340 comp rx=0 tx=0).stop 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 shutdown_connections 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9a040b2880 0x7f9a040b4d40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a141083c0 0x7f9a141a4a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1406c110 0x7f9a141a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 --2- 172.21.15.86:0/3613144661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a14105ed0 0x7f9a141a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 >> 172.21.15.86:0/3613144661 conn(0x7f9a14079350 msgr2=0x7f9a14104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:14.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 shutdown_connections 2024-05-12T11:08:14.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:14.071+0000 7f9a1adb7700 1 -- 172.21.15.86:0/3613144661 wait complete. 2024-05-12T11:08:14.063 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 28 2024-05-12T11:08:14.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:13 smithi172 ceph-mon[34517]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:14.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:13 smithi176 ceph-mon[34357]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:14.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:08:14.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:14 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3613144661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:14.972 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:15.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:14 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3613144661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:15.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:14 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3613144661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:16.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:15 smithi086 ceph-mon[30110]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:16.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:15 smithi172 ceph-mon[34517]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:16.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:15 smithi176 ceph-mon[34357]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:16.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 -- 172.21.15.86:0/3256405009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84108410 msgr2=0x7fad841087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:16.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 --2- 172.21.15.86:0/3256405009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84108410 0x7fad841087f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fad74009990 tx=0x7fad74009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 -- 172.21.15.86:0/3256405009 shutdown_connections 2024-05-12T11:08:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 --2- 172.21.15.86:0/3256405009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad84102d60 0x7fad8410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 --2- 172.21.15.86:0/3256405009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84108410 0x7fad841087f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 --2- 172.21.15.86:0/3256405009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad841023a0 0x7fad84102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 -- 172.21.15.86:0/3256405009 >> 172.21.15.86:0/3256405009 conn(0x7fad84079350 msgr2=0x7fad84079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 -- 172.21.15.86:0/3256405009 shutdown_connections 2024-05-12T11:08:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.652+0000 7fad88a60700 1 -- 172.21.15.86:0/3256405009 wait complete. 2024-05-12T11:08:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad88a60700 1 Processor -- start 2024-05-12T11:08:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad88a60700 1 -- start start 2024-05-12T11:08:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad88a60700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad841023a0 0x7fad8419e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad88a60700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84102d60 0x7fad8419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad88a60700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad84108410 0x7fad841988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad88a60700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fad841125b0 con 0x7fad84102d60 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad88a60700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad84112430 con 0x7fad84108410 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad88a60700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad84112730 con 0x7fad841023a0 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad7bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84102d60 0x7fad8419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad7bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84102d60 0x7fad8419ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58340/0 (socket says 172.21.15.86:58340) 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad7bfff700 1 -- 172.21.15.86:0/2052352725 learned_addr learned my addr 172.21.15.86:0/2052352725 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.653+0000 7fad8259c700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad841023a0 0x7fad8419e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad82d9d700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad84108410 0x7fad841988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7bfff700 1 -- 172.21.15.86:0/2052352725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad841023a0 msgr2=0x7fad8419e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7bfff700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad841023a0 0x7fad8419e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7bfff700 1 -- 172.21.15.86:0/2052352725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad84108410 msgr2=0x7fad841988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7bfff700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad84108410 0x7fad841988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7bfff700 1 -- 172.21.15.86:0/2052352725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad84199010 con 0x7fad84102d60 2024-05-12T11:08:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad82d9d700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad84108410 0x7fad841988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7bfff700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84102d60 0x7fad8419ec30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00b530 tx=0x7fad6c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7b7fe700 1 -- 172.21.15.86:0/2052352725 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c015020 con 0x7fad84102d60 2024-05-12T11:08:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7b7fe700 1 -- 172.21.15.86:0/2052352725 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad6c011ce0 con 0x7fad84102d60 2024-05-12T11:08:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad84199300 con 0x7fad84102d60 2024-05-12T11:08:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad7b7fe700 1 -- 172.21.15.86:0/2052352725 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c010e40 con 0x7fad84102d60 2024-05-12T11:08:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.654+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad841a55c0 con 0x7fad84102d60 2024-05-12T11:08:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.655+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad8406a190 con 0x7fad84102d60 2024-05-12T11:08:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.657+0000 7fad7b7fe700 1 -- 172.21.15.86:0/2052352725 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fad6c018020 con 0x7fad84102d60 2024-05-12T11:08:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.657+0000 7fad7b7fe700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fad700b2880 0x7fad700b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.657+0000 7fad8259c700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fad700b2880 0x7fad700b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.657+0000 7fad7b7fe700 1 -- 172.21.15.86:0/2052352725 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fad6c0e2020 con 0x7fad84102d60 2024-05-12T11:08:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.657+0000 7fad8259c700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fad700b2880 0x7fad700b4d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad7400b5c0 tx=0x7fad74005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.660+0000 7fad7b7fe700 1 -- 172.21.15.86:0/2052352725 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fad6c01f020 con 0x7fad84102d60 2024-05-12T11:08:16.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.864+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad8402e510 con 0x7fad84102d60 2024-05-12T11:08:16.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.865+0000 7fad7b7fe700 1 -- 172.21.15.86:0/2052352725 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22746 (secure 0 0 0) 0x7fad6c0a9d20 con 0x7fad84102d60 2024-05-12T11:08:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:16.858 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:06:45.299850+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:08:16.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fad700b2880 msgr2=0x7fad700b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:16.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fad700b2880 0x7fad700b4d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad7400b5c0 tx=0x7fad74005960 comp rx=0 tx=0).stop 2024-05-12T11:08:16.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84102d60 msgr2=0x7fad8419ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:16.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84102d60 0x7fad8419ec30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00b530 tx=0x7fad6c00b840 comp rx=0 tx=0).stop 2024-05-12T11:08:16.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 shutdown_connections 2024-05-12T11:08:16.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fad700b2880 0x7fad700b4d40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad84108410 0x7fad841988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad841023a0 0x7fad8419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 --2- 172.21.15.86:0/2052352725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad84102d60 0x7fad8419ec30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:16.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 >> 172.21.15.86:0/2052352725 conn(0x7fad84079350 msgr2=0x7fad841010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:16.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 shutdown_connections 2024-05-12T11:08:16.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:16.868+0000 7fad88a60700 1 -- 172.21.15.86:0/2052352725 wait complete. 2024-05-12T11:08:17.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:16 smithi086 ceph-mon[30110]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:17.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:16 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2052352725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:08:17.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:16 smithi172 ceph-mon[34517]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:17.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:16 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2052352725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:08:17.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:16 smithi176 ceph-mon[34357]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:17.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:16 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2052352725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:08:17.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:08:17.734 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 -- 172.21.15.86:0/2894085176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f521806c150 msgr2=0x7f521806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 --2- 172.21.15.86:0/2894085176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f521806c150 0x7f521806c5d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5208009990 tx=0x7f5208009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 -- 172.21.15.86:0/2894085176 shutdown_connections 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 --2- 172.21.15.86:0/2894085176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5218105f30 0x7f52181063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 --2- 172.21.15.86:0/2894085176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52181084c0 0x7f521806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 --2- 172.21.15.86:0/2894085176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f521806c150 0x7f521806c5d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 -- 172.21.15.86:0/2894085176 >> 172.21.15.86:0/2894085176 conn(0x7f52180783f0 msgr2=0x7f5218078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 -- 172.21.15.86:0/2894085176 shutdown_connections 2024-05-12T11:08:19.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.386+0000 7f52201b0700 1 -- 172.21.15.86:0/2894085176 wait complete. 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f52201b0700 1 Processor -- start 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f52201b0700 1 -- start start 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f52201b0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f521806c150 0x7f52181a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f52201b0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5218105f30 0x7f52181a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f52201b0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52181084c0 0x7f52181a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f52201b0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5218119d00 con 0x7f52181084c0 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f52201b0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5218119b80 con 0x7f521806c150 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f52201b0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5218119e80 con 0x7f5218105f30 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52181084c0 0x7f52181a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52181084c0 0x7f52181a4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58354/0 (socket says 172.21.15.86:58354) 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 -- 172.21.15.86:0/773392187 learned_addr learned my addr 172.21.15.86:0/773392187 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521df4c700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f521806c150 0x7f52181a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521d74b700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5218105f30 0x7f52181a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 -- 172.21.15.86:0/773392187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5218105f30 msgr2=0x7f52181a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:19.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5218105f30 0x7f52181a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 -- 172.21.15.86:0/773392187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f521806c150 msgr2=0x7f52181a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f521806c150 0x7f52181a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 -- 172.21.15.86:0/773392187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52181a5220 con 0x7f52181084c0 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.387+0000 7f521e74d700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52181084c0 0x7f52181a4ae0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f521000b970 tx=0x7f521000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.388+0000 7f520effd700 1 -- 172.21.15.86:0/773392187 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521000d860 con 0x7f52181084c0 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.388+0000 7f520effd700 1 -- 172.21.15.86:0/773392187 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f521000e430 con 0x7f52181084c0 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.388+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52181a5510 con 0x7f52181084c0 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.388+0000 7f520effd700 1 -- 172.21.15.86:0/773392187 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5210017660 con 0x7f52181084c0 2024-05-12T11:08:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.388+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52181acd90 con 0x7f52181084c0 2024-05-12T11:08:19.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.389+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521806a190 con 0x7f52181084c0 2024-05-12T11:08:19.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.390+0000 7f520effd700 1 -- 172.21.15.86:0/773392187 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f521000da00 con 0x7f52181084c0 2024-05-12T11:08:19.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.391+0000 7f520effd700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f52040b2880 0x7f52040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:19.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.391+0000 7f521df4c700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f52040b2880 0x7f52040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:19.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.391+0000 7f520effd700 1 -- 172.21.15.86:0/773392187 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f52100e2210 con 0x7f52181084c0 2024-05-12T11:08:19.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.392+0000 7f521df4c700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f52040b2880 0x7f52040b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5214009a10 tx=0x7f5214009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:19.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.395+0000 7f520effd700 1 -- 172.21.15.86:0/773392187 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5210013030 con 0x7f52181084c0 2024-05-12T11:08:19.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:19 smithi086 ceph-mon[30110]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:19.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:19 smithi172 ceph-mon[34517]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:19.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:19 smithi176 ceph-mon[34357]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:19.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.643+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52181acfc0 con 0x7f52181084c0 2024-05-12T11:08:19.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.643+0000 7f520effd700 1 -- 172.21.15.86:0/773392187 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11935 (secure 0 0 0) 0x7f52100a9f10 con 0x7f52181084c0 2024-05-12T11:08:19.635 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:19.636 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:06:25.320260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24422,24436,24443,24442,24466]},"id":1}]} 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f52040b2880 msgr2=0x7f52040b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f52040b2880 0x7f52040b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5214009a10 tx=0x7f5214009190 comp rx=0 tx=0).stop 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52181084c0 msgr2=0x7f52181a4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52181084c0 0x7f52181a4ae0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f521000b970 tx=0x7f521000bc80 comp rx=0 tx=0).stop 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 shutdown_connections 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f52040b2880 0x7f52040b4d40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52181084c0 0x7f52181a4ae0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f521806c150 0x7f52181a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 --2- 172.21.15.86:0/773392187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5218105f30 0x7f52181a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 >> 172.21.15.86:0/773392187 conn(0x7f52180783f0 msgr2=0x7f5218101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:19.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 shutdown_connections 2024-05-12T11:08:19.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:19.646+0000 7f52201b0700 1 -- 172.21.15.86:0/773392187 wait complete. 2024-05-12T11:08:19.639 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 28 2024-05-12T11:08:20.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:20 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/773392187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:20.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-12T11:06:07.078153+0000', 'modified': '2024-05-12T11:06:25.320260+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24466, 'mds_1': 24443, 'mds_2': 24442, 'mds_3': 24436, 'mds_4': 24422}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6839/2477289859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6838', 'nonce': 2477289859}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 2477289859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6841/637755871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6840', 'nonce': 637755871}, {'type': 'v1', 'addr': '172.21.15.86:6841', 'nonce': 637755871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24383': {'gid': 24383, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/3992302401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3992302401}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 3992302401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.176:6833/868497491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 868497491}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 868497491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24398': {'gid': 24398, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/3404000495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3404000495}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3404000495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.172:6837/2564045723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2564045723}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2564045723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.176:6835/197047059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 197047059}, {'type': 'v1', 'addr': '172.21.15.176:6835', 'nonce': 197047059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.176:6837/2905239515', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 2905239515}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 2905239515}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.172:6839/2644756211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 2644756211}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 2644756211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.176:6839/410261641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6838', 'nonce': 410261641}, {'type': 'v1', 'addr': '172.21.15.176:6839', 'nonce': 410261641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24466, 'qdb_cluster': [24422, 24436, 24443, 24442, 24466]} 2024-05-12T11:08:20.310 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-12T11:08:20.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-12T11:08:20.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:20 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/773392187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:20.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:20 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/773392187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:20.553 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:21.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:21 smithi086 ceph-mon[30110]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:21.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:21 smithi172 ceph-mon[34517]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:21.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:21 smithi176 ceph-mon[34357]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.188+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3938145497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 msgr2=0x7f4dec10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.188+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3938145497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 0x7f4dec10f2e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4de400b0d0 tx=0x7f4de400b3e0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.189+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3938145497 shutdown_connections 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.189+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3938145497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 0x7f4dec10f2e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.189+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3938145497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dec102e00 0x7f4dec1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.189+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3938145497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dec1037b0 0x7f4dec107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.189+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3938145497 >> 172.21.15.86:0/3938145497 conn(0x7f4dec078a10 msgr2=0x7f4dec0ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.189+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3938145497 shutdown_connections 2024-05-12T11:08:22.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.189+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3938145497 wait complete. 2024-05-12T11:08:22.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.189+0000 7f4df0f5c700 1 Processor -- start 2024-05-12T11:08:22.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4df0f5c700 1 -- start start 2024-05-12T11:08:22.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4df0f5c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dec102e00 0x7f4dec19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4df0f5c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dec1037b0 0x7f4dec19afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4df0f5c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 0x7f4dec1a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4df0f5c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec112620 con 0x7f4dec107760 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4df0f5c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec1124a0 con 0x7f4dec102e00 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4df0f5c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec1127a0 con 0x7f4dec1037b0 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 0x7f4dec1a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 0x7f4dec1a5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60712/0 (socket says 172.21.15.86:60712) 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 -- 172.21.15.86:0/3292371071 learned_addr learned my addr 172.21.15.86:0/3292371071 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dec102e00 0x7f4dec19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dec1037b0 0x7f4dec19afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 -- 172.21.15.86:0/3292371071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dec1037b0 msgr2=0x7f4dec19afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dec1037b0 0x7f4dec19afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 -- 172.21.15.86:0/3292371071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dec102e00 msgr2=0x7f4dec19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dec102e00 0x7f4dec19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 -- 172.21.15.86:0/3292371071 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec198850 con 0x7f4dec107760 2024-05-12T11:08:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dec1037b0 0x7f4dec19afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.190+0000 7f4dead9d700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 0x7f4dec1a5ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009fd0 tx=0x7f4de4007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.191+0000 7f4de3fff700 1 -- 172.21.15.86:0/3292371071 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de401f070 con 0x7f4dec107760 2024-05-12T11:08:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.191+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3292371071 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec198ae0 con 0x7f4dec107760 2024-05-12T11:08:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.191+0000 7f4de3fff700 1 -- 172.21.15.86:0/3292371071 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de4003c00 con 0x7f4dec107760 2024-05-12T11:08:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.191+0000 7f4de3fff700 1 -- 172.21.15.86:0/3292371071 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de401b7b0 con 0x7f4dec107760 2024-05-12T11:08:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.191+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3292371071 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec199010 con 0x7f4dec107760 2024-05-12T11:08:22.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.193+0000 7f4de3fff700 1 -- 172.21.15.86:0/3292371071 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4de4022070 con 0x7f4dec107760 2024-05-12T11:08:22.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.194+0000 7f4de3fff700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4dd80b2880 0x7f4dd80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.194+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4dd80b2880 0x7f4dd80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.194+0000 7f4de3fff700 1 -- 172.21.15.86:0/3292371071 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f4de400f020 con 0x7f4dec107760 2024-05-12T11:08:22.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.194+0000 7f4dfb7efb80 1 Processor -- start 2024-05-12T11:08:22.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.194+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4dd80b2880 0x7f4dd80b4d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009a10 tx=0x7f4ddc009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:22.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dfb7efb80 1 -- start start 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece54860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e1ecda6810 con 0x55e1ece58c30 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1ecd45770 con 0x55e1ece54480 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e1ecda27d0 con 0x55e1ece54da0 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60722/0 (socket says 172.21.15.86:60722) 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 -- 172.21.15.86:0/1218523155 learned_addr learned my addr 172.21.15.86:0/1218523155 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dea59c700 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece54860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 -- 172.21.15.86:0/1218523155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 msgr2=0x55e1ece586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 -- 172.21.15.86:0/1218523155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 msgr2=0x55e1ece54860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece54860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 -- 172.21.15.86:0/1218523155 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1eccf3880 con 0x55e1ece58c30 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.195+0000 7f4dead9d700 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece590b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4de40aa880 tx=0x7f4de400b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b5cdd646e5bb84 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4de0d99700 1 -- 172.21.15.86:0/1218523155 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40b32a0 con 0x55e1ece58c30 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4de0d99700 1 -- 172.21.15.86:0/1218523155 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de4009cb0 con 0x55e1ece58c30 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4de0d99700 1 -- 172.21.15.86:0/1218523155 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40075d0 con 0x55e1ece58c30 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/1218523155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 msgr2=0x55e1ece590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece590b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4de40aa880 tx=0x7f4de400b3e0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/1218523155 shutdown_connections 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece590b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece54860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/1218523155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/1218523155 >> 172.21.15.86:0/1218523155 conn(0x55e1ecd800b0 msgr2=0x55e1ece4ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.196+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/1218523155 shutdown_connections 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/1218523155 wait complete. 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 -- start start 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 Processor -- start 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54480 0x55e1ece5fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54da0 0x55e1ece5d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece58c30 0x55e1ece5d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e1ece60c00 con 0x55e1ece54480 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1ecd0cbe0 con 0x55e1ece54da0 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e1ece60d80 con 0x55e1ece58c30 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dfb7efb80 10 client.0 _ll_register_callbacks cb 0x55e1ecd3e8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:22.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54480 0x55e1ece5fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54480 0x55e1ece5fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60736/0 (socket says 172.21.15.86:60736) 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4dea59c700 1 -- 172.21.15.86:0/3965642441 learned_addr learned my addr 172.21.15.86:0/3965642441 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.197+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54da0 0x55e1ece5d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dead9d700 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece58c30 0x55e1ece5d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dea59c700 1 -- 172.21.15.86:0/3965642441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece58c30 msgr2=0x55e1ece5d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece58c30 0x55e1ece5d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dea59c700 1 -- 172.21.15.86:0/3965642441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54da0 msgr2=0x55e1ece5d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54da0 0x55e1ece5d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dea59c700 1 -- 172.21.15.86:0/3965642441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1ecd42640 con 0x55e1ece54480 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54480 0x55e1ece5fff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00eeb0 tx=0x7f4ddc004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ece59aa5fac20d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3965642441 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc024020 con 0x55e1ece54480 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3965642441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de4009cb0 con 0x55e1ece54480 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3965642441 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f4ddc00f040 con 0x55e1ece54480 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3965642441 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ddc015aa0 con 0x55e1ece54480 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dfb7efb80 10 client.14955 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3965642441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1ece6b380 con 0x55e1ece54480 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.198+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3965642441 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de4009cb0 con 0x55e1ece54480 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3965642441 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4ddc0063f0 con 0x55e1ece54480 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4dfb7efb80 10 client.14955 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4dfb7efb80 10 client.14955 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4dfb7efb80 20 client.14955 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55e1ece6da40 0x55e1ece6eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4dfb7efb80 4 client.14955 mds_command: new command op to 24422 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:08:22.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3965642441 --> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1ece20600 con 0x55e1ece6da40 2024-05-12T11:08:22.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55e1ece6da40 0x55e1ece6eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4dd1ffb700 10 client.14955 ms_handle_connect on v2:172.21.15.172:6836/2564045723 2024-05-12T11:08:22.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.199+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55e1ece6da40 0x55e1ece6eeb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=65b94d6f3a31dfac server_cookie=199604afa9c3c6c6 in_seq=0 out_seq=0 2024-05-12T11:08:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3965642441 <== mds.4 v2:172.21.15.172:6836/2564045723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e1ece20600 con 0x55e1ece6da40 2024-05-12T11:08:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dd1ffb700 10 client.14955 handle_command_reply: tid=0 2024-05-12T11:08:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 client.14955 shutdown 2024-05-12T11:08:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3965642441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54480 msgr2=0x55e1ece5fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54480 0x55e1ece5fff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00eeb0 tx=0x7f4ddc004860 comp rx=0 tx=0).stop 2024-05-12T11:08:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3965642441 shutdown_connections 2024-05-12T11:08:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece58c30 0x55e1ece5d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55e1ece6da40 0x55e1ece6eeb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54480 0x55e1ece5fff0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3965642441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54da0 0x55e1ece5d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3965642441 >> 172.21.15.86:0/3965642441 conn(0x55e1ecd800b0 msgr2=0x55e1ece4ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dd1ffb700 0 client.14955 ms_handle_reset on v2:172.21.15.172:6836/2564045723 2024-05-12T11:08:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3965642441 shutdown_connections 2024-05-12T11:08:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3965642441 wait complete. 2024-05-12T11:08:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.200+0000 7f4dfb7efb80 20 client.14955 trim_cache size 0 max 16384 2024-05-12T11:08:22.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.221+0000 7f4dfb7efb80 1 Processor -- start 2024-05-12T11:08:22.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.221+0000 7f4dfb7efb80 1 -- start start 2024-05-12T11:08:22.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece5c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece49550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e1ece6d1f0 con 0x55e1ece58c30 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1ece6d8c0 con 0x55e1ece54480 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e1ece6df90 con 0x55e1ece54da0 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece49550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece49550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60752/0 (socket says 172.21.15.86:60752) 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 -- 172.21.15.86:0/4241395519 learned_addr learned my addr 172.21.15.86:0/4241395519 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dea59c700 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece5c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 -- 172.21.15.86:0/4241395519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 msgr2=0x55e1ece5c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece5c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 -- 172.21.15.86:0/4241395519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 msgr2=0x55e1ece506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 -- 172.21.15.86:0/4241395519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1ece4b7c0 con 0x55e1ece58c30 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dea59c700 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece5c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dead9d700 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece49550 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4de40aab10 tx=0x7f4de40a63c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de699d34560225f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.222+0000 7f4dd3fff700 1 -- 172.21.15.86:0/4241395519 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40c3070 con 0x55e1ece58c30 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dd3fff700 1 -- 172.21.15.86:0/4241395519 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de4009cb0 con 0x55e1ece58c30 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dd3fff700 1 -- 172.21.15.86:0/4241395519 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40aade0 con 0x55e1ece58c30 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/4241395519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 msgr2=0x55e1ece49550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece49550 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4de40aab10 tx=0x7f4de40a63c0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/4241395519 shutdown_connections 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece58c30 0x55e1ece49550 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece54480 0x55e1ece506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/4241395519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54da0 0x55e1ece5c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/4241395519 >> 172.21.15.86:0/4241395519 conn(0x55e1ecd800b0 msgr2=0x55e1ece48e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:22.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/4241395519 shutdown_connections 2024-05-12T11:08:22.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/4241395519 wait complete. 2024-05-12T11:08:22.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.223+0000 7f4dfb7efb80 1 -- start start 2024-05-12T11:08:22.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dfb7efb80 1 Processor -- start 2024-05-12T11:08:22.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54480 0x55e1ece783e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54da0 0x55e1ece78920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dfb7efb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece58c30 0x55e1ece719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e1ece6ed30 con 0x55e1ece54da0 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1ece6e660 con 0x55e1ece58c30 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dfb7efb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e1ece6f400 con 0x55e1ece54480 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dfb7efb80 10 client.0 _ll_register_callbacks cb 0x55e1ecd3e8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54da0 0x55e1ece78920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54da0 0x55e1ece78920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60766/0 (socket says 172.21.15.86:60766) 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 -- 172.21.15.86:0/3057478151 learned_addr learned my addr 172.21.15.86:0/3057478151 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54480 0x55e1ece783e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4dead9d700 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece58c30 0x55e1ece719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 -- 172.21.15.86:0/3057478151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54480 msgr2=0x55e1ece783e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54480 0x55e1ece783e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 -- 172.21.15.86:0/3057478151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece58c30 msgr2=0x55e1ece719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece58c30 0x55e1ece719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 -- 172.21.15.86:0/3057478151 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1ece72200 con 0x55e1ece54da0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.224+0000 7f4de1d9b700 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54da0 0x55e1ece78920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55e1ece5e960 tx=0x7f4dd400dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a62328460541a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3057478151 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4027060 con 0x55e1ece54da0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3057478151 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f4dd4017ba0 con 0x55e1ece54da0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3057478151 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de4009cb0 con 0x55e1ece54da0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3057478151 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4dd4017da0 con 0x55e1ece54da0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 10 client.14961 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3057478151 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1ece76bd0 con 0x55e1ece54da0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3057478151 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de4009cb0 con 0x55e1ece54da0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3057478151 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4dd402d590 con 0x55e1ece54da0 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 10 client.14961 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 10 client.14961 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 20 client.14961 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55e1ecedd740 0x55e1ecedc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 4 client.14961 mds_command: new command op to 24422 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.225+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3057478151 --> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] -- command(tid 0: {"prefix": "status"}) -- 0x55e1ecdb41f0 con 0x55e1ecedd740 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.226+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55e1ecedd740 0x55e1ecedc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.226+0000 7f4dd1ffb700 10 client.14961 ms_handle_connect on v2:172.21.15.172:6836/2564045723 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.226+0000 7f4dea59c700 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55e1ecedd740 0x55e1ecedc450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1b6adff79d810377 server_cookie=18d14a27c57242ac in_seq=0 out_seq=0 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.226+0000 7f4dd1ffb700 1 -- 172.21.15.86:0/3057478151 <== mds.4 v2:172.21.15.172:6836/2564045723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e1ecdb41f0 con 0x55e1ecedd740 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.226+0000 7f4dd1ffb700 10 client.14961 handle_command_reply: tid=0 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.226+0000 7f4dfb7efb80 1 client.14961 shutdown 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.226+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3057478151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54da0 msgr2=0x55e1ece78920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.226+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54da0 0x55e1ece78920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55e1ece5e960 tx=0x7f4dd400dee0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3057478151 shutdown_connections 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1ece58c30 0x55e1ece719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e1ece54480 0x55e1ece783e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55e1ecedd740 0x55e1ecedc450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 1 --2- 172.21.15.86:0/3057478151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e1ece54da0 0x55e1ece78920 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3057478151 >> 172.21.15.86:0/3057478151 conn(0x55e1ecd800b0 msgr2=0x55e1ece53290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:22.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dd1ffb700 0 client.14961 ms_handle_reset on v2:172.21.15.172:6836/2564045723 2024-05-12T11:08:22.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3057478151 shutdown_connections 2024-05-12T11:08:22.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 1 -- 172.21.15.86:0/3057478151 wait complete. 2024-05-12T11:08:22.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4dfb7efb80 20 client.14961 trim_cache size 0 max 16384 2024-05-12T11:08:22.226 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:08:22.226 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:08:22.226 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 4, 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24422, 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 119.987182898, 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 165.46802837300001 2024-05-12T11:08:22.227 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4dd80b2880 msgr2=0x7f4dd80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4dd80b2880 0x7f4dd80b4d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009a10 tx=0x7f4ddc009190 comp rx=0 tx=0).stop 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 msgr2=0x7f4dec1a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 0x7f4dec1a5ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009fd0 tx=0x7f4de4007a20 comp rx=0 tx=0).stop 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3292371071 shutdown_connections 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f4dd80b2880 0x7f4dd80b4d40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dec107760 0x7f4dec1a5ae0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dec102e00 0x7f4dec19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 --2- 172.21.15.86:0/3292371071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dec1037b0 0x7f4dec19afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.227+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3292371071 >> 172.21.15.86:0/3292371071 conn(0x7f4dec078a10 msgr2=0x7f4dec0ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.228+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3292371071 shutdown_connections 2024-05-12T11:08:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:22.228+0000 7f4df0f5c700 1 -- 172.21.15.86:0/3292371071 wait complete. 2024-05-12T11:08:22.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.f status 2024-05-12T11:08:23.169 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:23.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:23 smithi086 ceph-mon[30110]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:23.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:23 smithi172 ceph-mon[34517]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:23 smithi176 ceph-mon[34357]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 -- 172.21.15.86:0/244889565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0108410 msgr2=0x7f62e01087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 --2- 172.21.15.86:0/244889565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0108410 0x7f62e01087f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009990 tx=0x7f62dc009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 -- 172.21.15.86:0/244889565 shutdown_connections 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 --2- 172.21.15.86:0/244889565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0102d60 0x7f62e010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 --2- 172.21.15.86:0/244889565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0108410 0x7f62e01087f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 --2- 172.21.15.86:0/244889565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62e01023a0 0x7f62e0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 -- 172.21.15.86:0/244889565 >> 172.21.15.86:0/244889565 conn(0x7f62e0079350 msgr2=0x7f62e0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 -- 172.21.15.86:0/244889565 shutdown_connections 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.806+0000 7f62e82af700 1 -- 172.21.15.86:0/244889565 wait complete. 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e82af700 1 Processor -- start 2024-05-12T11:08:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e82af700 1 -- start start 2024-05-12T11:08:24.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e82af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62e01023a0 0x7f62e019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e82af700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0102d60 0x7f62e019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e82af700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0108410 0x7f62e01999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e82af700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0112580 con 0x7f62e0102d60 2024-05-12T11:08:24.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e82af700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0112400 con 0x7f62e01023a0 2024-05-12T11:08:24.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e82af700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0112700 con 0x7f62e0108410 2024-05-12T11:08:24.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e584a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0102d60 0x7f62e019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e584a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0102d60 0x7f62e019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60788/0 (socket says 172.21.15.86:60788) 2024-05-12T11:08:24.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e584a700 1 -- 172.21.15.86:0/1950819696 learned_addr learned my addr 172.21.15.86:0/1950819696 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:24.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.807+0000 7f62e604b700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62e01023a0 0x7f62e019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62e584a700 1 -- 172.21.15.86:0/1950819696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0108410 msgr2=0x7f62e01999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62e584a700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0108410 0x7f62e01999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62e584a700 1 -- 172.21.15.86:0/1950819696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62e01023a0 msgr2=0x7f62e019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62e584a700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62e01023a0 0x7f62e019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62e584a700 1 -- 172.21.15.86:0/1950819696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e019a130 con 0x7f62e0102d60 2024-05-12T11:08:24.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62e584a700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0102d60 0x7f62e019fd50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f62d000e9a0 tx=0x7f62d000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:24.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62d77fe700 1 -- 172.21.15.86:0/1950819696 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d000cbd0 con 0x7f62e0102d60 2024-05-12T11:08:24.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62e82af700 1 -- 172.21.15.86:0/1950819696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e019a420 con 0x7f62e0102d60 2024-05-12T11:08:24.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62d77fe700 1 -- 172.21.15.86:0/1950819696 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d000cd70 con 0x7f62e0102d60 2024-05-12T11:08:24.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62d77fe700 1 -- 172.21.15.86:0/1950819696 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0018680 con 0x7f62e0102d60 2024-05-12T11:08:24.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.808+0000 7f62e82af700 1 -- 172.21.15.86:0/1950819696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e01a66e0 con 0x7f62e0102d60 2024-05-12T11:08:24.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.811+0000 7f62d77fe700 1 -- 172.21.15.86:0/1950819696 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f62d0010970 con 0x7f62e0102d60 2024-05-12T11:08:24.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.812+0000 7f62d77fe700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f62cc0b2880 0x7f62cc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.812+0000 7f62e604b700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f62cc0b2880 0x7f62cc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.812+0000 7f62d77fe700 1 -- 172.21.15.86:0/1950819696 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f62d00e25f0 con 0x7f62e0102d60 2024-05-12T11:08:24.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.812+0000 7f62f2b42b80 1 Processor -- start 2024-05-12T11:08:24.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.812+0000 7f62e604b700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f62cc0b2880 0x7f62cc0b4d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62e019ab10 tx=0x7f62dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:24.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62f2b42b80 1 -- start start 2024-05-12T11:08:24.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 0x56364c7c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c8a80 0x56364c7c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c2d00 0x56364c7c3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56364c7148f0 con 0x56364c7c8a80 2024-05-12T11:08:24.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56364c679d50 con 0x56364c7c8160 2024-05-12T11:08:24.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56364c7108b0 con 0x56364c7c2d00 2024-05-12T11:08:24.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c8a80 0x56364c7c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c8a80 0x56364c7c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60802/0 (socket says 172.21.15.86:60802) 2024-05-12T11:08:24.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 -- 172.21.15.86:0/29101398 learned_addr learned my addr 172.21.15.86:0/29101398 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:24.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e604b700 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 0x56364c7c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e684c700 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c2d00 0x56364c7c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 -- 172.21.15.86:0/29101398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c2d00 msgr2=0x56364c7c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:24.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c2d00 0x56364c7c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 -- 172.21.15.86:0/29101398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 msgr2=0x56364c7c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:24.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 0x56364c7c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 -- 172.21.15.86:0/29101398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56364c661880 con 0x56364c7c8a80 2024-05-12T11:08:24.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.813+0000 7f62e584a700 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c8a80 0x56364c7c27c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f62d00a5c70 tx=0x7f62d00a9430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae3ca9dd689d618 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:24.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.814+0000 7f62d4d70700 1 -- 172.21.15.86:0/29101398 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d00a9700 con 0x56364c7c8a80 2024-05-12T11:08:24.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.814+0000 7f62d4d70700 1 -- 172.21.15.86:0/29101398 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d00aa2f0 con 0x56364c7c8a80 2024-05-12T11:08:24.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.814+0000 7f62d4d70700 1 -- 172.21.15.86:0/29101398 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d00e20e0 con 0x56364c7c8a80 2024-05-12T11:08:24.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.814+0000 7f62f2b42b80 1 -- 172.21.15.86:0/29101398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c8a80 msgr2=0x56364c7c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.814+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c8a80 0x56364c7c27c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f62d00a5c70 tx=0x7f62d00a9430 comp rx=0 tx=0).stop 2024-05-12T11:08:24.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 -- 172.21.15.86:0/29101398 shutdown_connections 2024-05-12T11:08:24.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c2d00 0x56364c7c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 0x56364c7c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/29101398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c8a80 0x56364c7c27c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 -- 172.21.15.86:0/29101398 >> 172.21.15.86:0/29101398 conn(0x56364c6eeb20 msgr2=0x56364c7bd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:24.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 -- 172.21.15.86:0/29101398 shutdown_connections 2024-05-12T11:08:24.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 -- 172.21.15.86:0/29101398 wait complete. 2024-05-12T11:08:24.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 -- start start 2024-05-12T11:08:24.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 Processor -- start 2024-05-12T11:08:24.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 0x56364c7cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 0x56364c7cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56364c7cf340 con 0x56364c7c2d00 2024-05-12T11:08:24.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56364c6cde80 con 0x56364c7c8a80 2024-05-12T11:08:24.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56364c7cf4c0 con 0x56364c7c8160 2024-05-12T11:08:24.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.815+0000 7f62f2b42b80 10 client.0 _ll_register_callbacks cb 0x56364c6a8560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:24.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60816/0 (socket says 172.21.15.86:60816) 2024-05-12T11:08:24.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 -- 172.21.15.86:0/1049335689 learned_addr learned my addr 172.21.15.86:0/1049335689 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:24.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e584a700 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 0x56364c7cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e684c700 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 0x56364c7cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 -- 172.21.15.86:0/1049335689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 msgr2=0x56364c7cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:24.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 0x56364c7cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 -- 172.21.15.86:0/1049335689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 msgr2=0x56364c7cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:24.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 0x56364c7cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 -- 172.21.15.86:0/1049335689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56364c6cb710 con 0x56364c7c2d00 2024-05-12T11:08:24.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e684c700 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 0x56364c7cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:08:24.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62e604b700 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7ce620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f62dc015000 tx=0x7f62dc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f418446efa2f003 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:24.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:24.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1049335689 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc023810 con 0x56364c7c2d00 2024-05-12T11:08:24.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1049335689 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f62dc0239b0 con 0x56364c7c2d00 2024-05-12T11:08:24.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1049335689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62d00aa2f0 con 0x56364c7c2d00 2024-05-12T11:08:24.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1049335689 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62dc023bb0 con 0x56364c7c2d00 2024-05-12T11:08:24.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62f2b42b80 10 client.14973 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:24.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.816+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1049335689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56364c7d9b70 con 0x56364c7c2d00 2024-05-12T11:08:24.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1049335689 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d00aa2f0 con 0x56364c7c2d00 2024-05-12T11:08:24.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1049335689 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f62dc022070 con 0x56364c7c2d00 2024-05-12T11:08:24.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62f2b42b80 10 client.14973 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:24.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62f2b42b80 10 client.14973 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-12T11:08:24.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62f2b42b80 20 client.14973 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:24.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x56364c7dc1f0 0x56364c7dd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62f2b42b80 4 client.14973 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:08:24.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1049335689 --> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56364c7222d0 con 0x56364c7dc1f0 2024-05-12T11:08:24.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.817+0000 7f62e584a700 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x56364c7dc1f0 0x56364c7dd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.818+0000 7f62c9ffb700 10 client.14973 ms_handle_connect on v2:172.21.15.176:6834/197047059 2024-05-12T11:08:24.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.818+0000 7f62e584a700 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x56364c7dc1f0 0x56364c7dd660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=986ab801ab049e77 server_cookie=5cc9030c2eabace3 in_seq=0 out_seq=0 2024-05-12T11:08:24.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1049335689 <== mds.3 v2:172.21.15.176:6834/197047059 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56364c7222d0 con 0x56364c7dc1f0 2024-05-12T11:08:24.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62c9ffb700 10 client.14973 handle_command_reply: tid=0 2024-05-12T11:08:24.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 client.14973 shutdown 2024-05-12T11:08:24.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1049335689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 msgr2=0x56364c7ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7ce620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f62dc015000 tx=0x7f62dc009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1049335689 shutdown_connections 2024-05-12T11:08:24.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x56364c7dc1f0 0x56364c7dd660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 0x56364c7cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7ce620 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1049335689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 0x56364c7cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1049335689 >> 172.21.15.86:0/1049335689 conn(0x56364c6eeb20 msgr2=0x56364c7b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:24.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62c9ffb700 0 client.14973 ms_handle_reset on v2:172.21.15.176:6834/197047059 2024-05-12T11:08:24.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1049335689 shutdown_connections 2024-05-12T11:08:24.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1049335689 wait complete. 2024-05-12T11:08:24.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.819+0000 7f62f2b42b80 20 client.14973 trim_cache size 0 max 16384 2024-05-12T11:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62f2b42b80 1 Processor -- start 2024-05-12T11:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62f2b42b80 1 -- start start 2024-05-12T11:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 0x56364c7b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8a80 0x56364c7c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56364c7db9a0 con 0x56364c7c2d00 2024-05-12T11:08:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56364c7dc070 con 0x56364c7c8160 2024-05-12T11:08:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56364c7dc740 con 0x56364c7c8a80 2024-05-12T11:08:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60830/0 (socket says 172.21.15.86:60830) 2024-05-12T11:08:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 -- 172.21.15.86:0/3905956639 learned_addr learned my addr 172.21.15.86:0/3905956639 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 -- 172.21.15.86:0/3905956639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8a80 msgr2=0x56364c7c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 --2- 172.21.15.86:0/3905956639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8a80 0x56364c7c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 -- 172.21.15.86:0/3905956639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 msgr2=0x56364c7b7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 --2- 172.21.15.86:0/3905956639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 0x56364c7b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 -- 172.21.15.86:0/3905956639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56364c7be020 con 0x56364c7c2d00 2024-05-12T11:08:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.840+0000 7f62e604b700 1 --2- 172.21.15.86:0/3905956639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7c27c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f62dc000c00 tx=0x7f62dc0095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8cbbafc2bb0b8b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:24.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62cbfff700 1 -- 172.21.15.86:0/3905956639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc023810 con 0x56364c7c2d00 2024-05-12T11:08:24.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62cbfff700 1 -- 172.21.15.86:0/3905956639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62dc034070 con 0x56364c7c2d00 2024-05-12T11:08:24.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62cbfff700 1 -- 172.21.15.86:0/3905956639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc02f8c0 con 0x56364c7c2d00 2024-05-12T11:08:24.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 -- 172.21.15.86:0/3905956639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 msgr2=0x56364c7c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/3905956639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7c27c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f62dc000c00 tx=0x7f62dc0095b0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 -- 172.21.15.86:0/3905956639 shutdown_connections 2024-05-12T11:08:24.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/3905956639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8a80 0x56364c7c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/3905956639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7c27c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/3905956639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8160 0x56364c7b7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 -- 172.21.15.86:0/3905956639 >> 172.21.15.86:0/3905956639 conn(0x56364c6eeb20 msgr2=0x56364c7ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:24.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 -- 172.21.15.86:0/3905956639 shutdown_connections 2024-05-12T11:08:24.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.841+0000 7f62f2b42b80 1 -- 172.21.15.86:0/3905956639 wait complete. 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 1 -- start start 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 1 Processor -- start 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 0x56364c7e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 0x56364c7e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56364c7dd4e0 con 0x56364c7c2d00 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56364c7dce10 con 0x56364c7c8a80 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56364c7ddbb0 con 0x56364c7c8160 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62f2b42b80 10 client.0 _ll_register_callbacks cb 0x56364c6a8560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60842/0 (socket says 172.21.15.86:60842) 2024-05-12T11:08:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 -- 172.21.15.86:0/1340373881 learned_addr learned my addr 172.21.15.86:0/1340373881 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 -- 172.21.15.86:0/1340373881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 msgr2=0x56364c7e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 0x56364c7e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 -- 172.21.15.86:0/1340373881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 msgr2=0x56364c7e63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 0x56364c7e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 -- 172.21.15.86:0/1340373881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56364c7b9c30 con 0x56364c7c2d00 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62e604b700 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7b79c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009350 tx=0x7f62dc0238f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426466c3919d09b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.842+0000 7f62c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1340373881 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc047070 con 0x56364c7c2d00 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1340373881 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f62dc038810 con 0x56364c7c2d00 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1340373881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62dc034070 con 0x56364c7c2d00 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1340373881 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62dc027040 con 0x56364c7c2d00 2024-05-12T11:08:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 10 client.14979 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1340373881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56364c84c240 con 0x56364c7c2d00 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1340373881 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62dc034070 con 0x56364c7c2d00 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1340373881 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f62dc022050 con 0x56364c7c2d00 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 10 client.14979 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 10 client.14979 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 20 client.14979 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x56364c850860 0x56364c84f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 4 client.14979 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1340373881 --> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] -- command(tid 0: {"prefix": "status"}) -- 0x56364c71c370 con 0x56364c850860 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.843+0000 7f62e584a700 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x56364c850860 0x56364c84f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62e584a700 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x56364c850860 0x56364c84f570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f532ef0bf1100b1e server_cookie=99eabc3e9c3110a3 in_seq=0 out_seq=0 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62c9ffb700 10 client.14979 ms_handle_connect on v2:172.21.15.176:6834/197047059 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62c9ffb700 1 -- 172.21.15.86:0/1340373881 <== mds.3 v2:172.21.15.176:6834/197047059 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56364c71c370 con 0x56364c850860 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62c9ffb700 10 client.14979 handle_command_reply: tid=0 2024-05-12T11:08:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 client.14979 shutdown 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1340373881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 msgr2=0x56364c7b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7b79c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009350 tx=0x7f62dc0238f0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1340373881 shutdown_connections 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x56364c850860 0x56364c84f570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56364c7c8a80 0x56364c7e63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56364c7c2d00 0x56364c7b79c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62c9ffb700 0 client.14979 ms_handle_reset on v2:172.21.15.176:6834/197047059 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 --2- 172.21.15.86:0/1340373881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56364c7c8160 0x56364c7e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1340373881 >> 172.21.15.86:0/1340373881 conn(0x56364c6eeb20 msgr2=0x56364c7c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1340373881 shutdown_connections 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 1 -- 172.21.15.86:0/1340373881 wait complete. 2024-05-12T11:08:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.844+0000 7f62f2b42b80 20 client.14979 trim_cache size 0 max 16384 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 3, 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24436, 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 123.615379522, 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 174.00081799099999 2024-05-12T11:08:24.849 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:08:24.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 -- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f62cc0b2880 msgr2=0x7f62cc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f62cc0b2880 0x7f62cc0b4d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62e019ab10 tx=0x7f62dc01a040 comp rx=0 tx=0).stop 2024-05-12T11:08:24.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 -- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0102d60 msgr2=0x7f62e019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:24.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0102d60 0x7f62e019fd50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f62d000e9a0 tx=0x7f62d000ed60 comp rx=0 tx=0).stop 2024-05-12T11:08:24.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 -- 172.21.15.86:0/1950819696 shutdown_connections 2024-05-12T11:08:24.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f62cc0b2880 0x7f62cc0b4d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0108410 0x7f62e01999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62e01023a0 0x7f62e019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 --2- 172.21.15.86:0/1950819696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62e0102d60 0x7f62e019fd50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:24.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 -- 172.21.15.86:0/1950819696 >> 172.21.15.86:0/1950819696 conn(0x7f62e0079350 msgr2=0x7f62e006b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:24.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 -- 172.21.15.86:0/1950819696 shutdown_connections 2024-05-12T11:08:24.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:24.845+0000 7f62e82af700 1 -- 172.21.15.86:0/1950819696 wait complete. 2024-05-12T11:08:25.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:25 smithi086 ceph-mon[30110]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:25.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:25 smithi172 ceph-mon[34517]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:25.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:25 smithi176 ceph-mon[34357]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:25.560 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-12T11:08:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:27.435 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:27 smithi086 ceph-mon[30110]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:27.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.443+0000 7f1551bee700 1 -- 172.21.15.86:0/2228117720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c1083c0 msgr2=0x7f154c06bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.443+0000 7f1551bee700 1 --2- 172.21.15.86:0/2228117720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c1083c0 0x7f154c06bbd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f153c009990 tx=0x7f153c009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.443+0000 7f1551bee700 1 -- 172.21.15.86:0/2228117720 shutdown_connections 2024-05-12T11:08:27.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.443+0000 7f1551bee700 1 --2- 172.21.15.86:0/2228117720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f154c105ed0 0x7f154c106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.443+0000 7f1551bee700 1 --2- 172.21.15.86:0/2228117720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c1083c0 0x7f154c06bbd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.443+0000 7f1551bee700 1 --2- 172.21.15.86:0/2228117720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154c06c110 0x7f154c06c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.443+0000 7f1551bee700 1 -- 172.21.15.86:0/2228117720 >> 172.21.15.86:0/2228117720 conn(0x7f154c079340 msgr2=0x7f154c079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.444+0000 7f1551bee700 1 -- 172.21.15.86:0/2228117720 shutdown_connections 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.444+0000 7f1551bee700 1 -- 172.21.15.86:0/2228117720 wait complete. 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.444+0000 7f1551bee700 1 Processor -- start 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f1551bee700 1 -- start start 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f1551bee700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f154c06c110 0x7f154c1a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f1551bee700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c105ed0 0x7f154c1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f1551bee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154c1083c0 0x7f154c1a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f1551bee700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f154c119c80 con 0x7f154c105ed0 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f1551bee700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f154c119b00 con 0x7f154c1083c0 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f1551bee700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f154c119e00 con 0x7f154c06c110 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c105ed0 0x7f154c1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c105ed0 0x7f154c1a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60858/0 (socket says 172.21.15.86:60858) 2024-05-12T11:08:27.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154affd700 1 -- 172.21.15.86:0/1835582825 learned_addr learned my addr 172.21.15.86:0/1835582825 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154b7fe700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f154c06c110 0x7f154c1a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154bfff700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154c1083c0 0x7f154c1a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154affd700 1 -- 172.21.15.86:0/1835582825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f154c06c110 msgr2=0x7f154c1a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154affd700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f154c06c110 0x7f154c1a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154affd700 1 -- 172.21.15.86:0/1835582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154c1083c0 msgr2=0x7f154c1a4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154affd700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154c1083c0 0x7f154c1a4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.445+0000 7f154affd700 1 -- 172.21.15.86:0/1835582825 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c1a51c0 con 0x7f154c105ed0 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.446+0000 7f154affd700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c105ed0 0x7f154c1a06f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f154000c920 tx=0x7f154000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.446+0000 7f1548ff9700 1 -- 172.21.15.86:0/1835582825 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540007b00 con 0x7f154c105ed0 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.446+0000 7f1551bee700 1 -- 172.21.15.86:0/1835582825 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154c1a54b0 con 0x7f154c105ed0 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.446+0000 7f1548ff9700 1 -- 172.21.15.86:0/1835582825 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1540004ce0 con 0x7f154c105ed0 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.446+0000 7f1548ff9700 1 -- 172.21.15.86:0/1835582825 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540005650 con 0x7f154c105ed0 2024-05-12T11:08:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.446+0000 7f1551bee700 1 -- 172.21.15.86:0/1835582825 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154c1acd30 con 0x7f154c105ed0 2024-05-12T11:08:27.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.449+0000 7f1548ff9700 1 -- 172.21.15.86:0/1835582825 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1540007ca0 con 0x7f154c105ed0 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.449+0000 7f155c481b80 1 Processor -- start 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.449+0000 7f155c481b80 1 -- start start 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.449+0000 7f1548ff9700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f15340b2880 0x7f15340b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f155c481b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d5475860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f155c481b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 0x5587d54796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f1548ff9700 1 -- 172.21.15.86:0/1835582825 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f15400e1e40 con 0x7f154c105ed0 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f155c481b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d547a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f15340b2880 0x7f15340b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f155c481b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5587d53c7810 con 0x5587d5479c30 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f155c481b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5587d5366770 con 0x5587d5475da0 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f155c481b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5587d53c37d0 con 0x5587d5475480 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d547a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154b7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d5475860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154b7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d5475860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.86:39110/0 (socket says 172.21.15.86:39110) 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d547a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60874/0 (socket says 172.21.15.86:60874) 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154b7fe700 1 -- 172.21.15.86:0/3973402732 learned_addr learned my addr 172.21.15.86:0/3973402732 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154affd700 1 --2- 172.21.15.86:0/3973402732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 0x5587d54796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 -- 172.21.15.86:0/3973402732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 msgr2=0x5587d5475860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 --2- 172.21.15.86:0/3973402732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d5475860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 -- 172.21.15.86:0/3973402732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 msgr2=0x5587d54796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 --2- 172.21.15.86:0/3973402732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 0x5587d54796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 -- 172.21.15.86:0/3973402732 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587d5314880 con 0x5587d5479c30 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 --2- 172.21.15.86:0/3973402732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d547a0b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f154400dd70 tx=0x7f154400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37090b6d897711e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.450+0000 7f154bfff700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f15340b2880 0x7f15340b4d40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f15440070b0 tx=0x7f154400b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f1531ffb700 1 -- 172.21.15.86:0/3973402732 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154401f070 con 0x5587d5479c30 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f1531ffb700 1 -- 172.21.15.86:0/3973402732 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1544007e90 con 0x5587d5479c30 2024-05-12T11:08:27.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f1531ffb700 1 -- 172.21.15.86:0/3973402732 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544016040 con 0x5587d5479c30 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 -- 172.21.15.86:0/3973402732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 msgr2=0x5587d547a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 --2- 172.21.15.86:0/3973402732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d547a0b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f154400dd70 tx=0x7f154400dda0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 -- 172.21.15.86:0/3973402732 shutdown_connections 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 --2- 172.21.15.86:0/3973402732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d547a0b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 --2- 172.21.15.86:0/3973402732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d5475860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 --2- 172.21.15.86:0/3973402732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 0x5587d54796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 -- 172.21.15.86:0/3973402732 >> 172.21.15.86:0/3973402732 conn(0x5587d53a10b0 msgr2=0x5587d546fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 -- 172.21.15.86:0/3973402732 shutdown_connections 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.451+0000 7f155c481b80 1 -- 172.21.15.86:0/3973402732 wait complete. 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 1 -- start start 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 1 Processor -- start 2024-05-12T11:08:27.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 0x5587d54810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d547e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d547e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5587d5481de0 con 0x5587d5475da0 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5587d532dbe0 con 0x5587d5475480 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5587d5481f60 con 0x5587d5479c30 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f155c481b80 10 client.0 _ll_register_callbacks cb 0x5587d535f8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f154affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d547e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f154affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d547e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60890/0 (socket says 172.21.15.86:60890) 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.452+0000 7f154affd700 1 -- 172.21.15.86:0/503043765 learned_addr learned my addr 172.21.15.86:0/503043765 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154bfff700 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d547e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154b7fe700 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 0x5587d54810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154affd700 1 -- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 msgr2=0x5587d547e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154affd700 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d547e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154affd700 1 -- 172.21.15.86:0/503043765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 msgr2=0x5587d54810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154affd700 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 0x5587d54810c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154affd700 1 -- 172.21.15.86:0/503043765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587d5363640 con 0x5587d5475da0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154bfff700 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d547e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f154affd700 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d547e460 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f15400058b0 tx=0x7f15400a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a262787954326bc server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f152affd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f152affd700 1 -- 172.21.15.86:0/503043765 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15400c3060 con 0x5587d5475da0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f152affd700 1 -- 172.21.15.86:0/503043765 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1540004e90 con 0x5587d5475da0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f155c481b80 1 -- 172.21.15.86:0/503043765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1544007e90 con 0x5587d5475da0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f152affd700 1 -- 172.21.15.86:0/503043765 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f154001d040 con 0x5587d5475da0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f155c481b80 10 client.14991 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f155c481b80 1 -- 172.21.15.86:0/503043765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5587d548c6f0 con 0x5587d5475da0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.453+0000 7f152affd700 1 -- 172.21.15.86:0/503043765 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1544007e90 con 0x5587d5475da0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f152affd700 1 -- 172.21.15.86:0/503043765 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f15400a3bf0 con 0x5587d5475da0 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f155c481b80 10 client.14991 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f155c481b80 10 client.14991 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f155c481b80 20 client.14991 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f155c481b80 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5587d548ec60 0x5587d54900d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f155c481b80 4 client.14991 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f155c481b80 1 -- 172.21.15.86:0/503043765 --> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587d5441600 con 0x5587d548ec60 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f154b7fe700 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5587d548ec60 0x5587d54900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f152affd700 10 client.14991 ms_handle_connect on v2:172.21.15.176:6836/2905239515 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.454+0000 7f154b7fe700 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5587d548ec60 0x5587d54900d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=185707e61233551a server_cookie=dfc0cd15d6b1005d in_seq=0 out_seq=0 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f152affd700 1 -- 172.21.15.86:0/503043765 <== mds.2 v2:172.21.15.176:6836/2905239515 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5587d5441600 con 0x5587d548ec60 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f152affd700 10 client.14991 handle_command_reply: tid=0 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 client.14991 shutdown 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 -- 172.21.15.86:0/503043765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 msgr2=0x5587d547e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d547e460 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f15400058b0 tx=0x7f15400a9000 comp rx=0 tx=0).stop 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 -- 172.21.15.86:0/503043765 shutdown_connections 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5587d548ec60 0x5587d54900d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d547e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 0x5587d54810c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 --2- 172.21.15.86:0/503043765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d547e460 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 -- 172.21.15.86:0/503043765 >> 172.21.15.86:0/503043765 conn(0x5587d53a10b0 msgr2=0x5587d546fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:27.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f152affd700 0 client.14991 ms_handle_reset on v2:172.21.15.176:6836/2905239515 2024-05-12T11:08:27.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 -- 172.21.15.86:0/503043765 shutdown_connections 2024-05-12T11:08:27.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.455+0000 7f155c481b80 1 -- 172.21.15.86:0/503043765 wait complete. 2024-05-12T11:08:27.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.456+0000 7f155c481b80 20 client.14991 trim_cache size 0 max 16384 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.476+0000 7f155c481b80 1 Processor -- start 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.476+0000 7f155c481b80 1 -- start start 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.476+0000 7f155c481b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d548ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.476+0000 7f155c481b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 0x5587d547d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.476+0000 7f155c481b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d5499530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.476+0000 7f155c481b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5587d548e410 con 0x5587d5479c30 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.476+0000 7f155c481b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5587d548eae0 con 0x5587d5475da0 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.476+0000 7f155c481b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5587d548f1b0 con 0x5587d5475480 2024-05-12T11:08:27.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d5499530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d5499530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60898/0 (socket says 172.21.15.86:60898) 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 -- 172.21.15.86:0/4103695200 learned_addr learned my addr 172.21.15.86:0/4103695200 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154affd700 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 0x5587d547d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154b7fe700 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d548ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 -- 172.21.15.86:0/4103695200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 msgr2=0x5587d548ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d548ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 -- 172.21.15.86:0/4103695200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 msgr2=0x5587d547d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 0x5587d547d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 -- 172.21.15.86:0/4103695200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587d546c3b0 con 0x5587d5479c30 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f154bfff700 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d5499530 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f154400dd70 tx=0x7f1544009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5970f44f27acafd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f15317fa700 1 -- 172.21.15.86:0/4103695200 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154401f050 con 0x5587d5479c30 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f15317fa700 1 -- 172.21.15.86:0/4103695200 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1544028070 con 0x5587d5479c30 2024-05-12T11:08:27.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.477+0000 7f15317fa700 1 -- 172.21.15.86:0/4103695200 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544024410 con 0x5587d5479c30 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 -- 172.21.15.86:0/4103695200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 msgr2=0x5587d5499530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d5499530 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f154400dd70 tx=0x7f1544009430 comp rx=0 tx=0).stop 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 -- 172.21.15.86:0/4103695200 shutdown_connections 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5479c30 0x5587d5499530 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5475480 0x5587d548ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 --2- 172.21.15.86:0/4103695200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475da0 0x5587d547d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 -- 172.21.15.86:0/4103695200 >> 172.21.15.86:0/4103695200 conn(0x5587d53a10b0 msgr2=0x5587d546fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 -- 172.21.15.86:0/4103695200 shutdown_connections 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 -- 172.21.15.86:0/4103695200 wait complete. 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 -- start start 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.478+0000 7f155c481b80 1 Processor -- start 2024-05-12T11:08:27.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f155c481b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 0x5587d54995f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f155c481b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d5499b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f155c481b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d5494bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f155c481b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5587d548ff50 con 0x5587d5475da0 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f155c481b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5587d548f880 con 0x5587d5475480 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f155c481b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5587d5490620 con 0x5587d5479c30 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f155c481b80 10 client.0 _ll_register_callbacks cb 0x5587d535f8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d5499b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d5499b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60906/0 (socket says 172.21.15.86:60906) 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 -- 172.21.15.86:0/3739560898 learned_addr learned my addr 172.21.15.86:0/3739560898 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154bfff700 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d5494bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154b7fe700 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 0x5587d54995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 -- 172.21.15.86:0/3739560898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 msgr2=0x5587d5494bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d5494bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 -- 172.21.15.86:0/3739560898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 msgr2=0x5587d54995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 0x5587d54995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 -- 172.21.15.86:0/3739560898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587d54953b0 con 0x5587d5475da0 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f154affd700 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d5499b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f15400dfc90 tx=0x7f154000a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f107056c452982 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f152affd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f152affd700 1 -- 172.21.15.86:0/3739560898 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15400ad7f0 con 0x5587d5475da0 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f152affd700 1 -- 172.21.15.86:0/3739560898 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f15400a5a30 con 0x5587d5475da0 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.479+0000 7f155c481b80 1 -- 172.21.15.86:0/3739560898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1544028070 con 0x5587d5475da0 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f152affd700 1 -- 172.21.15.86:0/3739560898 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f15400b22a0 con 0x5587d5475da0 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f155c481b80 10 client.14997 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f155c481b80 1 -- 172.21.15.86:0/3739560898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5587d54f9c90 con 0x5587d5475da0 2024-05-12T11:08:27.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f152affd700 1 -- 172.21.15.86:0/3739560898 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1544028070 con 0x5587d5475da0 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f152affd700 1 -- 172.21.15.86:0/3739560898 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f15400a8830 con 0x5587d5475da0 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f155c481b80 10 client.14997 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f155c481b80 10 client.14997 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f155c481b80 20 client.14997 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f155c481b80 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5587d54fe740 0x5587d54fd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f155c481b80 4 client.14997 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f155c481b80 1 -- 172.21.15.86:0/3739560898 --> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] -- command(tid 0: {"prefix": "status"}) -- 0x5587d53d51f0 con 0x5587d54fe740 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.480+0000 7f154b7fe700 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5587d54fe740 0x5587d54fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f154b7fe700 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5587d54fe740 0x5587d54fd450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b73cc78911d1eeb server_cookie=5b9aad812180d07f in_seq=0 out_seq=0 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f152affd700 10 client.14997 ms_handle_connect on v2:172.21.15.176:6836/2905239515 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f152affd700 1 -- 172.21.15.86:0/3739560898 <== mds.2 v2:172.21.15.176:6836/2905239515 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5587d53d51f0 con 0x5587d54fe740 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f152affd700 10 client.14997 handle_command_reply: tid=0 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 client.14997 shutdown 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 -- 172.21.15.86:0/3739560898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 msgr2=0x5587d5499b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d5499b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f15400dfc90 tx=0x7f154000a5a0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 -- 172.21.15.86:0/3739560898 shutdown_connections 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5587d54fe740 0x5587d54fd450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5587d5479c30 0x5587d5494bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5587d5475480 0x5587d54995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 --2- 172.21.15.86:0/3739560898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5587d5475da0 0x5587d5499b30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 -- 172.21.15.86:0/3739560898 >> 172.21.15.86:0/3739560898 conn(0x5587d53a10b0 msgr2=0x5587d5469e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f152affd700 0 client.14997 ms_handle_reset on v2:172.21.15.176:6836/2905239515 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 -- 172.21.15.86:0/3739560898 shutdown_connections 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 1 -- 172.21.15.86:0/3739560898 wait complete. 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.481+0000 7f155c481b80 20 client.14997 trim_cache size 0 max 16384 2024-05-12T11:08:27.477 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 2, 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24442, 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 127.253914287, 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 173.85721439100001 2024-05-12T11:08:27.478 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:08:27.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 -- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f15340b2880 msgr2=0x7f15340b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f15340b2880 0x7f15340b4d40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f15440070b0 tx=0x7f154400b000 comp rx=0 tx=0).stop 2024-05-12T11:08:27.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 -- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c105ed0 msgr2=0x7f154c1a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:27.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c105ed0 0x7f154c1a06f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f154000c920 tx=0x7f154000cce0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 -- 172.21.15.86:0/1835582825 shutdown_connections 2024-05-12T11:08:27.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f15340b2880 0x7f15340b4d40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154c1083c0 0x7f154c1a4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f154c06c110 0x7f154c1a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 --2- 172.21.15.86:0/1835582825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f154c105ed0 0x7f154c1a06f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:27.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 -- 172.21.15.86:0/1835582825 >> 172.21.15.86:0/1835582825 conn(0x7f154c079340 msgr2=0x7f154c1013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:27.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 -- 172.21.15.86:0/1835582825 shutdown_connections 2024-05-12T11:08:27.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:27.482+0000 7f1551bee700 1 -- 172.21.15.86:0/1835582825 wait complete. 2024-05-12T11:08:27.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:27 smithi172 ceph-mon[34517]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:27.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:27 smithi176 ceph-mon[34357]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:28.153 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-12T11:08:28.395 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:29.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:29 smithi086 ceph-mon[30110]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:29.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:29 smithi172 ceph-mon[34517]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:29.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:29 smithi176 ceph-mon[34357]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:30.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 -- 172.21.15.86:0/3576750173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc102690 msgr2=0x7ff3dc102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3576750173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc102690 0x7ff3dc102a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00099c0 tx=0x7ff3d0009cd0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 -- 172.21.15.86:0/3576750173 shutdown_connections 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3576750173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc1076e0 0x7ff3dc10f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3576750173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc102690 0x7ff3dc102a70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3576750173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3dc103040 0x7ff3dc107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 -- 172.21.15.86:0/3576750173 >> 172.21.15.86:0/3576750173 conn(0x7ff3dc0783f0 msgr2=0x7ff3dc078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 -- 172.21.15.86:0/3576750173 shutdown_connections 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.032+0000 7ff3e1584700 1 -- 172.21.15.86:0/3576750173 wait complete. 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3e1584700 1 Processor -- start 2024-05-12T11:08:30.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3e1584700 1 -- start start 2024-05-12T11:08:30.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3e1584700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc102690 0x7ff3dc19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3e1584700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc103040 0x7ff3dc19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3e1584700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3dc1076e0 0x7ff3dc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3e1584700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1125f0 con 0x7ff3dc103040 2024-05-12T11:08:30.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3e1584700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc112470 con 0x7ff3dc1076e0 2024-05-12T11:08:30.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3e1584700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc112770 con 0x7ff3dc102690 2024-05-12T11:08:30.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3da7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc103040 0x7ff3dc19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3da7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc103040 0x7ff3dc19ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60916/0 (socket says 172.21.15.86:60916) 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3417075502 learned_addr learned my addr 172.21.15.86:0/3417075502 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc102690 0x7ff3dc19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.033+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3dc1076e0 0x7ff3dc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3417075502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc102690 msgr2=0x7ff3dc19e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3da7fc700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc102690 0x7ff3dc19e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3417075502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3dc1076e0 msgr2=0x7ff3dc198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3da7fc700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3dc1076e0 0x7ff3dc198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3417075502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc199070 con 0x7ff3dc103040 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3da7fc700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc103040 0x7ff3dc19ec90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00b500 tx=0x7ff3cc00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3c3fff700 1 -- 172.21.15.86:0/3417075502 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc015020 con 0x7ff3dc103040 2024-05-12T11:08:30.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3e1584700 1 -- 172.21.15.86:0/3417075502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc199360 con 0x7ff3dc103040 2024-05-12T11:08:30.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3c3fff700 1 -- 172.21.15.86:0/3417075502 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3cc011ce0 con 0x7ff3dc103040 2024-05-12T11:08:30.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3c3fff700 1 -- 172.21.15.86:0/3417075502 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc010d40 con 0x7ff3dc103040 2024-05-12T11:08:30.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.034+0000 7ff3e1584700 1 -- 172.21.15.86:0/3417075502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc06bc10 con 0x7ff3dc103040 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.036+0000 7ff3c3fff700 1 -- 172.21.15.86:0/3417075502 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff3cc018020 con 0x7ff3dc103040 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.037+0000 7ff3c3fff700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff3c40b2880 0x7ff3c40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.037+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff3c40b2880 0x7ff3c40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.037+0000 7ff3c3fff700 1 -- 172.21.15.86:0/3417075502 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff3cc0e1940 con 0x7ff3dc103040 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff3c40b2880 0x7ff3c40b4d40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc199a50 tx=0x7ff3d0005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3ebe17b80 1 Processor -- start 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3ebe17b80 1 -- start start 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd0e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd0eda0 0x56374cd126a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56374cc60810 con 0x56374cd0e480 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56374cbff770 con 0x56374cd12c30 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56374cc5c7d0 con 0x56374cd0eda0 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd0e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd0e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60926/0 (socket says 172.21.15.86:60926) 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 -- 172.21.15.86:0/2575943897 learned_addr learned my addr 172.21.15.86:0/2575943897 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/2575943897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 -- 172.21.15.86:0/2575943897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd0eda0 msgr2=0x56374cd126a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 --2- 172.21.15.86:0/2575943897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd0eda0 0x56374cd126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 -- 172.21.15.86:0/2575943897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 msgr2=0x56374cd130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 --2- 172.21.15.86:0/2575943897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd130b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.038+0000 7ff3daffd700 1 -- 172.21.15.86:0/2575943897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56374cbad880 con 0x56374cd0e480 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.039+0000 7ff3daffd700 1 --2- 172.21.15.86:0/2575943897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd0e860 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000b580 tx=0x7ff3d001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb3e36f6f652e2b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.039+0000 7ff3c17fa700 1 -- 172.21.15.86:0/2575943897 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0034070 con 0x56374cd0e480 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.039+0000 7ff3c17fa700 1 -- 172.21.15.86:0/2575943897 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d0024930 con 0x56374cd0e480 2024-05-12T11:08:30.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.039+0000 7ff3c17fa700 1 -- 172.21.15.86:0/2575943897 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d002faa0 con 0x56374cd0e480 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/2575943897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 msgr2=0x56374cd0e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/2575943897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd0e860 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000b580 tx=0x7ff3d001f000 comp rx=0 tx=0).stop 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/2575943897 shutdown_connections 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/2575943897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/2575943897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd0e860 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/2575943897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd0eda0 0x56374cd126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/2575943897 >> 172.21.15.86:0/2575943897 conn(0x56374cc3a0b0 msgr2=0x56374cd08c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/2575943897 shutdown_connections 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/2575943897 wait complete. 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 -- start start 2024-05-12T11:08:30.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.040+0000 7ff3ebe17b80 1 Processor -- start 2024-05-12T11:08:30.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd1a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0eda0 0x56374cd17520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd17a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56374cd1ade0 con 0x56374cd0e480 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56374cbc6be0 con 0x56374cd0eda0 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56374cd1af60 con 0x56374cd12c30 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3ebe17b80 10 client.0 _ll_register_callbacks cb 0x56374cbf88d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3da7fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0eda0 0x56374cd17520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3da7fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0eda0 0x56374cd17520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.86:55624/0 (socket says 172.21.15.86:55624) 2024-05-12T11:08:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3243266176 learned_addr learned my addr 172.21.15.86:0/3243266176 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd1a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd17a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3db7fe700 1 -- 172.21.15.86:0/3243266176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0eda0 msgr2=0x56374cd17520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0eda0 0x56374cd17520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3db7fe700 1 -- 172.21.15.86:0/3243266176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 msgr2=0x56374cd1a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd1a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3db7fe700 1 -- 172.21.15.86:0/3243266176 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56374cbfc640 con 0x56374cd12c30 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd1a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3da7fc700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0eda0 0x56374cd17520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd17a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40077b0 tx=0x7ff3d4007ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f849bcfd84622a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.041+0000 7ff3beff5700 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3beff5700 1 -- 172.21.15.86:0/3243266176 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4018020 con 0x56374cd12c30 2024-05-12T11:08:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3243266176 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3d0024930 con 0x56374cd12c30 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3beff5700 1 -- 172.21.15.86:0/3243266176 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff3d4014800 con 0x56374cd12c30 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3beff5700 1 -- 172.21.15.86:0/3243266176 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3d4023050 con 0x56374cd12c30 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 10 client.24697 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3243266176 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56374cd257f0 con 0x56374cd12c30 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3beff5700 1 -- 172.21.15.86:0/3243266176 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d0024930 con 0x56374cd12c30 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3beff5700 1 -- 172.21.15.86:0/3243266176 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ff3d401cb20 con 0x56374cd12c30 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 10 client.24697 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 10 client.24697 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 20 client.24697 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x56374cd27dd0 0x56374cd29240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 4 client.24697 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.042+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3243266176 --> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56374ccda600 con 0x56374cd27dd0 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.043+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x56374cd27dd0 0x56374cd29240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.043+0000 7ff3beff5700 10 client.24697 ms_handle_connect on v2:172.21.15.172:6838/2644756211 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.043+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x56374cd27dd0 0x56374cd29240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3902a5a6d5bf729 server_cookie=bb8fed205df4fa7a in_seq=0 out_seq=0 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3beff5700 1 -- 172.21.15.86:0/3243266176 <== mds.1 v2:172.21.15.172:6838/2644756211 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56374ccda600 con 0x56374cd27dd0 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3beff5700 10 client.24697 handle_command_reply: tid=0 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 client.24697 shutdown 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3243266176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 msgr2=0x56374cd17a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd17a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40077b0 tx=0x7ff3d4007ac0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3243266176 shutdown_connections 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x56374cd27dd0 0x56374cd29240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd17a60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd1a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3243266176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0eda0 0x56374cd17520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3beff5700 0 client.24697 ms_handle_reset on v2:172.21.15.172:6838/2644756211 2024-05-12T11:08:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3243266176 >> 172.21.15.86:0/3243266176 conn(0x56374cc3a0b0 msgr2=0x56374cd036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3243266176 shutdown_connections 2024-05-12T11:08:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3243266176 wait complete. 2024-05-12T11:08:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.044+0000 7ff3ebe17b80 20 client.24697 trim_cache size 0 max 16384 2024-05-12T11:08:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3ebe17b80 1 Processor -- start 2024-05-12T11:08:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3ebe17b80 1 -- start start 2024-05-12T11:08:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd0eda0 0x56374cd32a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd03550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56374cd27580 con 0x56374cd0e480 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56374cd27c50 con 0x56374cd12c30 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56374cd28320 con 0x56374cd0eda0 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd166a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60948/0 (socket says 172.21.15.86:60948) 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.065+0000 7ff3daffd700 1 -- 172.21.15.86:0/1270228181 learned_addr learned my addr 172.21.15.86:0/1270228181 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3daffd700 1 -- 172.21.15.86:0/1270228181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd0eda0 msgr2=0x56374cd32a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3daffd700 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd0eda0 0x56374cd32a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3daffd700 1 -- 172.21.15.86:0/1270228181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 msgr2=0x56374cd03550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd03550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3daffd700 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd03550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3daffd700 1 -- 172.21.15.86:0/1270228181 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56374cd15a90 con 0x56374cd0e480 2024-05-12T11:08:30.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd03550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3daffd700 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd166a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0032040 tx=0x7ff3d0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb464b37fad329a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3c0ff9700 1 -- 172.21.15.86:0/1270228181 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0034040 con 0x56374cd0e480 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3c0ff9700 1 -- 172.21.15.86:0/1270228181 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d002fba0 con 0x56374cd0e480 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.066+0000 7ff3c0ff9700 1 -- 172.21.15.86:0/1270228181 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000f930 con 0x56374cd0e480 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/1270228181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 msgr2=0x56374cd166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd166a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0032040 tx=0x7ff3d0009cd0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/1270228181 shutdown_connections 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd12c30 0x56374cd03550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0e480 0x56374cd166a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/1270228181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd0eda0 0x56374cd32a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/1270228181 >> 172.21.15.86:0/1270228181 conn(0x56374cc3a0b0 msgr2=0x56374cd02e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/1270228181 shutdown_connections 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/1270228181 wait complete. 2024-05-12T11:08:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- start start 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 Processor -- start 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0e480 0x56374cd8b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0eda0 0x56374cd8b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd96280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56374cd290c0 con 0x56374cd0eda0 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56374cd289f0 con 0x56374cd0e480 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56374cd29790 con 0x56374cd12c30 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3ebe17b80 10 client.0 _ll_register_callbacks cb 0x56374cbf88d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.067+0000 7ff3da7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0eda0 0x56374cd8b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3da7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0eda0 0x56374cd8b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60950/0 (socket says 172.21.15.86:60950) 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3027227735 learned_addr learned my addr 172.21.15.86:0/3027227735 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0e480 0x56374cd8b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3db7fe700 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd96280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3027227735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 msgr2=0x56374cd96280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3da7fc700 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd96280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0e480 msgr2=0x56374cd8b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3da7fc700 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0e480 0x56374cd8b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3da7fc700 1 -- 172.21.15.86:0/3027227735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56374cd967c0 con 0x56374cd0eda0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0e480 0x56374cd8b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3da7fc700 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0eda0 0x56374cd8b740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0a8ed0 tx=0x7ff3cc010640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afe4db56f46b44e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3beff5700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3beff5700 1 -- 172.21.15.86:0/3027227735 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0a8f40 con 0x56374cd0eda0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3beff5700 1 -- 172.21.15.86:0/3027227735 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff3cc011a40 con 0x56374cd0eda0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3027227735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3d002fba0 con 0x56374cd0eda0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3beff5700 1 -- 172.21.15.86:0/3027227735 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3cc0c9070 con 0x56374cd0eda0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3ebe17b80 10 client.15015 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3027227735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56374cd97920 con 0x56374cd0eda0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.068+0000 7ff3beff5700 1 -- 172.21.15.86:0/3027227735 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d002fba0 con 0x56374cd0eda0 2024-05-12T11:08:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3beff5700 1 -- 172.21.15.86:0/3027227735 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ff3cc0a7c10 con 0x56374cd0eda0 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3ebe17b80 10 client.15015 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3ebe17b80 10 client.15015 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3ebe17b80 20 client.15015 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x56374cd9c470 0x56374cd9b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3ebe17b80 4 client.15015 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3027227735 --> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] -- command(tid 0: {"prefix": "status"}) -- 0x56374cc6e1f0 con 0x56374cd9c470 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x56374cd9c470 0x56374cd9b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3daffd700 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x56374cd9c470 0x56374cd9b180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33dfedc4956700cf server_cookie=332520d7c88abe33 in_seq=0 out_seq=0 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3beff5700 10 client.15015 ms_handle_connect on v2:172.21.15.172:6838/2644756211 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3beff5700 1 -- 172.21.15.86:0/3027227735 <== mds.1 v2:172.21.15.172:6838/2644756211 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56374cc6e1f0 con 0x56374cd9c470 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3beff5700 10 client.15015 handle_command_reply: tid=0 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.069+0000 7ff3ebe17b80 1 client.15015 shutdown 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3027227735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0eda0 msgr2=0x56374cd8b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0eda0 0x56374cd8b740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0a8ed0 tx=0x7ff3cc010640 comp rx=0 tx=0).stop 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3027227735 shutdown_connections 2024-05-12T11:08:30.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x56374cd9c470 0x56374cd9b180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56374cd12c30 0x56374cd96280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56374cd0e480 0x56374cd8b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3beff5700 0 client.15015 ms_handle_reset on v2:172.21.15.172:6838/2644756211 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 --2- 172.21.15.86:0/3027227735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56374cd0eda0 0x56374cd8b740 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3027227735 >> 172.21.15.86:0/3027227735 conn(0x56374cc3a0b0 msgr2=0x56374cd036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3027227735 shutdown_connections 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 1 -- 172.21.15.86:0/3027227735 wait complete. 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3ebe17b80 20 client.15015 trim_cache size 0 max 16384 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 1, 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24443, 2024-05-12T11:08:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:08:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:08:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:08:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 130.85598981999999, 2024-05-12T11:08:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:08:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:08:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:08:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 160.187544828 2024-05-12T11:08:30.069 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:08:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 -- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff3c40b2880 msgr2=0x7ff3c40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff3c40b2880 0x7ff3c40b4d40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc199a50 tx=0x7ff3d0005c40 comp rx=0 tx=0).stop 2024-05-12T11:08:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 -- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc103040 msgr2=0x7ff3dc19ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc103040 0x7ff3dc19ec90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00b500 tx=0x7ff3cc00b810 comp rx=0 tx=0).stop 2024-05-12T11:08:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 -- 172.21.15.86:0/3417075502 shutdown_connections 2024-05-12T11:08:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff3c40b2880 0x7ff3c40b4d40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3dc1076e0 0x7ff3dc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc102690 0x7ff3dc19e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 --2- 172.21.15.86:0/3417075502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3dc103040 0x7ff3dc19ec90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:30.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.070+0000 7ff3e1584700 1 -- 172.21.15.86:0/3417075502 >> 172.21.15.86:0/3417075502 conn(0x7ff3dc0783f0 msgr2=0x7ff3dc1088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:30.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.071+0000 7ff3e1584700 1 -- 172.21.15.86:0/3417075502 shutdown_connections 2024-05-12T11:08:30.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:30.071+0000 7ff3e1584700 1 -- 172.21.15.86:0/3417075502 wait complete. 2024-05-12T11:08:30.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-12T11:08:30.964 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:31.347 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:31 smithi086 ceph-mon[30110]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:31.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:31 smithi172 ceph-mon[34517]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:31.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:31 smithi176 ceph-mon[34357]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.667+0000 7f94fbad0700 1 -- 172.21.15.86:0/3299839051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f4102d90 msgr2=0x7f94f410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.667+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3299839051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f4102d90 0x7f94f410f250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00b0a0 tx=0x7f94ec00b3b0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.667+0000 7f94fbad0700 1 -- 172.21.15.86:0/3299839051 shutdown_connections 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.667+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3299839051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f4102d90 0x7f94f410f250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.667+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3299839051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94f4108450 0x7f94f4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.667+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3299839051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f41023d0 0x7f94f4102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.667+0000 7f94fbad0700 1 -- 172.21.15.86:0/3299839051 >> 172.21.15.86:0/3299839051 conn(0x7f94f4078410 msgr2=0x7f94f4078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 -- 172.21.15.86:0/3299839051 shutdown_connections 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 -- 172.21.15.86:0/3299839051 wait complete. 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 Processor -- start 2024-05-12T11:08:32.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 -- start start 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f41023d0 0x7f94f419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f4102d90 0x7f94f419afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94f4108450 0x7f94f41a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94f4112620 con 0x7f94f41023d0 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f94f41124a0 con 0x7f94f4108450 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.668+0000 7f94fbad0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94f41127a0 con 0x7f94f4102d90 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f41023d0 0x7f94f419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f41023d0 0x7f94f419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54162/0 (socket says 172.21.15.86:54162) 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 -- 172.21.15.86:0/3678333108 learned_addr learned my addr 172.21.15.86:0/3678333108 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f906b700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f4102d90 0x7f94f419afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94fa06d700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94f4108450 0x7f94f41a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 -- 172.21.15.86:0/3678333108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f4102d90 msgr2=0x7f94f419afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f4102d90 0x7f94f419afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 -- 172.21.15.86:0/3678333108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94f4108450 msgr2=0x7f94f41a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94f4108450 0x7f94f41a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 -- 172.21.15.86:0/3678333108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f41a6060 con 0x7f94f41023d0 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94fa06d700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94f4108450 0x7f94f41a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94f986c700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f41023d0 0x7f94f419aaa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f94f000b530 tx=0x7f94f000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94eaffd700 1 -- 172.21.15.86:0/3678333108 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0015020 con 0x7f94f41023d0 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94fbad0700 1 -- 172.21.15.86:0/3678333108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f41a62f0 con 0x7f94f41023d0 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94eaffd700 1 -- 172.21.15.86:0/3678333108 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94f0011ce0 con 0x7f94f41023d0 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94eaffd700 1 -- 172.21.15.86:0/3678333108 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0010e40 con 0x7f94f41023d0 2024-05-12T11:08:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.669+0000 7f94fbad0700 1 -- 172.21.15.86:0/3678333108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f41a6800 con 0x7f94f41023d0 2024-05-12T11:08:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.671+0000 7f94eaffd700 1 -- 172.21.15.86:0/3678333108 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f94f0018020 con 0x7f94f41023d0 2024-05-12T11:08:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.672+0000 7f94eaffd700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94e00b2880 0x7f94e00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.672+0000 7f94f906b700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94e00b2880 0x7f94e00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.672+0000 7f94eaffd700 1 -- 172.21.15.86:0/3678333108 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f94f00e1a70 con 0x7f94f41023d0 2024-05-12T11:08:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94f906b700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94e00b2880 0x7f94e00b4d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f94f4078b50 tx=0x7f94e4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f9506363b80 1 Processor -- start 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f9506363b80 1 -- start start 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f9506363b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb243860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f9506363b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243da0 0x562afb2476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f9506363b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb247c30 0x562afb2480b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f9506363b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562afb195810 con 0x562afb243da0 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f9506363b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562afb134770 con 0x562afb243480 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f9506363b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562afb1917d0 con 0x562afb247c30 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94f906b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243da0 0x562afb2476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94f906b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243da0 0x562afb2476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54164/0 (socket says 172.21.15.86:54164) 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94f906b700 1 -- 172.21.15.86:0/2777650778 learned_addr learned my addr 172.21.15.86:0/2777650778 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94fa06d700 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb247c30 0x562afb2480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94f906b700 1 -- 172.21.15.86:0/2777650778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb247c30 msgr2=0x562afb2480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94f986c700 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb243860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94f906b700 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb247c30 0x562afb2480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.673+0000 7f94f906b700 1 -- 172.21.15.86:0/2777650778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 msgr2=0x562afb243860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.674+0000 7f94f906b700 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb243860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.674+0000 7f94f906b700 1 -- 172.21.15.86:0/2777650778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562afb0e2880 con 0x562afb243da0 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.674+0000 7f94f986c700 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb243860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.674+0000 7f94fa06d700 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb247c30 0x562afb2480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.674+0000 7f94f906b700 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243da0 0x562afb2476a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009fd0 tx=0x7f94e4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e82dc14c88a141 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.674+0000 7f94dffff700 1 -- 172.21.15.86:0/2777650778 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e401b040 con 0x562afb243da0 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.674+0000 7f94dffff700 1 -- 172.21.15.86:0/2777650778 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e4024070 con 0x562afb243da0 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.674+0000 7f94dffff700 1 -- 172.21.15.86:0/2777650778 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4013740 con 0x562afb243da0 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 -- 172.21.15.86:0/2777650778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243da0 msgr2=0x562afb2476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243da0 0x562afb2476a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009fd0 tx=0x7f94e4011000 comp rx=0 tx=0).stop 2024-05-12T11:08:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 -- 172.21.15.86:0/2777650778 shutdown_connections 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb247c30 0x562afb2480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb243860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 --2- 172.21.15.86:0/2777650778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243da0 0x562afb2476a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 -- 172.21.15.86:0/2777650778 >> 172.21.15.86:0/2777650778 conn(0x562afb16f0b0 msgr2=0x562afb23dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 -- 172.21.15.86:0/2777650778 shutdown_connections 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 -- 172.21.15.86:0/2777650778 wait complete. 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 -- start start 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.675+0000 7f9506363b80 1 Processor -- start 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f9506363b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243480 0x562afb24ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f9506363b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243da0 0x562afb24c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f9506363b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb24c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f9506363b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562afb24fe40 con 0x562afb247c30 2024-05-12T11:08:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f9506363b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562afb0fbbe0 con 0x562afb243da0 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f9506363b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562afb24ffc0 con 0x562afb243480 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f9506363b80 10 client.0 _ll_register_callbacks cb 0x562afb12d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb24c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb24c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54174/0 (socket says 172.21.15.86:54174) 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 -- 172.21.15.86:0/2917211883 learned_addr learned my addr 172.21.15.86:0/2917211883 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94f906b700 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243da0 0x562afb24c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94f986c700 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243480 0x562afb24ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 -- 172.21.15.86:0/2917211883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243480 msgr2=0x562afb24ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243480 0x562afb24ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 -- 172.21.15.86:0/2917211883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243da0 msgr2=0x562afb24c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243da0 0x562afb24c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 -- 172.21.15.86:0/2917211883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562afb131640 con 0x562afb247c30 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94fa06d700 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb24c7f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f94ec015000 tx=0x7f94ec004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b64e05aea370fd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94dd7fa700 1 -- 172.21.15.86:0/2917211883 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0078f0 con 0x562afb247c30 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f94dd7fa700 1 -- 172.21.15.86:0/2917211883 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f94ec007a90 con 0x562afb247c30 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.676+0000 7f9506363b80 1 -- 172.21.15.86:0/2917211883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94e4024070 con 0x562afb247c30 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f94dd7fa700 1 -- 172.21.15.86:0/2917211883 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94ec007c90 con 0x562afb247c30 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f9506363b80 10 client.15027 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f9506363b80 1 -- 172.21.15.86:0/2917211883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562afb25a4b0 con 0x562afb247c30 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f94dd7fa700 1 -- 172.21.15.86:0/2917211883 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e4024070 con 0x562afb247c30 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f94dd7fa700 1 -- 172.21.15.86:0/2917211883 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f94ec011070 con 0x562afb247c30 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f9506363b80 10 client.15027 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f9506363b80 10 client.15027 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f9506363b80 20 client.15027 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f9506363b80 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x562afb25cb40 0x562afb25dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f9506363b80 4 client.15027 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:08:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f9506363b80 1 -- 172.21.15.86:0/2917211883 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562afb20f600 con 0x562afb25cb40 2024-05-12T11:08:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.677+0000 7f94f986c700 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x562afb25cb40 0x562afb25dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.678+0000 7f94dd7fa700 10 client.15027 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:08:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.678+0000 7f94f986c700 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x562afb25cb40 0x562afb25dfb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35572a4805d5cad3 server_cookie=d8cdd3f57ef95457 in_seq=0 out_seq=0 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.678+0000 7f94dd7fa700 1 -- 172.21.15.86:0/2917211883 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562afb20f600 con 0x562afb25cb40 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.678+0000 7f94dd7fa700 10 client.15027 handle_command_reply: tid=0 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.678+0000 7f9506363b80 1 client.15027 shutdown 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 -- 172.21.15.86:0/2917211883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 msgr2=0x562afb24c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb24c7f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f94ec015000 tx=0x7f94ec004c80 comp rx=0 tx=0).stop 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 -- 172.21.15.86:0/2917211883 shutdown_connections 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x562afb25cb40 0x562afb25dfb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb24c7f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243480 0x562afb24ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 --2- 172.21.15.86:0/2917211883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243da0 0x562afb24c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f94dd7fa700 0 client.15027 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:08:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 -- 172.21.15.86:0/2917211883 >> 172.21.15.86:0/2917211883 conn(0x562afb16f0b0 msgr2=0x562afb2386d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:32.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 -- 172.21.15.86:0/2917211883 shutdown_connections 2024-05-12T11:08:32.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 1 -- 172.21.15.86:0/2917211883 wait complete. 2024-05-12T11:08:32.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.679+0000 7f9506363b80 20 client.15027 trim_cache size 0 max 16384 2024-05-12T11:08:32.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f9506363b80 1 Processor -- start 2024-05-12T11:08:32.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f9506363b80 1 -- start start 2024-05-12T11:08:32.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f9506363b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243480 0x562afb24ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f9506363b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 0x562afb267800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f9506363b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb247c30 0x562afb237e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f9506363b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562afb25c2f0 con 0x562afb243480 2024-05-12T11:08:32.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f9506363b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562afb25c9c0 con 0x562afb247c30 2024-05-12T11:08:32.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f9506363b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562afb25d090 con 0x562afb243da0 2024-05-12T11:08:32.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f986c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243480 0x562afb24ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f986c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243480 0x562afb24ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54188/0 (socket says 172.21.15.86:54188) 2024-05-12T11:08:32.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f986c700 1 -- 172.21.15.86:0/2693339489 learned_addr learned my addr 172.21.15.86:0/2693339489 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:32.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f906b700 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 0x562afb267800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94fa06d700 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb247c30 0x562afb237e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f986c700 1 -- 172.21.15.86:0/2693339489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 msgr2=0x562afb267800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:32.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f986c700 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 0x562afb267800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f986c700 1 -- 172.21.15.86:0/2693339489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb247c30 msgr2=0x562afb237e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:32.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f986c700 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb247c30 0x562afb237e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94f986c700 1 -- 172.21.15.86:0/2693339489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562afb23f4d0 con 0x562afb243480 2024-05-12T11:08:32.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.700+0000 7f94fa06d700 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb247c30 0x562afb237e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:32.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.701+0000 7f94f986c700 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243480 0x562afb24ba80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f94f000b500 tx=0x7f94f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7b87eb1e469fa5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:32.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.701+0000 7f94df7fe700 1 -- 172.21.15.86:0/2693339489 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00ad420 con 0x562afb243480 2024-05-12T11:08:32.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.701+0000 7f94df7fe700 1 -- 172.21.15.86:0/2693339489 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94f00b1ed0 con 0x562afb243480 2024-05-12T11:08:32.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.701+0000 7f94df7fe700 1 -- 172.21.15.86:0/2693339489 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00b1ca0 con 0x562afb243480 2024-05-12T11:08:32.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 -- 172.21.15.86:0/2693339489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243480 msgr2=0x562afb24ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243480 0x562afb24ba80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f94f000b500 tx=0x7f94f0004750 comp rx=0 tx=0).stop 2024-05-12T11:08:32.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 -- 172.21.15.86:0/2693339489 shutdown_connections 2024-05-12T11:08:32.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb247c30 0x562afb237e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb243480 0x562afb24ba80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 --2- 172.21.15.86:0/2693339489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 0x562afb267800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 -- 172.21.15.86:0/2693339489 >> 172.21.15.86:0/2693339489 conn(0x562afb16f0b0 msgr2=0x562afb24c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:32.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 -- 172.21.15.86:0/2693339489 shutdown_connections 2024-05-12T11:08:32.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 -- 172.21.15.86:0/2693339489 wait complete. 2024-05-12T11:08:32.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 -- start start 2024-05-12T11:08:32.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 Processor -- start 2024-05-12T11:08:32.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.702+0000 7f9506363b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb2444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f9506363b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 0x562afb244a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f9506363b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb244f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f9506363b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562afb25de30 con 0x562afb247c30 2024-05-12T11:08:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f9506363b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562afb25d760 con 0x562afb243480 2024-05-12T11:08:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f9506363b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562afb25e500 con 0x562afb243da0 2024-05-12T11:08:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f9506363b80 10 client.0 _ll_register_callbacks cb 0x562afb12d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:08:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb244f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb244f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54200/0 (socket says 172.21.15.86:54200) 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 -- 172.21.15.86:0/1740316313 learned_addr learned my addr 172.21.15.86:0/1740316313 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94f906b700 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 0x562afb244a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94f986c700 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb2444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 -- 172.21.15.86:0/1740316313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 msgr2=0x562afb244a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 0x562afb244a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 -- 172.21.15.86:0/1740316313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 msgr2=0x562afb2444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb2444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 -- 172.21.15.86:0/1740316313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562afb2cb0e0 con 0x562afb247c30 2024-05-12T11:08:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94fa06d700 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb244f40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00b3f0 tx=0x7f94ec031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999cf6b0b99e4b47 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:32.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:08:32.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94dd7fa700 1 -- 172.21.15.86:0/1740316313 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec035030 con 0x562afb247c30 2024-05-12T11:08:32.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f94dd7fa700 1 -- 172.21.15.86:0/1740316313 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f94ec00f040 con 0x562afb247c30 2024-05-12T11:08:32.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.703+0000 7f9506363b80 1 -- 172.21.15.86:0/1740316313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f00b1ed0 con 0x562afb247c30 2024-05-12T11:08:32.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f94dd7fa700 1 -- 172.21.15.86:0/1740316313 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94ec007900 con 0x562afb247c30 2024-05-12T11:08:32.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f9506363b80 10 client.15033 fetch_fsmap learned FSMap version 28 2024-05-12T11:08:32.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f9506363b80 1 -- 172.21.15.86:0/1740316313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562afb2cc350 con 0x562afb247c30 2024-05-12T11:08:32.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f94dd7fa700 1 -- 172.21.15.86:0/1740316313 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94f00b1ed0 con 0x562afb247c30 2024-05-12T11:08:32.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f94dd7fa700 1 -- 172.21.15.86:0/1740316313 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f94ec011070 con 0x562afb247c30 2024-05-12T11:08:32.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f9506363b80 10 client.15033 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:08:32.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f9506363b80 10 client.15033 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-12T11:08:32.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f9506363b80 20 client.15033 populate_metadata read hostname 'smithi086' 2024-05-12T11:08:32.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f9506363b80 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x562afb2d0ee0 0x562afb2cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:32.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f9506363b80 4 client.15033 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:08:32.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f9506363b80 1 -- 172.21.15.86:0/1740316313 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "status"}) -- 0x562afb1a31f0 con 0x562afb2d0ee0 2024-05-12T11:08:32.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.704+0000 7f94f986c700 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x562afb2d0ee0 0x562afb2cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f94f986c700 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x562afb2d0ee0 0x562afb2cfbf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c3ddee5b30a066 server_cookie=f8d72943085307c0 in_seq=0 out_seq=0 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f94dd7fa700 10 client.15033 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f94dd7fa700 1 -- 172.21.15.86:0/1740316313 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562afb1a31f0 con 0x562afb2d0ee0 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f94dd7fa700 10 client.15033 handle_command_reply: tid=0 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 client.15033 shutdown 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 -- 172.21.15.86:0/1740316313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 msgr2=0x562afb244f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb244f40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00b3f0 tx=0x7f94ec031810 comp rx=0 tx=0).stop 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 -- 172.21.15.86:0/1740316313 shutdown_connections 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x562afb2d0ee0 0x562afb2cfbf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562afb247c30 0x562afb244f40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f94dd7fa700 0 client.15033 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562afb243480 0x562afb2444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 --2- 172.21.15.86:0/1740316313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562afb243da0 0x562afb244a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 -- 172.21.15.86:0/1740316313 >> 172.21.15.86:0/1740316313 conn(0x562afb16f0b0 msgr2=0x562afb237e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 -- 172.21.15.86:0/1740316313 shutdown_connections 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 1 -- 172.21.15.86:0/1740316313 wait complete. 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.705+0000 7f9506363b80 20 client.15033 trim_cache size 0 max 16384 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:08:32.710 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24466, 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 145.53698248000001, 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 173.14213369399999 2024-05-12T11:08:32.711 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 -- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94e00b2880 msgr2=0x7f94e00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94e00b2880 0x7f94e00b4d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f94f4078b50 tx=0x7f94e4009190 comp rx=0 tx=0).stop 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 -- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f41023d0 msgr2=0x7f94f419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f41023d0 0x7f94f419aaa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f94f000b530 tx=0x7f94f000b840 comp rx=0 tx=0).stop 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 -- 172.21.15.86:0/3678333108 shutdown_connections 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f94e00b2880 0x7f94e00b4d40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94f4108450 0x7f94f41a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f41023d0 0x7f94f419aaa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 --2- 172.21.15.86:0/3678333108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f4102d90 0x7f94f419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:32.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 -- 172.21.15.86:0/3678333108 >> 172.21.15.86:0/3678333108 conn(0x7f94f4078410 msgr2=0x7f94f4101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:32.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 -- 172.21.15.86:0/3678333108 shutdown_connections 2024-05-12T11:08:32.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:32.706+0000 7f94fbad0700 1 -- 172.21.15.86:0/3678333108 wait complete. 2024-05-12T11:08:33.386 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:33 smithi086 ceph-mon[30110]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:33.414 INFO:tasks.cephadm:Setup complete, yielding 2024-05-12T11:08:33.414 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-12T11:08:33.425 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:08:33.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- bash -c 'ceph orch status' 2024-05-12T11:08:33.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:33 smithi172 ceph-mon[34517]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:33.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:33 smithi176 ceph-mon[34357]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:33.667 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 -- 172.21.15.86:0/143583115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 msgr2=0x7f05e410b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/143583115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 0x7f05e410b650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f05d400b0a0 tx=0x7f05d400b3b0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 -- 172.21.15.86:0/143583115 shutdown_connections 2024-05-12T11:08:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/143583115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 0x7f05e410b650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/143583115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e4103f80 0x7f05e4106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/143583115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e41068b0 0x7f05e4108ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 -- 172.21.15.86:0/143583115 >> 172.21.15.86:0/143583115 conn(0x7f05e40fd990 msgr2=0x7f05e40ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 -- 172.21.15.86:0/143583115 shutdown_connections 2024-05-12T11:08:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.356+0000 7f05e9e6d700 1 -- 172.21.15.86:0/143583115 wait complete. 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e9e6d700 1 Processor -- start 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e9e6d700 1 -- start start 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e9e6d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e4103f80 0x7f05e41038e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e9e6d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e41068b0 0x7f05e4101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e9e6d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 0x7f05e4102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e9e6d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05e410efd0 con 0x7f05e41091e0 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e9e6d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05e410ee50 con 0x7f05e41068b0 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e9e6d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f05e410f150 con 0x7f05e4103f80 2024-05-12T11:08:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 0x7f05e4102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 0x7f05e4102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54214/0 (socket says 172.21.15.86:54214) 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.357+0000 7f05e3fff700 1 -- 172.21.15.86:0/2251577164 learned_addr learned my addr 172.21.15.86:0/2251577164 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e37fe700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e4103f80 0x7f05e41038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e2ffd700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e41068b0 0x7f05e4101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e3fff700 1 -- 172.21.15.86:0/2251577164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e4103f80 msgr2=0x7f05e41038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e3fff700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e4103f80 0x7f05e41038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e3fff700 1 -- 172.21.15.86:0/2251577164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e41068b0 msgr2=0x7f05e4101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e3fff700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e41068b0 0x7f05e4101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e3fff700 1 -- 172.21.15.86:0/2251577164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4102d20 con 0x7f05e41091e0 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e2ffd700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e41068b0 0x7f05e4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e3fff700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 0x7f05e4102470 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f05d400b070 tx=0x7f05d400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e0ff9700 1 -- 172.21.15.86:0/2251577164 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4021070 con 0x7f05e41091e0 2024-05-12T11:08:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e41a3710 con 0x7f05e41091e0 2024-05-12T11:08:35.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e0ff9700 1 -- 172.21.15.86:0/2251577164 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05d4004020 con 0x7f05e41091e0 2024-05-12T11:08:35.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e0ff9700 1 -- 172.21.15.86:0/2251577164 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d401d690 con 0x7f05e41091e0 2024-05-12T11:08:35.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.358+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e41a3cd0 con 0x7f05e41091e0 2024-05-12T11:08:35.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.359+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e406a190 con 0x7f05e41091e0 2024-05-12T11:08:35.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.361+0000 7f05e0ff9700 1 -- 172.21.15.86:0/2251577164 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f05d40041d0 con 0x7f05e41091e0 2024-05-12T11:08:35.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.361+0000 7f05e0ff9700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05d00b2880 0x7f05d00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:35.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.361+0000 7f05e37fe700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05d00b2880 0x7f05d00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:35.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.361+0000 7f05e0ff9700 1 -- 172.21.15.86:0/2251577164 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f05d400f020 con 0x7f05e41091e0 2024-05-12T11:08:35.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.362+0000 7f05e37fe700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05d00b2880 0x7f05d00b4d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006fd0 tx=0x7f05dc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:35.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.365+0000 7f05e0ff9700 1 -- 172.21.15.86:0/2251577164 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f05d402a020 con 0x7f05e41091e0 2024-05-12T11:08:35.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:35 smithi086 ceph-mon[30110]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:35.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:35 smithi172 ceph-mon[34517]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:35.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:35 smithi176 ceph-mon[34357]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:35.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.587+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f05e40638e0 con 0x7f05d00b2880 2024-05-12T11:08:35.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.588+0000 7f05e0ff9700 1 -- 172.21.15.86:0/2251577164 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f05e40638e0 con 0x7f05d00b2880 2024-05-12T11:08:35.579 INFO:teuthology.orchestra.run.smithi086.stdout:Backend: cephadm 2024-05-12T11:08:35.579 INFO:teuthology.orchestra.run.smithi086.stdout:Available: Yes 2024-05-12T11:08:35.579 INFO:teuthology.orchestra.run.smithi086.stdout:Paused: No 2024-05-12T11:08:35.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05d00b2880 msgr2=0x7f05d00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:35.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05d00b2880 0x7f05d00b4d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006fd0 tx=0x7f05dc008040 comp rx=0 tx=0).stop 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 msgr2=0x7f05e4102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 0x7f05e4102470 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f05d400b070 tx=0x7f05d400cf80 comp rx=0 tx=0).stop 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 shutdown_connections 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05d00b2880 0x7f05d00b4d40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e41091e0 0x7f05e4102470 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e4103f80 0x7f05e41038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 --2- 172.21.15.86:0/2251577164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e41068b0 0x7f05e4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.590+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 >> 172.21.15.86:0/2251577164 conn(0x7f05e40fd990 msgr2=0x7f05e41048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.591+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 shutdown_connections 2024-05-12T11:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:35.591+0000 7f05e9e6d700 1 -- 172.21.15.86:0/2251577164 wait complete. 2024-05-12T11:08:36.233 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-12T11:08:36.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:36 smithi086 ceph-mon[30110]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:36.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:36 smithi172 ceph-mon[34517]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:36.477 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:36.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:36 smithi176 ceph-mon[34357]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:37.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:37 smithi086 ceph-mon[30110]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:37.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:37 smithi172 ceph-mon[34517]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:37.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:37 smithi176 ceph-mon[34357]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:38.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.160+0000 7f88b4cb7700 1 -- 172.21.15.86:0/3985361539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 msgr2=0x7f88b010b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.160+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/3985361539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 0x7f88b010b950 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f88a800b0d0 tx=0x7f88a800b3e0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.160+0000 7f88b4cb7700 1 -- 172.21.15.86:0/3985361539 shutdown_connections 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.160+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/3985361539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 0x7f88b010b950 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.160+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/3985361539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b0103500 0x7f88b0103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.160+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/3985361539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88b0104700 0x7f88b0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.160+0000 7f88b4cb7700 1 -- 172.21.15.86:0/3985361539 >> 172.21.15.86:0/3985361539 conn(0x7f88b00feaa0 msgr2=0x7f88b0100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.160+0000 7f88b4cb7700 1 -- 172.21.15.86:0/3985361539 shutdown_connections 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 -- 172.21.15.86:0/3985361539 wait complete. 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 Processor -- start 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 -- start start 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b0103500 0x7f88b0077240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88b0104700 0x7f88b0075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 0x7f88b0075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f88b010f020 con 0x7f88b01050a0 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88b010eea0 con 0x7f88b0103500 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.161+0000 7f88b4cb7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88b010f1a0 con 0x7f88b0104700 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 0x7f88b0075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 0x7f88b0075dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54232/0 (socket says 172.21.15.86:54232) 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 -- 172.21.15.86:0/919402046 learned_addr learned my addr 172.21.15.86:0/919402046 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88add9b700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88b0104700 0x7f88b0075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88ae59c700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b0103500 0x7f88b0077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 -- 172.21.15.86:0/919402046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88b0104700 msgr2=0x7f88b0075890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88b0104700 0x7f88b0075890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 -- 172.21.15.86:0/919402046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b0103500 msgr2=0x7f88b0077240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b0103500 0x7f88b0077240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 -- 172.21.15.86:0/919402046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b0076680 con 0x7f88b01050a0 2024-05-12T11:08:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88aed9d700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 0x7f88b0075dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009fd0 tx=0x7f88a8004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f889f7fe700 1 -- 172.21.15.86:0/919402046 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a801f030 con 0x7f88b01050a0 2024-05-12T11:08:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b01a3710 con 0x7f88b01050a0 2024-05-12T11:08:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f889f7fe700 1 -- 172.21.15.86:0/919402046 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88a8003a00 con 0x7f88b01050a0 2024-05-12T11:08:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f889f7fe700 1 -- 172.21.15.86:0/919402046 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a80047f0 con 0x7f88b01050a0 2024-05-12T11:08:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.162+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b01a3b90 con 0x7f88b01050a0 2024-05-12T11:08:38.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.163+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b006a190 con 0x7f88b01050a0 2024-05-12T11:08:38.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.165+0000 7f889f7fe700 1 -- 172.21.15.86:0/919402046 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f88a8003bb0 con 0x7f88b01050a0 2024-05-12T11:08:38.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.165+0000 7f889f7fe700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f88980b2880 0x7f88980b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:38.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.165+0000 7f88ae59c700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f88980b2880 0x7f88980b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:38.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.165+0000 7f889f7fe700 1 -- 172.21.15.86:0/919402046 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f88a800f020 con 0x7f88b01050a0 2024-05-12T11:08:38.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.166+0000 7f88ae59c700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f88980b2880 0x7f88980b4d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f88b0104560 tx=0x7f88a0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:38.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.169+0000 7f889f7fe700 1 -- 172.21.15.86:0/919402046 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f88a8029020 con 0x7f88b01050a0 2024-05-12T11:08:38.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.382+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f88b00638e0 con 0x7f88980b2880 2024-05-12T11:08:38.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.396+0000 7f889f7fe700 1 -- 172.21.15.86:0/919402046 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f88b00638e0 con 0x7f88980b2880 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.a smithi086 running (2m) 30s ago 2m 19.2M - 19.0.0-3517-gf1ec8823 6791bdeb4eda e11230b9fcd1 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.b smithi172 running (2m) 33s ago 2m 22.6M - 19.0.0-3517-gf1ec8823 6791bdeb4eda d5ccd5369888 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.c smithi176 running (3m) 33s ago 3m 22.1M - 19.0.0-3517-gf1ec8823 6791bdeb4eda 2a5c72407815 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.d smithi086 running (3m) 30s ago 3m 13.7M - 19.0.0-3517-gf1ec8823 6791bdeb4eda a5800a290abd 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.e smithi172 running (3m) 33s ago 3m 22.1M - 19.0.0-3517-gf1ec8823 6791bdeb4eda 8602267d807b 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.f smithi176 running (3m) 33s ago 3m 19.7M - 19.0.0-3517-gf1ec8823 6791bdeb4eda b18ed50f4088 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.g smithi086 running (2m) 30s ago 2m 18.7M - 19.0.0-3517-gf1ec8823 6791bdeb4eda 4d7310f5c6c3 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.h smithi172 running (3m) 33s ago 3m 19.4M - 19.0.0-3517-gf1ec8823 6791bdeb4eda cbd4d8913856 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.i smithi176 running (2m) 33s ago 2m 26.3M - 19.0.0-3517-gf1ec8823 6791bdeb4eda dae97fceaa9a 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.j smithi086 running (3m) 30s ago 3m 17.0M - 19.0.0-3517-gf1ec8823 6791bdeb4eda 52c0a89746c1 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.k smithi172 running (3m) 33s ago 3m 19.5M - 19.0.0-3517-gf1ec8823 6791bdeb4eda edaeeb374b3d 2024-05-12T11:08:38.387 INFO:teuthology.orchestra.run.smithi086.stdout:mds.l smithi176 running (3m) 33s ago 3m 21.9M - 19.0.0-3517-gf1ec8823 6791bdeb4eda d116c79b1903 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:mgr.x smithi086 *:9283,8765 running (10m) 30s ago 10m 531M - 19.0.0-3517-gf1ec8823 6791bdeb4eda c006a90d75fa 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:mgr.y smithi172 *:8443,8765 running (8m) 33s ago 8m 470M - 19.0.0-3517-gf1ec8823 6791bdeb4eda 24d1c8192c9a 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:mgr.z smithi176 *:8443,8765 running (8m) 33s ago 8m 466M - 19.0.0-3517-gf1ec8823 6791bdeb4eda 9e11416f5d2b 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:mon.a smithi086 running (10m) 30s ago 10m 56.7M 2048M 19.0.0-3517-gf1ec8823 6791bdeb4eda 272d40c7cd93 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:mon.b smithi172 running (9m) 33s ago 9m 41.2M 2048M 19.0.0-3517-gf1ec8823 6791bdeb4eda caaa4d031058 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:mon.c smithi176 running (9m) 33s ago 9m 41.8M 2048M 19.0.0-3517-gf1ec8823 6791bdeb4eda f56d1b53be8d 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0 smithi086 running (8m) 30s ago 8m 47.4M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 9889602b32a5 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1 smithi172 running (7m) 33s ago 7m 58.4M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 9e72443f9e81 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2 smithi176 running (7m) 33s ago 7m 59.4M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 85f2fc86a5aa 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3 smithi086 running (7m) 30s ago 7m 55.7M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda d5e2dd689446 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4 smithi172 running (6m) 33s ago 6m 56.9M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 5c9346018318 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5 smithi176 running (6m) 33s ago 6m 58.4M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 37c4c9d351ba 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6 smithi086 running (5m) 30s ago 5m 53.5M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 9534a682394e 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7 smithi172 running (5m) 33s ago 5m 45.6M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 26a3c646ba15 2024-05-12T11:08:38.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8 smithi176 running (5m) 33s ago 5m 53.9M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 40e95d0c0dbb 2024-05-12T11:08:38.389 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9 smithi086 running (4m) 30s ago 4m 43.6M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 272e2215ed78 2024-05-12T11:08:38.389 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10 smithi172 running (4m) 33s ago 4m 57.2M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 630dd2188483 2024-05-12T11:08:38.389 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11 smithi176 running (3m) 33s ago 3m 45.2M 4272M 19.0.0-3517-gf1ec8823 6791bdeb4eda 49965f8b38b0 2024-05-12T11:08:38.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f88980b2880 msgr2=0x7f88980b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:38.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f88980b2880 0x7f88980b4d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f88b0104560 tx=0x7f88a0009190 comp rx=0 tx=0).stop 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 msgr2=0x7f88b0075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 0x7f88b0075dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009fd0 tx=0x7f88a8004e40 comp rx=0 tx=0).stop 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 shutdown_connections 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f88980b2880 0x7f88980b4d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88b01050a0 0x7f88b0075dd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b0103500 0x7f88b0077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 --2- 172.21.15.86:0/919402046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88b0104700 0x7f88b0075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 >> 172.21.15.86:0/919402046 conn(0x7f88b00feaa0 msgr2=0x7f88b0107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 shutdown_connections 2024-05-12T11:08:38.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:38.398+0000 7f88b4cb7700 1 -- 172.21.15.86:0/919402046 wait complete. 2024-05-12T11:08:39.133 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-12T11:08:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:39.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:39 smithi086 ceph-mon[30110]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:39.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:39 smithi086 ceph-mon[30110]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:39.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:39 smithi172 ceph-mon[34517]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:39.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:39 smithi172 ceph-mon[34517]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:39.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:39 smithi176 ceph-mon[34357]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:39.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:39 smithi176 ceph-mon[34357]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 -- 172.21.15.86:0/2470940364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 msgr2=0x7f1654103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 --2- 172.21.15.86:0/2470940364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 0x7f1654103a50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f163c0099c0 tx=0x7f163c009cd0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 -- 172.21.15.86:0/2470940364 shutdown_connections 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 --2- 172.21.15.86:0/2470940364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1654103f90 0x7f165410a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 --2- 172.21.15.86:0/2470940364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16541023f0 0x7f1654102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 --2- 172.21.15.86:0/2470940364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 0x7f1654103a50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 -- 172.21.15.86:0/2470940364 >> 172.21.15.86:0/2470940364 conn(0x7f16540fd990 msgr2=0x7f16540ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 -- 172.21.15.86:0/2470940364 shutdown_connections 2024-05-12T11:08:41.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 -- 172.21.15.86:0/2470940364 wait complete. 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 Processor -- start 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.157+0000 7f1659478700 1 -- start start 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f1659478700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16541023f0 0x7f16541996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f1659478700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 0x7f1654199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f1659478700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1654103f90 0x7f16541a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f1659478700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f165410dee0 con 0x7f16541035f0 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f1659478700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f165410dd60 con 0x7f1654103f90 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f1659478700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f165410e060 con 0x7f16541023f0 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 0x7f1654199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 0x7f1654199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54250/0 (socket says 172.21.15.86:54250) 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 -- 172.21.15.86:0/1784548074 learned_addr learned my addr 172.21.15.86:0/1784548074 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f1652ffd700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16541023f0 0x7f16541996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16537fe700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1654103f90 0x7f16541a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:41.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 -- 172.21.15.86:0/1784548074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16541023f0 msgr2=0x7f16541996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16541023f0 0x7f16541996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 -- 172.21.15.86:0/1784548074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1654103f90 msgr2=0x7f16541a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1654103f90 0x7f16541a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 -- 172.21.15.86:0/1784548074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16541a1300 con 0x7f16541035f0 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f16527fc700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 0x7f1654199be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f163c005910 tx=0x7f163c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f164bfff700 1 -- 172.21.15.86:0/1784548074 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c027070 con 0x7f16541035f0 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16541a1590 con 0x7f16541035f0 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f164bfff700 1 -- 172.21.15.86:0/1784548074 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f163c004020 con 0x7f16541035f0 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.158+0000 7f164bfff700 1 -- 172.21.15.86:0/1784548074 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c022c50 con 0x7f16541035f0 2024-05-12T11:08:41.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.159+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16541a1ac0 con 0x7f16541035f0 2024-05-12T11:08:41.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.159+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165406a190 con 0x7f16541035f0 2024-05-12T11:08:41.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.162+0000 7f164bfff700 1 -- 172.21.15.86:0/1784548074 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f163c02a070 con 0x7f16541035f0 2024-05-12T11:08:41.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.162+0000 7f164bfff700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f16400b2880 0x7f16400b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:41.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.163+0000 7f1652ffd700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f16400b2880 0x7f16400b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:41.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.163+0000 7f164bfff700 1 -- 172.21.15.86:0/1784548074 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f163c0e38b0 con 0x7f16541035f0 2024-05-12T11:08:41.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.163+0000 7f1652ffd700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f16400b2880 0x7f16400b4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f164c009550 tx=0x7f164c0091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:41.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.166+0000 7f164bfff700 1 -- 172.21.15.86:0/1784548074 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f163c031070 con 0x7f16541035f0 2024-05-12T11:08:41.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.382+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f16540ffbb0 con 0x7f16400b2880 2024-05-12T11:08:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.388+0000 7f164bfff700 1 -- 172.21.15.86:0/1784548074 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f16540ffbb0 con 0x7f16400b2880 2024-05-12T11:08:41.379 INFO:teuthology.orchestra.run.smithi086.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-12T11:08:41.380 INFO:teuthology.orchestra.run.smithi086.stdout:mds.all 12/12 36s ago 3m smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l;count:12 2024-05-12T11:08:41.380 INFO:teuthology.orchestra.run.smithi086.stdout:mgr 3/3 36s ago 8m smithi086=x;smithi172=y;smithi176=z;count:3 2024-05-12T11:08:41.380 INFO:teuthology.orchestra.run.smithi086.stdout:mon 3/3 36s ago 9m smithi086:172.21.15.86=a;smithi172:172.21.15.172=b;smithi176:172.21.15.176=c;count:3 2024-05-12T11:08:41.380 INFO:teuthology.orchestra.run.smithi086.stdout:osd 12 36s ago - 2024-05-12T11:08:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f16400b2880 msgr2=0x7f16400b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f16400b2880 0x7f16400b4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f164c009550 tx=0x7f164c0091b0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 msgr2=0x7f1654199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 0x7f1654199be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f163c005910 tx=0x7f163c005b00 comp rx=0 tx=0).stop 2024-05-12T11:08:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 shutdown_connections 2024-05-12T11:08:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f16400b2880 0x7f16400b4d40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1654103f90 0x7f16541a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16541023f0 0x7f16541996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 --2- 172.21.15.86:0/1784548074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16541035f0 0x7f1654199be0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:41.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.390+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 >> 172.21.15.86:0/1784548074 conn(0x7f16540fd990 msgr2=0x7f16540ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:41.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.391+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 shutdown_connections 2024-05-12T11:08:41.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:41.391+0000 7f1659478700 1 -- 172.21.15.86:0/1784548074 wait complete. 2024-05-12T11:08:41.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:41 smithi086 ceph-mon[30110]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:41.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:41 smithi172 ceph-mon[34517]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:41.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:41 smithi176 ceph-mon[34357]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:42.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-12T11:08:42.282 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:42.405 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:42 smithi086 ceph-mon[30110]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:42.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:42 smithi172 ceph-mon[34517]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:42.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:42 smithi176 ceph-mon[34357]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:43.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:43 smithi086 ceph-mon[30110]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:43.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:43 smithi172 ceph-mon[34517]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:43.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:43 smithi176 ceph-mon[34357]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:44.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 -- 172.21.15.86:0/2844478214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103630 msgr2=0x7fb5f4103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:44.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 --2- 172.21.15.86:0/2844478214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103630 0x7fb5f4103a90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0099c0 tx=0x7fb5dc009cd0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 -- 172.21.15.86:0/2844478214 shutdown_connections 2024-05-12T11:08:44.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 --2- 172.21.15.86:0/2844478214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f4103fd0 0x7fb5f410a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 --2- 172.21.15.86:0/2844478214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102430 0x7fb5f4102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 --2- 172.21.15.86:0/2844478214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103630 0x7fb5f4103a90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 -- 172.21.15.86:0/2844478214 >> 172.21.15.86:0/2844478214 conn(0x7fb5f40fd9f0 msgr2=0x7fb5f40ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:44.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 -- 172.21.15.86:0/2844478214 shutdown_connections 2024-05-12T11:08:44.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.119+0000 7fb5f9839700 1 -- 172.21.15.86:0/2844478214 wait complete. 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.120+0000 7fb5f9839700 1 Processor -- start 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.120+0000 7fb5f9839700 1 -- start start 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f9839700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102430 0x7fb5f4199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f9839700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f4103630 0x7fb5f4199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f9839700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103fd0 0x7fb5f41a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f9839700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f410df20 con 0x7fb5f4103fd0 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f9839700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f410dda0 con 0x7fb5f4102430 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f9839700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f410e0a0 con 0x7fb5f4103630 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103fd0 0x7fb5f41a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:44.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103fd0 0x7fb5f41a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42214/0 (socket says 172.21.15.86:42214) 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f27fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f4103630 0x7fb5f4199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 -- 172.21.15.86:0/1903414861 learned_addr learned my addr 172.21.15.86:0/1903414861 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f2ffd700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102430 0x7fb5f4199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 -- 172.21.15.86:0/1903414861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f4103630 msgr2=0x7fb5f4199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f4103630 0x7fb5f4199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 -- 172.21.15.86:0/1903414861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102430 msgr2=0x7fb5f4199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102430 0x7fb5f4199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 -- 172.21.15.86:0/1903414861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f41a1280 con 0x7fb5f4103fd0 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f2ffd700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102430 0x7fb5f4199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.121+0000 7fb5f37fe700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103fd0 0x7fb5f41a0be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00b580 tx=0x7fb5ec00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.122+0000 7fb5f8837700 1 -- 172.21.15.86:0/1903414861 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec015020 con 0x7fb5f4103fd0 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.122+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f41a1570 con 0x7fb5f4103fd0 2024-05-12T11:08:44.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.122+0000 7fb5f8837700 1 -- 172.21.15.86:0/1903414861 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5ec011ce0 con 0x7fb5f4103fd0 2024-05-12T11:08:44.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.122+0000 7fb5f8837700 1 -- 172.21.15.86:0/1903414861 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec010dd0 con 0x7fb5f4103fd0 2024-05-12T11:08:44.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.122+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f41a1b00 con 0x7fb5f4103fd0 2024-05-12T11:08:44.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.123+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f406a190 con 0x7fb5f4103fd0 2024-05-12T11:08:44.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.124+0000 7fb5f8837700 1 -- 172.21.15.86:0/1903414861 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb5ec018020 con 0x7fb5f4103fd0 2024-05-12T11:08:44.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.125+0000 7fb5f8837700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb5e00b2880 0x7fb5e00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:44.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.125+0000 7fb5f2ffd700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb5e00b2880 0x7fb5e00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:44.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.125+0000 7fb5f8837700 1 -- 172.21.15.86:0/1903414861 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb5ec0e1920 con 0x7fb5f4103fd0 2024-05-12T11:08:44.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.125+0000 7fb5f2ffd700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb5e00b2880 0x7fb5e00b4d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4103490 tx=0x7fb5e4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:44.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.129+0000 7fb5f8837700 1 -- 172.21.15.86:0/1903414861 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb5ec01f020 con 0x7fb5f4103fd0 2024-05-12T11:08:44.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.343+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fb5f41a1dc0 con 0x7fb5e00b2880 2024-05-12T11:08:44.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.347+0000 7fb5f8837700 1 -- 172.21.15.86:0/1903414861 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fb5f41a1dc0 con 0x7fb5e00b2880 2024-05-12T11:08:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:HOST ADDR LABELS STATUS 2024-05-12T11:08:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086 172.21.15.86 2024-05-12T11:08:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:smithi172 172.21.15.172 2024-05-12T11:08:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:smithi176 172.21.15.176 2024-05-12T11:08:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:3 hosts in cluster 2024-05-12T11:08:44.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb5e00b2880 msgr2=0x7fb5e00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:44.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb5e00b2880 0x7fb5e00b4d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4103490 tx=0x7fb5e4009040 comp rx=0 tx=0).stop 2024-05-12T11:08:44.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103fd0 msgr2=0x7fb5f41a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:44.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103fd0 0x7fb5f41a0be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00b580 tx=0x7fb5ec00b890 comp rx=0 tx=0).stop 2024-05-12T11:08:44.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 shutdown_connections 2024-05-12T11:08:44.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fb5e00b2880 0x7fb5e00b4d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f4103fd0 0x7fb5f41a0be0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102430 0x7fb5f4199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 --2- 172.21.15.86:0/1903414861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f4103630 0x7fb5f4199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:44.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 >> 172.21.15.86:0/1903414861 conn(0x7fb5f40fd9f0 msgr2=0x7fb5f406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:44.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 shutdown_connections 2024-05-12T11:08:44.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:44.349+0000 7fb5f9839700 1 -- 172.21.15.86:0/1903414861 wait complete. 2024-05-12T11:08:44.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-12T11:08:45.240 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:45.362 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:45 smithi086 ceph-mon[30110]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:45.362 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:45 smithi086 ceph-mon[30110]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:45.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:45 smithi172 ceph-mon[34517]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:45.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:45 smithi172 ceph-mon[34517]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:45.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:45 smithi176 ceph-mon[34357]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:45.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:45 smithi176 ceph-mon[34357]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:46.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 -- 172.21.15.86:0/113246787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78102970 msgr2=0x7efe78102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:46.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/113246787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78102970 0x7efe78102d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efe60009990 tx=0x7efe60009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:46.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 -- 172.21.15.86:0/113246787 shutdown_connections 2024-05-12T11:08:46.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/113246787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe78104050 0x7efe7810a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:46.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/113246787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78102970 0x7efe78102d90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:46.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/113246787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe78103690 0x7efe78103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:46.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 -- 172.21.15.86:0/113246787 >> 172.21.15.86:0/113246787 conn(0x7efe780fd170 msgr2=0x7efe780ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:46.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 -- 172.21.15.86:0/113246787 shutdown_connections 2024-05-12T11:08:46.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.972+0000 7efe7d5c4700 1 -- 172.21.15.86:0/113246787 wait complete. 2024-05-12T11:08:46.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.973+0000 7efe7d5c4700 1 Processor -- start 2024-05-12T11:08:46.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.973+0000 7efe7d5c4700 1 -- start start 2024-05-12T11:08:46.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe7d5c4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe78102970 0x7efe78102050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:46.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe7d5c4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe78103690 0x7efe7819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:46.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe7d5c4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78104050 0x7efe781a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:46.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe7d5c4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe7810e000 con 0x7efe78104050 2024-05-12T11:08:46.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe7d5c4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe7810de80 con 0x7efe78103690 2024-05-12T11:08:46.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe7d5c4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe7810e180 con 0x7efe78102970 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78104050 0x7efe781a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78104050 0x7efe781a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42228/0 (socket says 172.21.15.86:42228) 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 -- 172.21.15.86:0/1134133333 learned_addr learned my addr 172.21.15.86:0/1134133333 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe76ffd700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe78102970 0x7efe78102050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe767fc700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe78103690 0x7efe7819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 -- 172.21.15.86:0/1134133333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe78102970 msgr2=0x7efe78102050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe78102970 0x7efe78102050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 -- 172.21.15.86:0/1134133333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe78103690 msgr2=0x7efe7819e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe78103690 0x7efe7819e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 -- 172.21.15.86:0/1134133333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe781a1380 con 0x7efe78104050 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe777fe700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78104050 0x7efe781a0ab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efe7000b970 tx=0x7efe7000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe6ffff700 1 -- 172.21.15.86:0/1134133333 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70019070 con 0x7efe78104050 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe781a1670 con 0x7efe78104050 2024-05-12T11:08:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe6ffff700 1 -- 172.21.15.86:0/1134133333 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe70014440 con 0x7efe78104050 2024-05-12T11:08:46.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe6ffff700 1 -- 172.21.15.86:0/1134133333 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7000ce60 con 0x7efe78104050 2024-05-12T11:08:46.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.974+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe781a1c30 con 0x7efe78104050 2024-05-12T11:08:46.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.975+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7806a190 con 0x7efe78104050 2024-05-12T11:08:46.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.977+0000 7efe6ffff700 1 -- 172.21.15.86:0/1134133333 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efe7001c070 con 0x7efe78104050 2024-05-12T11:08:46.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.977+0000 7efe6ffff700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efe640b2880 0x7efe640b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:46.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.977+0000 7efe76ffd700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efe640b2880 0x7efe640b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:46.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.977+0000 7efe6ffff700 1 -- 172.21.15.86:0/1134133333 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7efe700e1b10 con 0x7efe78104050 2024-05-12T11:08:46.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.978+0000 7efe76ffd700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efe640b2880 0x7efe640b4d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b5c0 tx=0x7efe60005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:46.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:46.981+0000 7efe6ffff700 1 -- 172.21.15.86:0/1134133333 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efe700a9810 con 0x7efe78104050 2024-05-12T11:08:47.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.190+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7efe780638e0 con 0x7efe640b2880 2024-05-12T11:08:47.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.193+0000 7efe6ffff700 1 -- 172.21.15.86:0/1134133333 <== mgr.14152 v2:172.21.15.86:6800/155657181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7efe780638e0 con 0x7efe640b2880 2024-05-12T11:08:47.183 INFO:teuthology.orchestra.run.smithi086.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-12T11:08:47.184 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UL400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-12T11:08:47.184 INFO:teuthology.orchestra.run.smithi086.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-12T11:08:47.184 INFO:teuthology.orchestra.run.smithi086.stdout:smithi176 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330099400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efe640b2880 msgr2=0x7efe640b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efe640b2880 0x7efe640b4d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b5c0 tx=0x7efe60005fb0 comp rx=0 tx=0).stop 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78104050 msgr2=0x7efe781a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78104050 0x7efe781a0ab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efe7000b970 tx=0x7efe7000bd30 comp rx=0 tx=0).stop 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 shutdown_connections 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7efe640b2880 0x7efe640b4d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe78104050 0x7efe781a0ab0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe78102970 0x7efe78102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 --2- 172.21.15.86:0/1134133333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe78103690 0x7efe7819e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 >> 172.21.15.86:0/1134133333 conn(0x7efe780fd170 msgr2=0x7efe78106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:47.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 shutdown_connections 2024-05-12T11:08:47.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:47.195+0000 7efe7d5c4700 1 -- 172.21.15.86:0/1134133333 wait complete. 2024-05-12T11:08:47.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:47 smithi086 ceph-mon[30110]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:47.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:47 smithi172 ceph-mon[34517]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:47.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:47 smithi176 ceph-mon[34357]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:47.855 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-12T11:08:47.865 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:08:47.865 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-12T11:08:48.108 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:48.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:48 smithi086 ceph-mon[30110]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:48.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:48 smithi172 ceph-mon[34517]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:48.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:48 smithi176 ceph-mon[34357]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:08:49.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:49 smithi086 ceph-mon[30110]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:49.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:49 smithi172 ceph-mon[34517]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:49.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:49 smithi176 ceph-mon[34357]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:49.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.735+0000 7f99e2783700 1 -- 172.21.15.86:0/4180501573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103fa0 msgr2=0x7f99dc10a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:49.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.735+0000 7f99e2783700 1 --2- 172.21.15.86:0/4180501573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103fa0 0x7f99dc10a850 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99d400b0d0 tx=0x7f99d400b3e0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.735+0000 7f99e2783700 1 -- 172.21.15.86:0/4180501573 shutdown_connections 2024-05-12T11:08:49.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.735+0000 7f99e2783700 1 --2- 172.21.15.86:0/4180501573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103fa0 0x7f99dc10a850 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.735+0000 7f99e2783700 1 --2- 172.21.15.86:0/4180501573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99dc102400 0x7f99dc102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.735+0000 7f99e2783700 1 --2- 172.21.15.86:0/4180501573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc103600 0x7f99dc103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.735+0000 7f99e2783700 1 -- 172.21.15.86:0/4180501573 >> 172.21.15.86:0/4180501573 conn(0x7f99dc0fd9a0 msgr2=0x7f99dc0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:49.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 -- 172.21.15.86:0/4180501573 shutdown_connections 2024-05-12T11:08:49.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 -- 172.21.15.86:0/4180501573 wait complete. 2024-05-12T11:08:49.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 Processor -- start 2024-05-12T11:08:49.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 -- start start 2024-05-12T11:08:49.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99dc102400 0x7f99dc06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:49.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103600 0x7f99dc19e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:49.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc103fa0 0x7f99dc1a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:49.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc10de90 con 0x7f99dc103600 2024-05-12T11:08:49.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc10dd10 con 0x7f99dc103fa0 2024-05-12T11:08:49.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.736+0000 7f99e2783700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc10e010 con 0x7f99dc102400 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103600 0x7f99dc19e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103600 0x7f99dc19e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42242/0 (socket says 172.21.15.86:42242) 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 -- 172.21.15.86:0/3545991639 learned_addr learned my addr 172.21.15.86:0/3545991639 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99dbfff700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99dc102400 0x7f99dc06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99e0d20700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc103fa0 0x7f99dc1a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 -- 172.21.15.86:0/3545991639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99dc102400 msgr2=0x7f99dc06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99dc102400 0x7f99dc06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 -- 172.21.15.86:0/3545991639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc103fa0 msgr2=0x7f99dc1a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc103fa0 0x7f99dc1a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 -- 172.21.15.86:0/3545991639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc198150 con 0x7f99dc103600 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99dbfff700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99dc102400 0x7f99dc06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d3fff700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103600 0x7f99dc19e380 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99c400c920 tx=0x7f99c400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d9ffb700 1 -- 172.21.15.86:0/3545991639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4007b00 con 0x7f99dc103600 2024-05-12T11:08:49.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc198440 con 0x7f99dc103600 2024-05-12T11:08:49.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d9ffb700 1 -- 172.21.15.86:0/3545991639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99c4004ce0 con 0x7f99dc103600 2024-05-12T11:08:49.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99d9ffb700 1 -- 172.21.15.86:0/3545991639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4005650 con 0x7f99dc103600 2024-05-12T11:08:49.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.737+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc1989d0 con 0x7f99dc103600 2024-05-12T11:08:49.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.738+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc06a190 con 0x7f99dc103600 2024-05-12T11:08:49.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.741+0000 7f99d9ffb700 1 -- 172.21.15.86:0/3545991639 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f99c4007ca0 con 0x7f99dc103600 2024-05-12T11:08:49.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.741+0000 7f99d9ffb700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f99c80b2880 0x7f99c80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:49.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.741+0000 7f99dbfff700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f99c80b2880 0x7f99c80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:49.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.741+0000 7f99d9ffb700 1 -- 172.21.15.86:0/3545991639 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f99c40e2220 con 0x7f99dc103600 2024-05-12T11:08:49.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.742+0000 7f99dbfff700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f99c80b2880 0x7f99c80b4d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f99cc005950 tx=0x7f99cc005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:49.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.744+0000 7f99d9ffb700 1 -- 172.21.15.86:0/3545991639 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f99c4014030 con 0x7f99dc103600 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:e28 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:legacy client fscid: 1 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:Filesystem 'cephfs' (1) 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:fs_name cephfs 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 28 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:created 2024-05-12T11:06:07.078153+0000 2024-05-12T11:08:49.988 INFO:teuthology.orchestra.run.smithi086.stdout:modified 2024-05-12T11:06:25.320260+0000 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:tableserver 0 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:root 0 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:session_timeout 300 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:session_autoclose 300 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:max_file_size 1099511627776 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:max_xattr_size 65536 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:required_client_features {} 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:last_failure 0 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:last_failure_osd_epoch 0 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:max_mds 5 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:in 0,1,2,3,4 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:up {0=24466,1=24443,2=24442,3=24436,4=24422} 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:failed 2024-05-12T11:08:49.989 INFO:teuthology.orchestra.run.smithi086.stdout:damaged 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:stopped 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:data_pools [3] 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:metadata_pool 2 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:inline_data disabled 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:balancer 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:bal_rank_mask -1 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:standby_count_wanted 0 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:qdb_cluster leader: 24466 members: 24422,24436,24443,24442,24466 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.i{0:24466} state up:active seq 8 addr [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.e{0:24398} state up:standby-replay seq 1 addr [v2:172.21.15.172:6834/3404000495,v1:172.21.15.172:6835/3404000495] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b{1:24443} state up:active seq 9 addr [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.l{1:24394} state up:standby-replay seq 1 addr [v2:172.21.15.176:6832/868497491,v1:172.21.15.176:6833/868497491] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c{2:24442} state up:active seq 13 addr [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.990 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.k{2:24383} state up:standby-replay seq 1 addr [v2:172.21.15.172:6832/3992302401,v1:172.21.15.172:6833/3992302401] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.f{3:24436} state up:active seq 14 addr [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a{3:14595} state up:standby-replay seq 1 addr [v2:172.21.15.86:6840/637755871,v1:172.21.15.86:6841/637755871] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.h{4:24422} state up:active seq 13 addr [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.g{4:14583} state up:standby-replay seq 1 addr [v2:172.21.15.86:6838/2477289859,v1:172.21.15.86:6839/2477289859] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout:Standby daemons: 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.j{-1:14526} state up:standby seq 1 addr [v2:172.21.15.86:6834/2771013061,v1:172.21.15.86:6835/2771013061] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.991 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d{-1:14538} state up:standby seq 1 addr [v2:172.21.15.86:6836/1659604028,v1:172.21.15.86:6837/1659604028] compat {c=[1],r=[1],i=[1fff]}] 2024-05-12T11:08:49.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.996+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f99dc199fc0 con 0x7f99dc103600 2024-05-12T11:08:49.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.997+0000 7f99d9ffb700 1 -- 172.21.15.86:0/3545991639 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3093 (secure 0 0 0) 0x7f99dc199fc0 con 0x7f99dc103600 2024-05-12T11:08:49.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f99c80b2880 msgr2=0x7f99c80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:49.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f99c80b2880 0x7f99c80b4d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f99cc005950 tx=0x7f99cc005f50 comp rx=0 tx=0).stop 2024-05-12T11:08:49.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103600 msgr2=0x7f99dc19e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:49.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103600 0x7f99dc19e380 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99c400c920 tx=0x7f99c400cce0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 shutdown_connections 2024-05-12T11:08:49.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f99c80b2880 0x7f99c80b4d40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc103fa0 0x7f99dc1a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99dc102400 0x7f99dc06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 --2- 172.21.15.86:0/3545991639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99dc103600 0x7f99dc19e380 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:49.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 >> 172.21.15.86:0/3545991639 conn(0x7f99dc0fd9a0 msgr2=0x7f99dc1069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:49.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 shutdown_connections 2024-05-12T11:08:49.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:49.999+0000 7f99e2783700 1 -- 172.21.15.86:0/3545991639 wait complete. 2024-05-12T11:08:49.993 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 28 2024-05-12T11:08:50.361 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:50 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3545991639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-12T11:08:50.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:50 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3545991639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-12T11:08:50.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:50 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3545991639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-12T11:08:50.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-12T11:08:50.982 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:51.354 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:51 smithi086 ceph-mon[30110]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:51.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:51 smithi172 ceph-mon[34517]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:51.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:51 smithi176 ceph-mon[34357]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:08:52.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 -- 172.21.15.86:0/854685854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0120103f90 msgr2=0x7f012010a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:52.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 --2- 172.21.15.86:0/854685854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0120103f90 0x7f012010a840 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f011800b0d0 tx=0x7f011800b3e0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 -- 172.21.15.86:0/854685854 shutdown_connections 2024-05-12T11:08:52.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 --2- 172.21.15.86:0/854685854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0120103f90 0x7f012010a840 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 --2- 172.21.15.86:0/854685854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01201023f0 0x7f0120102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 --2- 172.21.15.86:0/854685854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01201035f0 0x7f0120103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 -- 172.21.15.86:0/854685854 >> 172.21.15.86:0/854685854 conn(0x7f01200fd990 msgr2=0x7f01200ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:52.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 -- 172.21.15.86:0/854685854 shutdown_connections 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.747+0000 7f01278a3700 1 -- 172.21.15.86:0/854685854 wait complete. 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f01278a3700 1 Processor -- start 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f01278a3700 1 -- start start 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f01278a3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01201023f0 0x7f01201063f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f01278a3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01201035f0 0x7f0120104a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f01278a3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0120103f90 0x7f0120104f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f01278a3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f012010de60 con 0x7f01201035f0 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f01278a3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f012010dce0 con 0x7f01201023f0 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f01278a3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f012010dfe0 con 0x7f0120103f90 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0124e3e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01201035f0 0x7f0120104a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0124e3e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01201035f0 0x7f0120104a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56426/0 (socket says 172.21.15.86:56426) 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0124e3e700 1 -- 172.21.15.86:0/567661409 learned_addr learned my addr 172.21.15.86:0/567661409 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f012563f700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01201023f0 0x7f01201063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:52.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0125e40700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0120103f90 0x7f0120104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0124e3e700 1 -- 172.21.15.86:0/567661409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0120103f90 msgr2=0x7f0120104f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0124e3e700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0120103f90 0x7f0120104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0124e3e700 1 -- 172.21.15.86:0/567661409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01201023f0 msgr2=0x7f01201063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0124e3e700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01201023f0 0x7f01201063f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.748+0000 7f0124e3e700 1 -- 172.21.15.86:0/567661409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0120105830 con 0x7f01201035f0 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.749+0000 7f0124e3e700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01201035f0 0x7f0120104a40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c9b0 tx=0x7f011c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.749+0000 7f01167fc700 1 -- 172.21.15.86:0/567661409 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c007b00 con 0x7f01201035f0 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.749+0000 7f01167fc700 1 -- 172.21.15.86:0/567661409 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f011c007ca0 con 0x7f01201035f0 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.749+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01201a3670 con 0x7f01201035f0 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.749+0000 7f01167fc700 1 -- 172.21.15.86:0/567661409 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c018660 con 0x7f01201035f0 2024-05-12T11:08:52.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.749+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01201a3b80 con 0x7f01201035f0 2024-05-12T11:08:52.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.750+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012006a190 con 0x7f01201035f0 2024-05-12T11:08:52.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.752+0000 7f01167fc700 1 -- 172.21.15.86:0/567661409 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f011c00f450 con 0x7f01201035f0 2024-05-12T11:08:52.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.753+0000 7f01167fc700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f010c0b2880 0x7f010c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:52.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.753+0000 7f012563f700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f010c0b2880 0x7f010c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:52.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.753+0000 7f01167fc700 1 -- 172.21.15.86:0/567661409 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f011c0e24d0 con 0x7f01201035f0 2024-05-12T11:08:52.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.753+0000 7f012563f700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f010c0b2880 0x7f010c0b4d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0120103450 tx=0x7f011000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:52.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.756+0000 7f01167fc700 1 -- 172.21.15.86:0/567661409 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f011c014030 con 0x7f01201035f0 2024-05-12T11:08:52.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.960+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f01201a4000 con 0x7f01201035f0 2024-05-12T11:08:52.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.961+0000 7f01167fc700 1 -- 172.21.15.86:0/567661409 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5335 (secure 0 0 0) 0x7f011c0aa260 con 0x7f01201035f0 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 82 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:fsid 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:created 2024-05-12T10:57:49.284318+0000 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:modified 2024-05-12T11:06:45.299850+0000 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:crush_version 26 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:full_ratio 0.95 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:backfillfull_ratio 0.9 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:nearfull_ratio 0.85 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:require_min_compat_client luminous 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:min_compat_client luminous 2024-05-12T11:08:52.952 INFO:teuthology.orchestra.run.smithi086.stdout:require_osd_release squid 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:stretch_mode_enabled false 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:max_osd 12 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6802/2476610607,v1:172.21.15.86:6803/2476610607] [v2:172.21.15.86:6804/2476610607,v1:172.21.15.86:6805/2476610607] exists,up 6d3771cb-dd57-494b-ba95-1cf9a0d5d840 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/3776376045,v1:172.21.15.172:6801/3776376045] [v2:172.21.15.172:6802/3776376045,v1:172.21.15.172:6803/3776376045] exists,up 34298bec-64f8-4ede-a3de-f974d74e2cc5 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6800/753242720,v1:172.21.15.176:6801/753242720] [v2:172.21.15.176:6802/753242720,v1:172.21.15.176:6803/753242720] exists,up de1f858a-97d7-471d-8b4b-cc315316c20b 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3 up in weight 1 up_from 26 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6810/743430147,v1:172.21.15.86:6811/743430147] [v2:172.21.15.86:6812/743430147,v1:172.21.15.86:6813/743430147] exists,up e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4 up in weight 1 up_from 32 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/3299166420,v1:172.21.15.172:6809/3299166420] [v2:172.21.15.172:6810/3299166420,v1:172.21.15.172:6811/3299166420] exists,up 5d396904-c535-4618-afc4-706ddd9c478b 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5 up in weight 1 up_from 38 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6808/3129482072,v1:172.21.15.176:6809/3129482072] [v2:172.21.15.176:6810/3129482072,v1:172.21.15.176:6811/3129482072] exists,up 41cdc75e-1b3c-4555-8135-71c5fc91a504 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6 up in weight 1 up_from 44 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6818/2940460720,v1:172.21.15.86:6819/2940460720] [v2:172.21.15.86:6820/2940460720,v1:172.21.15.86:6821/2940460720] exists,up 7389cd75-eea2-4ce4-adeb-b8e8db25b3b4 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7 up in weight 1 up_from 49 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/183030662,v1:172.21.15.172:6817/183030662] [v2:172.21.15.172:6818/183030662,v1:172.21.15.172:6819/183030662] exists,up b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8 up in weight 1 up_from 55 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6816/1304311054,v1:172.21.15.176:6817/1304311054] [v2:172.21.15.176:6818/1304311054,v1:172.21.15.176:6819/1304311054] exists,up 45bf3d95-2150-45a9-8b6f-ea01eb14ba83 2024-05-12T11:08:52.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9 up in weight 1 up_from 61 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6826/3922597037,v1:172.21.15.86:6827/3922597037] [v2:172.21.15.86:6828/3922597037,v1:172.21.15.86:6829/3922597037] exists,up aaaf5d21-ebd3-4757-b50c-531bf69652aa 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10 up in weight 1 up_from 66 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/2676876464,v1:172.21.15.172:6825/2676876464] [v2:172.21.15.172:6826/2676876464,v1:172.21.15.172:6827/2676876464] exists,up b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11 up in weight 1 up_from 72 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6824/2310445273,v1:172.21.15.176:6825/2310445273] [v2:172.21.15.176:6826/2310445273,v1:172.21.15.176:6827/2310445273] exists,up daa12269-209c-4940-adcf-129c9470f578 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 2.a [2,11] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 2.e [2,1] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 2.10 [2,4] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 2.1c [8,11] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.6 [4,7] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.14 [4,6] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.18 [3,9] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.21 [5,9] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.31 [4,8] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.37 [1,9] 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:6801/3515811906 expires 2024-05-13T10:58:43.982021+0000 2024-05-12T11:08:52.954 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/4157495437 expires 2024-05-13T10:58:43.982021+0000 2024-05-12T11:08:52.955 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/636932738 expires 2024-05-13T10:58:43.982021+0000 2024-05-12T11:08:52.955 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/3025922080 expires 2024-05-13T10:58:16.834530+0000 2024-05-12T11:08:52.955 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:6800/1257416774 expires 2024-05-13T10:58:16.834530+0000 2024-05-12T11:08:52.955 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/3479534219 expires 2024-05-13T10:58:43.982021+0000 2024-05-12T11:08:52.955 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/1055215670 expires 2024-05-13T10:58:16.834530+0000 2024-05-12T11:08:52.955 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:6801/1257416774 expires 2024-05-13T10:58:16.834530+0000 2024-05-12T11:08:52.955 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/995517811 expires 2024-05-13T10:58:16.834530+0000 2024-05-12T11:08:52.955 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:6800/3515811906 expires 2024-05-13T10:58:43.982021+0000 2024-05-12T11:08:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f010c0b2880 msgr2=0x7f010c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f010c0b2880 0x7f010c0b4d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0120103450 tx=0x7f011000a380 comp rx=0 tx=0).stop 2024-05-12T11:08:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01201035f0 msgr2=0x7f0120104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01201035f0 0x7f0120104a40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c9b0 tx=0x7f011c00ccc0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 shutdown_connections 2024-05-12T11:08:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f010c0b2880 0x7f010c0b4d40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0120103f90 0x7f0120104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01201023f0 0x7f01201063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 --2- 172.21.15.86:0/567661409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01201035f0 0x7f0120104a40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:52.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 >> 172.21.15.86:0/567661409 conn(0x7f01200fd990 msgr2=0x7f012006ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:52.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 shutdown_connections 2024-05-12T11:08:52.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:52.963+0000 7f01278a3700 1 -- 172.21.15.86:0/567661409 wait complete. 2024-05-12T11:08:53.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:53 smithi086 ceph-mon[30110]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:53.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:53 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/567661409' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-12T11:08:53.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:53 smithi172 ceph-mon[34517]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:53.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:53 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/567661409' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-12T11:08:53.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:53 smithi176 ceph-mon[34357]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:53.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:53 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/567661409' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-12T11:08:53.709 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-12T11:08:53.722 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:08:53.966 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:55 smithi172 ceph-mon[34517]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:55.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:55 smithi176 ceph-mon[34357]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:55.534 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:55 smithi086 ceph-mon[30110]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:55.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.545+0000 7fcf26285700 1 -- 172.21.15.86:0/3321836730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 msgr2=0x7fcf2010fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:55.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.545+0000 7fcf26285700 1 --2- 172.21.15.86:0/3321836730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 0x7fcf2010fa40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009990 tx=0x7fcf08009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 -- 172.21.15.86:0/3321836730 shutdown_connections 2024-05-12T11:08:55.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 --2- 172.21.15.86:0/3321836730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2010ff80 0x7fcf20112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 --2- 172.21.15.86:0/3321836730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2006bbd0 0x7fcf2006bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 --2- 172.21.15.86:0/3321836730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 0x7fcf2010fa40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 -- 172.21.15.86:0/3321836730 >> 172.21.15.86:0/3321836730 conn(0x7fcf20079350 msgr2=0x7fcf20079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 -- 172.21.15.86:0/3321836730 shutdown_connections 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 -- 172.21.15.86:0/3321836730 wait complete. 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 Processor -- start 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 -- start start 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2006bbd0 0x7fcf2019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 0x7fcf2019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2010ff80 0x7fcf201a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcf20115920 con 0x7fcf2006c4f0 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf201157a0 con 0x7fcf2010ff80 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.546+0000 7fcf26285700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf20115aa0 con 0x7fcf2006bbd0 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 0x7fcf2019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 0x7fcf2019c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56446/0 (socket says 172.21.15.86:56446) 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 -- 172.21.15.86:0/251929183 learned_addr learned my addr 172.21.15.86:0/251929183 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf24822700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2010ff80 0x7fcf201a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf1ffff700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2006bbd0 0x7fcf2019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 -- 172.21.15.86:0/251929183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2006bbd0 msgr2=0x7fcf2019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2006bbd0 0x7fcf2019be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 -- 172.21.15.86:0/251929183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2010ff80 msgr2=0x7fcf201a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2010ff80 0x7fcf201a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 -- 172.21.15.86:0/251929183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf201a0e80 con 0x7fcf2006c4f0 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf24822700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2010ff80 0x7fcf201a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf17fff700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 0x7fcf2019c3b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcf08005910 tx=0x7fcf08009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf1dffb700 1 -- 172.21.15.86:0/251929183 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08027070 con 0x7fcf2006c4f0 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf1dffb700 1 -- 172.21.15.86:0/251929183 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf08003f20 con 0x7fcf2006c4f0 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf201a1110 con 0x7fcf2006c4f0 2024-05-12T11:08:55.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf1dffb700 1 -- 172.21.15.86:0/251929183 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08022c50 con 0x7fcf2006c4f0 2024-05-12T11:08:55.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.547+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf201a89f0 con 0x7fcf2006c4f0 2024-05-12T11:08:55.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.548+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2006a190 con 0x7fcf2006c4f0 2024-05-12T11:08:55.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.549+0000 7fcf1dffb700 1 -- 172.21.15.86:0/251929183 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcf0802a070 con 0x7fcf2006c4f0 2024-05-12T11:08:55.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.550+0000 7fcf1dffb700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcf0c0b2880 0x7fcf0c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:55.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.550+0000 7fcf1ffff700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcf0c0b2880 0x7fcf0c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:55.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.550+0000 7fcf1dffb700 1 -- 172.21.15.86:0/251929183 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fcf080e31f0 con 0x7fcf2006c4f0 2024-05-12T11:08:55.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.551+0000 7fcf1ffff700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcf0c0b2880 0x7fcf0c0b4d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf10005950 tx=0x7fcf100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:55.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.555+0000 7fcf1dffb700 1 -- 172.21.15.86:0/251929183 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcf0805fdf0 con 0x7fcf2006c4f0 2024-05-12T11:08:55.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.800+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf2002e510 con 0x7fcf2006c4f0 2024-05-12T11:08:55.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.801+0000 7fcf1dffb700 1 -- 172.21.15.86:0/251929183 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11935 (secure 0 0 0) 0x7fcf08013070 con 0x7fcf2006c4f0 2024-05-12T11:08:55.792 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:55.792 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:06:25.320260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24422,24436,24443,24442,24466]},"id":1}]} 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcf0c0b2880 msgr2=0x7fcf0c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcf0c0b2880 0x7fcf0c0b4d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf10005950 tx=0x7fcf100058e0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 msgr2=0x7fcf2019c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 0x7fcf2019c3b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcf08005910 tx=0x7fcf08009f90 comp rx=0 tx=0).stop 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 shutdown_connections 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fcf0c0b2880 0x7fcf0c0b4d40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2010ff80 0x7fcf201a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2006bbd0 0x7fcf2019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 --2- 172.21.15.86:0/251929183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf2006c4f0 0x7fcf2019c3b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:55.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 >> 172.21.15.86:0/251929183 conn(0x7fcf20079350 msgr2=0x7fcf201114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:55.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 shutdown_connections 2024-05-12T11:08:55.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:55.804+0000 7fcf26285700 1 -- 172.21.15.86:0/251929183 wait complete. 2024-05-12T11:08:55.796 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 28 2024-05-12T11:08:56.449 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:56 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/251929183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:56.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:56 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/251929183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:56.478 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:08:56.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:56 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/251929183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:56.721 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:57.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:57 smithi086 ceph-mon[30110]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:57.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:57 smithi172 ceph-mon[34517]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:57.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:57 smithi176 ceph-mon[34357]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:08:58.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 -- 172.21.15.86:0/2611006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 msgr2=0x7f64741087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:58.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 --2- 172.21.15.86:0/2611006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 0x7f64741087f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6464009990 tx=0x7f6464009ca0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 -- 172.21.15.86:0/2611006 shutdown_connections 2024-05-12T11:08:58.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 --2- 172.21.15.86:0/2611006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6474102d60 0x7f647410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 --2- 172.21.15.86:0/2611006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 0x7f64741087f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 --2- 172.21.15.86:0/2611006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64741023a0 0x7f6474102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 -- 172.21.15.86:0/2611006 >> 172.21.15.86:0/2611006 conn(0x7f6474079350 msgr2=0x7f6474079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:58.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 -- 172.21.15.86:0/2611006 shutdown_connections 2024-05-12T11:08:58.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.382+0000 7f647a811700 1 -- 172.21.15.86:0/2611006 wait complete. 2024-05-12T11:08:58.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f647a811700 1 Processor -- start 2024-05-12T11:08:58.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f647a811700 1 -- start start 2024-05-12T11:08:58.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f647a811700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64741023a0 0x7f647419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:58.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f647a811700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6474102d60 0x7f647419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f647a811700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 0x7f64741a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f647a811700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6474112530 con 0x7f6474108410 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f647a811700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64741123b0 con 0x7f64741023a0 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f647a811700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f64741126b0 con 0x7f6474102d60 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6478dae700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 0x7f64741a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6478dae700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 0x7f64741a59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56468/0 (socket says 172.21.15.86:56468) 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6478dae700 1 -- 172.21.15.86:0/444559143 learned_addr learned my addr 172.21.15.86:0/444559143 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6473fff700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64741023a0 0x7f647419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f64737fe700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6474102d60 0x7f647419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:58.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6478dae700 1 -- 172.21.15.86:0/444559143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6474102d60 msgr2=0x7f647419ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6478dae700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6474102d60 0x7f647419ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6478dae700 1 -- 172.21.15.86:0/444559143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64741023a0 msgr2=0x7f647419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6478dae700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64741023a0 0x7f647419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.383+0000 7f6478dae700 1 -- 172.21.15.86:0/444559143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64741a5f10 con 0x7f6474108410 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.384+0000 7f6473fff700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64741023a0 0x7f647419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.384+0000 7f64737fe700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6474102d60 0x7f647419ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.384+0000 7f6478dae700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 0x7f64741a59d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f646c007ee0 tx=0x7f646c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.384+0000 7f64717fa700 1 -- 172.21.15.86:0/444559143 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c00dbd0 con 0x7f6474108410 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.384+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64741a6140 con 0x7f6474108410 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.384+0000 7f64717fa700 1 -- 172.21.15.86:0/444559143 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f646c00dd70 con 0x7f6474108410 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.384+0000 7f64717fa700 1 -- 172.21.15.86:0/444559143 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c005990 con 0x7f6474108410 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.384+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64741a6600 con 0x7f6474108410 2024-05-12T11:08:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.385+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647406a190 con 0x7f6474108410 2024-05-12T11:08:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.386+0000 7f64717fa700 1 -- 172.21.15.86:0/444559143 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f646c01a020 con 0x7f6474108410 2024-05-12T11:08:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.387+0000 7f64717fa700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f645c0b2880 0x7f645c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:08:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.388+0000 7f6473fff700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f645c0b2880 0x7f645c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:08:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.388+0000 7f64717fa700 1 -- 172.21.15.86:0/444559143 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f646c0e20e0 con 0x7f6474108410 2024-05-12T11:08:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.388+0000 7f6473fff700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f645c0b2880 0x7f645c0b4d40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6464000c00 tx=0x7f6464005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:08:58.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.391+0000 7f64717fa700 1 -- 172.21.15.86:0/444559143 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f646c010070 con 0x7f6474108410 2024-05-12T11:08:58.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.642+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f647402e510 con 0x7f6474108410 2024-05-12T11:08:58.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.643+0000 7f64717fa700 1 -- 172.21.15.86:0/444559143 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11935 (secure 0 0 0) 0x7f646c0a9de0 con 0x7f6474108410 2024-05-12T11:08:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:08:58.634 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:06:25.320260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24422,24436,24443,24442,24466]},"id":1}]} 2024-05-12T11:08:58.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f645c0b2880 msgr2=0x7f645c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:58.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f645c0b2880 0x7f645c0b4d40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6464000c00 tx=0x7f6464005fb0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 msgr2=0x7f64741a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 0x7f64741a59d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f646c007ee0 tx=0x7f646c00d3b0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 shutdown_connections 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f645c0b2880 0x7f645c0b4d40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6474108410 0x7f64741a59d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64741023a0 0x7f647419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 --2- 172.21.15.86:0/444559143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6474102d60 0x7f647419ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 >> 172.21.15.86:0/444559143 conn(0x7f6474079350 msgr2=0x7f6474101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 shutdown_connections 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:08:58.645+0000 7f647a811700 1 -- 172.21.15.86:0/444559143 wait complete. 2024-05-12T11:08:58.637 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 28 2024-05-12T11:08:59.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:08:59.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:59 smithi176 ceph-mon[34357]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:59.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:08:59 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/444559143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:59.645 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:08:59.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:59 smithi086 ceph-mon[30110]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:59.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:08:59 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/444559143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:08:59.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:59 smithi172 ceph-mon[34517]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:08:59.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:08:59 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/444559143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:01.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 -- 172.21.15.86:0/1091411758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210108850 msgr2=0x7f42101103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:01.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 --2- 172.21.15.86:0/1091411758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210108850 0x7f42101103d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f420800b0d0 tx=0x7f420800b3e0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 -- 172.21.15.86:0/1091411758 shutdown_connections 2024-05-12T11:09:01.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 --2- 172.21.15.86:0/1091411758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210108850 0x7f42101103d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 --2- 172.21.15.86:0/1091411758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4210103750 0x7f4210103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 --2- 172.21.15.86:0/1091411758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210104100 0x7f4210108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 -- 172.21.15.86:0/1091411758 >> 172.21.15.86:0/1091411758 conn(0x7f421007a600 msgr2=0x7f421007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 -- 172.21.15.86:0/1091411758 shutdown_connections 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 -- 172.21.15.86:0/1091411758 wait complete. 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 Processor -- start 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.417+0000 7f4216cf7700 1 -- start start 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4216cf7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4210103750 0x7f421019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4216cf7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210104100 0x7f421019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4216cf7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210108850 0x7f4210199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:01.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4216cf7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42101136a0 con 0x7f4210104100 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4216cf7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4210113520 con 0x7f4210108850 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4216cf7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4210113820 con 0x7f4210103750 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210104100 0x7f421019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210104100 0x7f421019fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56494/0 (socket says 172.21.15.86:56494) 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 -- 172.21.15.86:0/538137357 learned_addr learned my addr 172.21.15.86:0/538137357 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4215294700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210108850 0x7f4210199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4214a93700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4210103750 0x7f421019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 -- 172.21.15.86:0/538137357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4210103750 msgr2=0x7f421019f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4210103750 0x7f421019f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 -- 172.21.15.86:0/538137357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210108850 msgr2=0x7f4210199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:01.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210108850 0x7f4210199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 -- 172.21.15.86:0/538137357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421019a0c0 con 0x7f4210104100 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4214a93700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4210103750 0x7f421019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420ffff700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210104100 0x7f421019fc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c920 tx=0x7f41fc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420dffb700 1 -- 172.21.15.86:0/538137357 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc007b00 con 0x7f4210104100 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421019a3b0 con 0x7f4210104100 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420dffb700 1 -- 172.21.15.86:0/538137357 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41fc004ce0 con 0x7f4210104100 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.418+0000 7f420dffb700 1 -- 172.21.15.86:0/538137357 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc005500 con 0x7f4210104100 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.419+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42101a6620 con 0x7f4210104100 2024-05-12T11:09:01.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.419+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421006a190 con 0x7f4210104100 2024-05-12T11:09:01.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.421+0000 7f420dffb700 1 -- 172.21.15.86:0/538137357 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f41fc007ca0 con 0x7f4210104100 2024-05-12T11:09:01.414 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:01 smithi086 ceph-mon[30110]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:09:01.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.422+0000 7f420dffb700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42000b2880 0x7f42000b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:01.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.422+0000 7f4214a93700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42000b2880 0x7f42000b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:01.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.422+0000 7f420dffb700 1 -- 172.21.15.86:0/538137357 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f41fc0e1dd0 con 0x7f4210104100 2024-05-12T11:09:01.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.422+0000 7f4214a93700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42000b2880 0x7f42000b4d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4210108350 tx=0x7f4204008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:01.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.426+0000 7f420dffb700 1 -- 172.21.15.86:0/538137357 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f41fc014030 con 0x7f4210104100 2024-05-12T11:09:01.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:01 smithi176 ceph-mon[34357]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:09:01.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.632+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f421002e510 con 0x7f4210104100 2024-05-12T11:09:01.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.633+0000 7f420dffb700 1 -- 172.21.15.86:0/538137357 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22746 (secure 0 0 0) 0x7f41fc0a9ad0 con 0x7f4210104100 2024-05-12T11:09:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:09:01.625 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:06:45.299850+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:09:01.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.635+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42000b2880 msgr2=0x7f42000b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:01.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.635+0000 7f4216cf7700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42000b2880 0x7f42000b4d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4210108350 tx=0x7f4204008040 comp rx=0 tx=0).stop 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.635+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210104100 msgr2=0x7f421019fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.635+0000 7f4216cf7700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210104100 0x7f421019fc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c920 tx=0x7f41fc00cc30 comp rx=0 tx=0).stop 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.636+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 shutdown_connections 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.636+0000 7f4216cf7700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f42000b2880 0x7f42000b4d40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.636+0000 7f4216cf7700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210108850 0x7f4210199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.636+0000 7f4216cf7700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4210103750 0x7f421019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.636+0000 7f4216cf7700 1 --2- 172.21.15.86:0/538137357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4210104100 0x7f421019fc90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.636+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 >> 172.21.15.86:0/538137357 conn(0x7f421007a600 msgr2=0x7f4210101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.636+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 shutdown_connections 2024-05-12T11:09:01.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:01.636+0000 7f4216cf7700 1 -- 172.21.15.86:0/538137357 wait complete. 2024-05-12T11:09:01.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:01 smithi172 ceph-mon[34517]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:09:02.402 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:02 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/538137357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:09:02.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-12T11:06:07.078153+0000', 'modified': '2024-05-12T11:06:25.320260+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24466, 'mds_1': 24443, 'mds_2': 24442, 'mds_3': 24436, 'mds_4': 24422}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6839/2477289859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6838', 'nonce': 2477289859}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 2477289859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6841/637755871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6840', 'nonce': 637755871}, {'type': 'v1', 'addr': '172.21.15.86:6841', 'nonce': 637755871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24383': {'gid': 24383, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/3992302401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3992302401}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 3992302401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.176:6833/868497491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 868497491}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 868497491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24398': {'gid': 24398, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/3404000495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3404000495}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3404000495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.172:6837/2564045723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2564045723}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2564045723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.176:6835/197047059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 197047059}, {'type': 'v1', 'addr': '172.21.15.176:6835', 'nonce': 197047059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.176:6837/2905239515', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 2905239515}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 2905239515}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.172:6839/2644756211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 2644756211}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 2644756211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.176:6839/410261641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6838', 'nonce': 410261641}, {'type': 'v1', 'addr': '172.21.15.176:6839', 'nonce': 410261641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24466, 'qdb_cluster': [24422, 24436, 24443, 24442, 24466]} 2024-05-12T11:09:02.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-12T11:09:02.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-12T11:09:02.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:02 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/538137357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:09:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:02.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:02 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/538137357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:09:03.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:03 smithi086 ceph-mon[30110]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:03.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:03 smithi176 ceph-mon[34357]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:03.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:03 smithi172 ceph-mon[34517]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:04.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 -- 172.21.15.86:0/3891505319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f101023d0 msgr2=0x7f8f10102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 --2- 172.21.15.86:0/3891505319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f101023d0 0x7f8f10102850 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009990 tx=0x7f8ef8009ca0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 -- 172.21.15.86:0/3891505319 shutdown_connections 2024-05-12T11:09:04.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 --2- 172.21.15.86:0/3891505319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f10102d90 0x7f8f1010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 --2- 172.21.15.86:0/3891505319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f10108450 0x7f8f10108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 --2- 172.21.15.86:0/3891505319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f101023d0 0x7f8f10102850 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 -- 172.21.15.86:0/3891505319 >> 172.21.15.86:0/3891505319 conn(0x7f8f10078410 msgr2=0x7f8f10078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:04.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 -- 172.21.15.86:0/3891505319 shutdown_connections 2024-05-12T11:09:04.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.392+0000 7f8f162a1700 1 -- 172.21.15.86:0/3891505319 wait complete. 2024-05-12T11:09:04.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f162a1700 1 Processor -- start 2024-05-12T11:09:04.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f162a1700 1 -- start start 2024-05-12T11:09:04.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f162a1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f101023d0 0x7f8f1019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f162a1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f10102d90 0x7f8f1019af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f162a1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f10108450 0x7f8f101a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f162a1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10112520 con 0x7f8f10108450 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f162a1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101123a0 con 0x7f8f10102d90 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f162a1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101126a0 con 0x7f8f101023d0 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f1483e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f10108450 0x7f8f101a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f1483e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f10108450 0x7f8f101a5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47330/0 (socket says 172.21.15.86:47330) 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f1483e700 1 -- 172.21.15.86:0/1932035411 learned_addr learned my addr 172.21.15.86:0/1932035411 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.393+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f10102d90 0x7f8f1019af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f1483e700 1 -- 172.21.15.86:0/1932035411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f101023d0 msgr2=0x7f8f1019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f101023d0 0x7f8f1019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f1483e700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f101023d0 0x7f8f1019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f1483e700 1 -- 172.21.15.86:0/1932035411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f10102d90 msgr2=0x7f8f1019af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f1483e700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f10102d90 0x7f8f1019af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f1483e700 1 -- 172.21.15.86:0/1932035411 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f101a5fc0 con 0x7f8f10108450 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f10102d90 0x7f8f1019af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f1483e700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f10108450 0x7f8f101a5a80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8f08007ee0 tx=0x7f8f0800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f0d7fa700 1 -- 172.21.15.86:0/1932035411 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800dbd0 con 0x7f8f10108450 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f0d7fa700 1 -- 172.21.15.86:0/1932035411 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f0800dd70 con 0x7f8f10108450 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f162a1700 1 -- 172.21.15.86:0/1932035411 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f101a6190 con 0x7f8f10108450 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f0d7fa700 1 -- 172.21.15.86:0/1932035411 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08005990 con 0x7f8f10108450 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.394+0000 7f8f162a1700 1 -- 172.21.15.86:0/1932035411 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f101a66a0 con 0x7f8f10108450 2024-05-12T11:09:04.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.397+0000 7f8f0d7fa700 1 -- 172.21.15.86:0/1932035411 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8f0801a020 con 0x7f8f10108450 2024-05-12T11:09:04.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f0d7fa700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8efc0b2880 0x7f8efc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8efc0b2880 0x7f8efc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f0d7fa700 1 -- 172.21.15.86:0/1932035411 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8f080e1a80 con 0x7f8f10108450 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f20b34b80 1 Processor -- start 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f20b34b80 1 -- start start 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8efc0b2880 0x7f8efc0b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f00005950 tx=0x7f8f00005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c60d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 0x55866c607bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c6085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55866c5558f0 con 0x55866c608160 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55866c4bad50 con 0x55866c60d540 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.398+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55866c5518b0 con 0x55866c60de60 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c6085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c6085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47346/0 (socket says 172.21.15.86:47346) 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 -- 172.21.15.86:0/2248089821 learned_addr learned my addr 172.21.15.86:0/2248089821 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c60d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 0x55866c607bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 -- 172.21.15.86:0/2248089821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 msgr2=0x55866c607bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 0x55866c607bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 -- 172.21.15.86:0/2248089821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 msgr2=0x55866c60d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c60d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 -- 172.21.15.86:0/2248089821 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55866c4a2880 con 0x55866c608160 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 0x55866c607bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c60d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:04.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f1483e700 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c6085c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8f080a9010 tx=0x7f8f080a87f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8625d20fa16efc20 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f067fc700 1 -- 172.21.15.86:0/2248089821 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f080a9080 con 0x55866c608160 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f067fc700 1 -- 172.21.15.86:0/2248089821 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f080ad430 con 0x55866c608160 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.399+0000 7f8f067fc700 1 -- 172.21.15.86:0/2248089821 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f080a9540 con 0x55866c608160 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 -- 172.21.15.86:0/2248089821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 msgr2=0x55866c6085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c6085c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8f080a9010 tx=0x7f8f080a87f0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 -- 172.21.15.86:0/2248089821 shutdown_connections 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c6085c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c60d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/2248089821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 0x55866c607bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 -- 172.21.15.86:0/2248089821 >> 172.21.15.86:0/2248089821 conn(0x55866c52fb20 msgr2=0x55866c5fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 -- 172.21.15.86:0/2248089821 shutdown_connections 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 -- 172.21.15.86:0/2248089821 wait complete. 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.400+0000 7f8f20b34b80 1 -- start start 2024-05-12T11:09:04.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 1 Processor -- start 2024-05-12T11:09:04.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c608160 0x55866c613b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60d540 0x55866c610ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 0x55866c611430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55866c614890 con 0x55866c60d540 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55866c50ee80 con 0x55866c608160 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55866c614a10 con 0x55866c60de60 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 10 client.0 _ll_register_callbacks cb 0x55866c4e9560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60d540 0x55866c610ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60d540 0x55866c610ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47356/0 (socket says 172.21.15.86:47356) 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 -- 172.21.15.86:0/495730116 learned_addr learned my addr 172.21.15.86:0/495730116 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c608160 0x55866c613b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 -- 172.21.15.86:0/495730116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 msgr2=0x55866c611430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 0x55866c611430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 -- 172.21.15.86:0/495730116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c608160 msgr2=0x55866c613b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c608160 0x55866c613b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 -- 172.21.15.86:0/495730116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55866c50c710 con 0x55866c60d540 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60d540 0x55866c610ef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000c00 tx=0x7f8ef8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafca638d61a0478 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8eef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8eef7fe700 1 -- 172.21.15.86:0/495730116 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80052c0 con 0x55866c60d540 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8eef7fe700 1 -- 172.21.15.86:0/495730116 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8ef8005460 con 0x55866c60d540 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.401+0000 7f8f20b34b80 1 -- 172.21.15.86:0/495730116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f080ad430 con 0x55866c60d540 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8eef7fe700 1 -- 172.21.15.86:0/495730116 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ef80095d0 con 0x55866c60d540 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8f20b34b80 10 client.15105 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8f20b34b80 1 -- 172.21.15.86:0/495730116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55866c61f0e0 con 0x55866c60d540 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8eef7fe700 1 -- 172.21.15.86:0/495730116 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f080ad430 con 0x55866c60d540 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8eef7fe700 1 -- 172.21.15.86:0/495730116 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f8ef800f8d0 con 0x55866c60d540 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8f20b34b80 10 client.15105 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8f20b34b80 10 client.15105 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-12T11:09:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8f20b34b80 20 client.15105 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55866c621790 0x55866c622c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8f20b34b80 4 client.15105 mds_command: new command op to 24422 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.402+0000 7f8f20b34b80 1 -- 172.21.15.86:0/495730116 --> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55866c5632d0 con 0x55866c621790 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.403+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55866c621790 0x55866c622c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.403+0000 7f8eef7fe700 10 client.15105 ms_handle_connect on v2:172.21.15.172:6836/2564045723 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.403+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55866c621790 0x55866c622c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d4774bdff652f92d server_cookie=6cef26aaddec666a in_seq=0 out_seq=0 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8eef7fe700 1 -- 172.21.15.86:0/495730116 <== mds.4 v2:172.21.15.172:6836/2564045723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55866c5632d0 con 0x55866c621790 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8eef7fe700 10 client.15105 handle_command_reply: tid=0 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 client.15105 shutdown 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 -- 172.21.15.86:0/495730116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60d540 msgr2=0x55866c610ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60d540 0x55866c610ef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000c00 tx=0x7f8ef8009f90 comp rx=0 tx=0).stop 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 -- 172.21.15.86:0/495730116 shutdown_connections 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60de60 0x55866c611430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c608160 0x55866c613b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55866c621790 0x55866c622c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/495730116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60d540 0x55866c610ef0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 -- 172.21.15.86:0/495730116 >> 172.21.15.86:0/495730116 conn(0x55866c52fb20 msgr2=0x55866c5f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8eef7fe700 0 client.15105 ms_handle_reset on v2:172.21.15.172:6836/2564045723 2024-05-12T11:09:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 -- 172.21.15.86:0/495730116 shutdown_connections 2024-05-12T11:09:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 1 -- 172.21.15.86:0/495730116 wait complete. 2024-05-12T11:09:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.404+0000 7f8f20b34b80 20 client.15105 trim_cache size 0 max 16384 2024-05-12T11:09:04.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f20b34b80 1 Processor -- start 2024-05-12T11:09:04.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f20b34b80 1 -- start start 2024-05-12T11:09:04.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c608160 0x55866c611460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c5f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60de60 0x55866c60e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55866c620f40 con 0x55866c60de60 2024-05-12T11:09:04.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55866c621610 con 0x55866c60d540 2024-05-12T11:09:04.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55866c621ce0 con 0x55866c608160 2024-05-12T11:09:04.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60de60 0x55866c60e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60de60 0x55866c60e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47372/0 (socket says 172.21.15.86:47372) 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 -- 172.21.15.86:0/3148013415 learned_addr learned my addr 172.21.15.86:0/3148013415 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c608160 0x55866c611460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c5f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 -- 172.21.15.86:0/3148013415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c608160 msgr2=0x55866c611460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c608160 0x55866c611460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 -- 172.21.15.86:0/3148013415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 msgr2=0x55866c5f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c5f8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 -- 172.21.15.86:0/3148013415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55866c5fac30 con 0x55866c60de60 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c608160 0x55866c611460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.425+0000 7f8f1483e700 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60de60 0x55866c60e2e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8f080a5100 tx=0x7f8f08004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73789f621aa305b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:04.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f05ffb700 1 -- 172.21.15.86:0/3148013415 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f080a9080 con 0x55866c60de60 2024-05-12T11:09:04.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f05ffb700 1 -- 172.21.15.86:0/3148013415 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f080b1ee0 con 0x55866c60de60 2024-05-12T11:09:04.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f05ffb700 1 -- 172.21.15.86:0/3148013415 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f080b1a50 con 0x55866c60de60 2024-05-12T11:09:04.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f20b34b80 1 -- 172.21.15.86:0/3148013415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60de60 msgr2=0x55866c60e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60de60 0x55866c60e2e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8f080a5100 tx=0x7f8f08004e80 comp rx=0 tx=0).stop 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f20b34b80 1 -- 172.21.15.86:0/3148013415 shutdown_connections 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c60de60 0x55866c60e2e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c608160 0x55866c611460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/3148013415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60d540 0x55866c5f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f20b34b80 1 -- 172.21.15.86:0/3148013415 >> 172.21.15.86:0/3148013415 conn(0x55866c52fb20 msgr2=0x55866c60f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.426+0000 7f8f20b34b80 1 -- 172.21.15.86:0/3148013415 shutdown_connections 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 -- 172.21.15.86:0/3148013415 wait complete. 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 -- start start 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 Processor -- start 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c5f8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60d540 0x55866c5f8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60de60 0x55866c5f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55866c622a80 con 0x55866c608160 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55866c6223b0 con 0x55866c60de60 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55866c623150 con 0x55866c60d540 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f20b34b80 10 client.0 _ll_register_callbacks cb 0x55866c4e9560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f0ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c5f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f0ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c5f8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47376/0 (socket says 172.21.15.86:47376) 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.427+0000 7f8f0ffff700 1 -- 172.21.15.86:0/113369407 learned_addr learned my addr 172.21.15.86:0/113369407 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60d540 0x55866c5f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f1483e700 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60de60 0x55866c5f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f0ffff700 1 -- 172.21.15.86:0/113369407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60d540 msgr2=0x55866c5f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:04.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60d540 0x55866c5f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f0ffff700 1 -- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60de60 msgr2=0x55866c5f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60de60 0x55866c5f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f0ffff700 1 -- 172.21.15.86:0/113369407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55866c623b60 con 0x55866c608160 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f1483e700 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60de60 0x55866c5f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f0ffff700 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c5f8000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000dea0 tx=0x7f8f000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621daf358d3eb2da server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8eef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8eef7fe700 1 -- 172.21.15.86:0/113369407 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0001de60 con 0x55866c608160 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8eef7fe700 1 -- 172.21.15.86:0/113369407 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8f00026500 con 0x55866c608160 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f20b34b80 1 -- 172.21.15.86:0/113369407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f080b1ee0 con 0x55866c608160 2024-05-12T11:09:04.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8eef7fe700 1 -- 172.21.15.86:0/113369407 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f00026700 con 0x55866c608160 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f20b34b80 10 client.15111 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8f20b34b80 1 -- 172.21.15.86:0/113369407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55866c68cd50 con 0x55866c608160 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.428+0000 7f8eef7fe700 1 -- 172.21.15.86:0/113369407 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f080b1ee0 con 0x55866c608160 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8eef7fe700 1 -- 172.21.15.86:0/113369407 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f8f00039ae0 con 0x55866c608160 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8f20b34b80 10 client.15111 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8f20b34b80 10 client.15111 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8f20b34b80 20 client.15111 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55866c691930 0x55866c690640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8f20b34b80 4 client.15111 mds_command: new command op to 24422 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8f20b34b80 1 -- 172.21.15.86:0/113369407 --> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] -- command(tid 0: {"prefix": "status"}) -- 0x55866c55d370 con 0x55866c691930 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55866c691930 0x55866c690640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8f0f7fe700 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55866c691930 0x55866c690640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9a066bcd4f07bb70 server_cookie=fd5686d982081d5e in_seq=0 out_seq=0 2024-05-12T11:09:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.429+0000 7f8eef7fe700 10 client.15111 ms_handle_connect on v2:172.21.15.172:6836/2564045723 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8eef7fe700 1 -- 172.21.15.86:0/113369407 <== mds.4 v2:172.21.15.172:6836/2564045723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55866c55d370 con 0x55866c691930 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8eef7fe700 10 client.15111 handle_command_reply: tid=0 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 client.15111 shutdown 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 -- 172.21.15.86:0/113369407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 msgr2=0x55866c5f8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c5f8000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000dea0 tx=0x7f8f000047c0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 -- 172.21.15.86:0/113369407 shutdown_connections 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55866c60de60 0x55866c5f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x55866c691930 0x55866c690640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8eef7fe700 0 client.15111 ms_handle_reset on v2:172.21.15.172:6836/2564045723 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55866c608160 0x55866c5f8000 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 --2- 172.21.15.86:0/113369407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55866c60d540 0x55866c5f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 -- 172.21.15.86:0/113369407 >> 172.21.15.86:0/113369407 conn(0x55866c52fb20 msgr2=0x55866c60e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 -- 172.21.15.86:0/113369407 shutdown_connections 2024-05-12T11:09:04.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 1 -- 172.21.15.86:0/113369407 wait complete. 2024-05-12T11:09:04.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.430+0000 7f8f20b34b80 20 client.15111 trim_cache size 0 max 16384 2024-05-12T11:09:04.430 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 4, 2024-05-12T11:09:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24422, 2024-05-12T11:09:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 162.19051005700001, 2024-05-12T11:09:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:09:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:09:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:09:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 207.671368919 2024-05-12T11:09:04.431 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:04.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 -- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8efc0b2880 msgr2=0x7f8efc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8efc0b2880 0x7f8efc0b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f00005950 tx=0x7f8f00005c70 comp rx=0 tx=0).stop 2024-05-12T11:09:04.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 -- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f10108450 msgr2=0x7f8f101a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:04.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f10108450 0x7f8f101a5a80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8f08007ee0 tx=0x7f8f0800d3b0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 -- 172.21.15.86:0/1932035411 shutdown_connections 2024-05-12T11:09:04.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f8efc0b2880 0x7f8efc0b4d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f10108450 0x7f8f101a5a80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f101023d0 0x7f8f1019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 --2- 172.21.15.86:0/1932035411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f10102d90 0x7f8f1019af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:04.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 -- 172.21.15.86:0/1932035411 >> 172.21.15.86:0/1932035411 conn(0x7f8f10078410 msgr2=0x7f8f10101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:04.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 -- 172.21.15.86:0/1932035411 shutdown_connections 2024-05-12T11:09:04.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:04.431+0000 7f8f162a1700 1 -- 172.21.15.86:0/1932035411 wait complete. 2024-05-12T11:09:05.147 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.f status 2024-05-12T11:09:05.393 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:05.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:05 smithi086 ceph-mon[30110]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:05.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:05 smithi176 ceph-mon[34357]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:05.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:05 smithi172 ceph-mon[34517]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/2868119595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58104100 msgr2=0x7f1a58108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/2868119595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58104100 0x7f1a58108120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1a540099c0 tx=0x7f1a54009cd0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/2868119595 shutdown_connections 2024-05-12T11:09:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/2868119595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a58108850 0x7f1a581103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/2868119595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a58103750 0x7f1a58103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/2868119595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58104100 0x7f1a58108120 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/2868119595 >> 172.21.15.86:0/2868119595 conn(0x7f1a5807a600 msgr2=0x7f1a5807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/2868119595 shutdown_connections 2024-05-12T11:09:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.188+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/2868119595 wait complete. 2024-05-12T11:09:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.189+0000 7f1a5f5f9700 1 Processor -- start 2024-05-12T11:09:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.189+0000 7f1a5f5f9700 1 -- start start 2024-05-12T11:09:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.189+0000 7f1a5f5f9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a58103750 0x7f1a580757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.189+0000 7f1a5f5f9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a58104100 0x7f1a58075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.189+0000 7f1a5f5f9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58108850 0x7f1a58076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.189+0000 7f1a5f5f9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1a58113630 con 0x7f1a58108850 2024-05-12T11:09:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.189+0000 7f1a5f5f9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581134b0 con 0x7f1a58103750 2024-05-12T11:09:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.189+0000 7f1a5f5f9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581137b0 con 0x7f1a58104100 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58108850 0x7f1a58076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58108850 0x7f1a58076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47396/0 (socket says 172.21.15.86:47396) 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 -- 172.21.15.86:0/3021610954 learned_addr learned my addr 172.21.15.86:0/3021610954 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5d395700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a58103750 0x7f1a580757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5cb94700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a58104100 0x7f1a58075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 -- 172.21.15.86:0/3021610954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a58104100 msgr2=0x7f1a58075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a58104100 0x7f1a58075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 -- 172.21.15.86:0/3021610954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a58103750 msgr2=0x7f1a580757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a58103750 0x7f1a580757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 -- 172.21.15.86:0/3021610954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a581a8030 con 0x7f1a58108850 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a5db96700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58108850 0x7f1a58076220 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1a50007ee0 tx=0x7f1a5000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a4e7fc700 1 -- 172.21.15.86:0/3021610954 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50004bb0 con 0x7f1a58108850 2024-05-12T11:09:07.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.190+0000 7f1a4e7fc700 1 -- 172.21.15.86:0/3021610954 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a50004d50 con 0x7f1a58108850 2024-05-12T11:09:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.191+0000 7f1a4e7fc700 1 -- 172.21.15.86:0/3021610954 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50005920 con 0x7f1a58108850 2024-05-12T11:09:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.191+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/3021610954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a581a8320 con 0x7f1a58108850 2024-05-12T11:09:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.191+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/3021610954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a581a8830 con 0x7f1a58108850 2024-05-12T11:09:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.194+0000 7f1a4e7fc700 1 -- 172.21.15.86:0/3021610954 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1a5001a020 con 0x7f1a58108850 2024-05-12T11:09:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.195+0000 7f1a4e7fc700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1a440b2900 0x7f1a440b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.195+0000 7f1a5d395700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1a440b2900 0x7f1a440b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.195+0000 7f1a4e7fc700 1 -- 172.21.15.86:0/3021610954 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1a500e1840 con 0x7f1a58108850 2024-05-12T11:09:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.195+0000 7f1a5d395700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1a440b2900 0x7f1a440b4dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1a48005950 tx=0x7f1a4800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.195+0000 7f1a69e8cb80 1 Processor -- start 2024-05-12T11:09:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.195+0000 7f1a69e8cb80 1 -- start start 2024-05-12T11:09:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479bf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bfa80 0x55f3479b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479ba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f34790b8f0 con 0x55f3479bf160 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f347870d50 con 0x55f3479b9d00 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f3479078b0 con 0x55f3479bfa80 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479bf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47404/0 (socket says 172.21.15.86:47404) 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 -- 172.21.15.86:0/4004687794 learned_addr learned my addr 172.21.15.86:0/4004687794 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5db96700 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5cb94700 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bfa80 0x55f3479b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 -- 172.21.15.86:0/4004687794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bfa80 msgr2=0x55f3479b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bfa80 0x55f3479b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 -- 172.21.15.86:0/4004687794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 msgr2=0x55f3479ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:07.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479ba140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 -- 172.21.15.86:0/4004687794 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f347858880 con 0x55f3479bf160 2024-05-12T11:09:07.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a5d395700 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479bf540 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800fdd0 tx=0x7f1a48012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8800dfcdc6b4e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:07.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a437fe700 1 -- 172.21.15.86:0/4004687794 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48016070 con 0x55f3479bf160 2024-05-12T11:09:07.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a437fe700 1 -- 172.21.15.86:0/4004687794 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a48010d70 con 0x55f3479bf160 2024-05-12T11:09:07.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.196+0000 7f1a437fe700 1 -- 172.21.15.86:0/4004687794 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4801bde0 con 0x55f3479bf160 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/4004687794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 msgr2=0x55f3479bf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479bf540 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800fdd0 tx=0x7f1a48012000 comp rx=0 tx=0).stop 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/4004687794 shutdown_connections 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479ba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479bf540 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/4004687794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bfa80 0x55f3479b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/4004687794 >> 172.21.15.86:0/4004687794 conn(0x55f3478e5b20 msgr2=0x55f3479b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/4004687794 shutdown_connections 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.197+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/4004687794 wait complete. 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 1 -- start start 2024-05-12T11:09:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 1 Processor -- start 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 0x55f3479c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f3479c6400 con 0x55f3479bfa80 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f3478c4e80 con 0x55f3479b9d00 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f3479c6580 con 0x55f3479bf160 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a69e8cb80 10 client.0 _ll_register_callbacks cb 0x55f34789f560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a5db96700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a5db96700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47406/0 (socket says 172.21.15.86:47406) 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a5db96700 1 -- 172.21.15.86:0/3980286999 learned_addr learned my addr 172.21.15.86:0/3980286999 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a5cb94700 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 0x55f3479c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.198+0000 7f1a5d395700 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a5db96700 1 -- 172.21.15.86:0/3980286999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 msgr2=0x55f3479c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a5db96700 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 0x55f3479c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a5db96700 1 -- 172.21.15.86:0/3980286999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 msgr2=0x55f3479c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a5db96700 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a5db96700 1 -- 172.21.15.86:0/3980286999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3478c2710 con 0x55f3479bfa80 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a5db96700 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479c2f90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1a500df2c0 tx=0x7f1a50005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b4374a8066b4f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a40ff9700 1 -- 172.21.15.86:0/3980286999 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50005ac0 con 0x55f3479bfa80 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/3980286999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a48010d70 con 0x55f3479bfa80 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a40ff9700 1 -- 172.21.15.86:0/3980286999 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1a500b19c0 con 0x55f3479bfa80 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a40ff9700 1 -- 172.21.15.86:0/3980286999 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a500a88f0 con 0x55f3479bfa80 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a69e8cb80 10 client.15123 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/3980286999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f3479d0d20 con 0x55f3479bfa80 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a40ff9700 1 -- 172.21.15.86:0/3980286999 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a48010d70 con 0x55f3479bfa80 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.199+0000 7f1a40ff9700 1 -- 172.21.15.86:0/3980286999 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1a500a8040 con 0x55f3479bfa80 2024-05-12T11:09:07.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a69e8cb80 10 client.15123 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a69e8cb80 10 client.15123 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a69e8cb80 20 client.15123 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x55f3479d3370 0x55f3479d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a69e8cb80 4 client.15123 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/3980286999 --> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3479192d0 con 0x55f3479d3370 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a5d395700 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x55f3479d3370 0x55f3479d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a40ff9700 10 client.15123 ms_handle_connect on v2:172.21.15.176:6834/197047059 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.200+0000 7f1a5d395700 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x55f3479d3370 0x55f3479d47e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a9785ac613404a42 server_cookie=e64cacfbceb27190 in_seq=0 out_seq=0 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a40ff9700 1 -- 172.21.15.86:0/3980286999 <== mds.3 v2:172.21.15.176:6834/197047059 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f3479192d0 con 0x55f3479d3370 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a40ff9700 10 client.15123 handle_command_reply: tid=0 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 client.15123 shutdown 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/3980286999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 msgr2=0x55f3479c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479c2f90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1a500df2c0 tx=0x7f1a50005260 comp rx=0 tx=0).stop 2024-05-12T11:09:07.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/3980286999 shutdown_connections 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x55f3479d3370 0x55f3479d47e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479c2f90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/3980286999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 0x55f3479c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/3980286999 >> 172.21.15.86:0/3980286999 conn(0x55f3478e5b20 msgr2=0x55f3479aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a40ff9700 0 client.15123 ms_handle_reset on v2:172.21.15.176:6834/197047059 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.201+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/3980286999 shutdown_connections 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.202+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/3980286999 wait complete. 2024-05-12T11:09:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.202+0000 7f1a69e8cb80 20 client.15123 trim_cache size 0 max 16384 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.222+0000 7f1a69e8cb80 1 Processor -- start 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.222+0000 7f1a69e8cb80 1 -- start start 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.222+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479b9d00 0x55f3479aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.222+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479ddc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.222+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479bfa80 0x55f3479de180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.222+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f3479d2b20 con 0x55f3479bf160 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.222+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f3479d31f0 con 0x55f3479bfa80 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.222+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f3479d38c0 con 0x55f3479b9d00 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479ddc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479ddc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47412/0 (socket says 172.21.15.86:47412) 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 -- 172.21.15.86:0/2139835082 learned_addr learned my addr 172.21.15.86:0/2139835082 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5db96700 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479bfa80 0x55f3479de180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5d395700 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479b9d00 0x55f3479aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 -- 172.21.15.86:0/2139835082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479b9d00 msgr2=0x55f3479aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479b9d00 0x55f3479aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 -- 172.21.15.86:0/2139835082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479bfa80 msgr2=0x55f3479de180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479bfa80 0x55f3479de180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 -- 172.21.15.86:0/2139835082 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3479d3db0 con 0x55f3479bf160 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5db96700 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479bfa80 0x55f3479de180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a5cb94700 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479ddc40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a54005b00 tx=0x7f1a54005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8e685a5494407f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a42ffd700 1 -- 172.21.15.86:0/2139835082 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54028070 con 0x55f3479bf160 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a42ffd700 1 -- 172.21.15.86:0/2139835082 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a5400bd80 con 0x55f3479bf160 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.223+0000 7f1a42ffd700 1 -- 172.21.15.86:0/2139835082 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a540056a0 con 0x55f3479bf160 2024-05-12T11:09:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/2139835082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 msgr2=0x55f3479ddc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479ddc40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a54005b00 tx=0x7f1a54005a90 comp rx=0 tx=0).stop 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/2139835082 shutdown_connections 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479bfa80 0x55f3479de180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479b9d00 0x55f3479aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/2139835082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bf160 0x55f3479ddc40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/2139835082 >> 172.21.15.86:0/2139835082 conn(0x55f3478e5b20 msgr2=0x55f3479b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/2139835082 shutdown_connections 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/2139835082 wait complete. 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 -- start start 2024-05-12T11:09:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.224+0000 7f1a69e8cb80 1 Processor -- start 2024-05-12T11:09:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479d99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 0x55f3479d9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a69e8cb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479da470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f3479d4660 con 0x55f3479bfa80 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f3479d3f90 con 0x55f3479b9d00 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a69e8cb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f3479d4d30 con 0x55f3479bf160 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a69e8cb80 10 client.0 _ll_register_callbacks cb 0x55f34789f560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479da470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479da470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47414/0 (socket says 172.21.15.86:47414) 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5cb94700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 0x55f3479d9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 -- 172.21.15.86:0/525629938 learned_addr learned my addr 172.21.15.86:0/525629938 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5d395700 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479d99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 -- 172.21.15.86:0/525629938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 msgr2=0x55f3479d9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 0x55f3479d9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 -- 172.21.15.86:0/525629938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 msgr2=0x55f3479d99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479d99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 -- 172.21.15.86:0/525629938 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f347a3d9f0 con 0x55f3479bfa80 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a5db96700 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479da470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1a500a8400 tx=0x7f1a50005b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2af042b35dd504 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.225+0000 7f1a40ff9700 1 -- 172.21.15.86:0/525629938 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a500a8de0 con 0x55f3479bfa80 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a40ff9700 1 -- 172.21.15.86:0/525629938 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1a5000db20 con 0x55f3479bfa80 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/525629938 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a5400bd80 con 0x55f3479bfa80 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a40ff9700 1 -- 172.21.15.86:0/525629938 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a500b1c40 con 0x55f3479bfa80 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 10 client.15129 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/525629938 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f347a3ecd0 con 0x55f3479bfa80 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a40ff9700 1 -- 172.21.15.86:0/525629938 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a5400bd80 con 0x55f3479bfa80 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a40ff9700 1 -- 172.21.15.86:0/525629938 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1a500ae320 con 0x55f3479bfa80 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 10 client.15129 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 10 client.15129 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-12T11:09:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 20 client.15129 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x55f347a43850 0x55f347a42560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 4 client.15129 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/525629938 --> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] -- command(tid 0: {"prefix": "status"}) -- 0x55f347913370 con 0x55f347a43850 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.226+0000 7f1a5d395700 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x55f347a43850 0x55f347a42560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a40ff9700 10 client.15129 ms_handle_connect on v2:172.21.15.176:6834/197047059 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a5d395700 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x55f347a43850 0x55f347a42560 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=265949f8c6aa35f7 server_cookie=5e7ec0ee2d5f37f8 in_seq=0 out_seq=0 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a40ff9700 1 -- 172.21.15.86:0/525629938 <== mds.3 v2:172.21.15.176:6834/197047059 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f347913370 con 0x55f347a43850 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a40ff9700 10 client.15129 handle_command_reply: tid=0 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 client.15129 shutdown 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/525629938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 msgr2=0x55f3479da470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479da470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1a500a8400 tx=0x7f1a50005b30 comp rx=0 tx=0).stop 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/525629938 shutdown_connections 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x55f347a43850 0x55f347a42560 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3479bfa80 0x55f3479da470 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3479b9d00 0x55f3479d99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a40ff9700 0 client.15129 ms_handle_reset on v2:172.21.15.176:6834/197047059 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 --2- 172.21.15.86:0/525629938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f3479bf160 0x55f3479d9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/525629938 >> 172.21.15.86:0/525629938 conn(0x55f3478e5b20 msgr2=0x55f3479bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/525629938 shutdown_connections 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.227+0000 7f1a69e8cb80 1 -- 172.21.15.86:0/525629938 wait complete. 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a69e8cb80 20 client.15129 trim_cache size 0 max 16384 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 3, 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24436, 2024-05-12T11:09:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 165.99939069800001, 2024-05-12T11:09:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:09:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:09:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:09:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 216.38482947899999 2024-05-12T11:09:07.226 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1a440b2900 msgr2=0x7f1a440b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1a440b2900 0x7f1a440b4dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1a48005950 tx=0x7f1a4800a300 comp rx=0 tx=0).stop 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58108850 msgr2=0x7f1a58076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58108850 0x7f1a58076220 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1a50007ee0 tx=0x7f1a5000d3b0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/3021610954 shutdown_connections 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f1a440b2900 0x7f1a440b4dc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a58108850 0x7f1a58076220 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a58103750 0x7f1a580757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 --2- 172.21.15.86:0/3021610954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a58104100 0x7f1a58075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/3021610954 >> 172.21.15.86:0/3021610954 conn(0x7f1a5807a600 msgr2=0x7f1a581099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:07.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/3021610954 shutdown_connections 2024-05-12T11:09:07.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:07.228+0000 7f1a5f5f9700 1 -- 172.21.15.86:0/3021610954 wait complete. 2024-05-12T11:09:07.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:07 smithi086 ceph-mon[30110]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:09:07.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:07 smithi176 ceph-mon[34357]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:09:07.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:07 smithi172 ceph-mon[34517]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-12T11:09:08.025 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-12T11:09:08.278 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:09.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:09 smithi176 ceph-mon[34357]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:09.582 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:09 smithi086 ceph-mon[30110]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:09 smithi172 ceph-mon[34517]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 -- 172.21.15.86:0/172177794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8108400 msgr2=0x7f05a81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 --2- 172.21.15.86:0/172177794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8108400 0x7f05a81087e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0598009990 tx=0x7f0598009ca0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 -- 172.21.15.86:0/172177794 shutdown_connections 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 --2- 172.21.15.86:0/172177794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a8102d50 0x7f05a810f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 --2- 172.21.15.86:0/172177794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8108400 0x7f05a81087e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 --2- 172.21.15.86:0/172177794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8102390 0x7f05a8102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 -- 172.21.15.86:0/172177794 >> 172.21.15.86:0/172177794 conn(0x7f05a8079310 msgr2=0x7f05a8079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 -- 172.21.15.86:0/172177794 shutdown_connections 2024-05-12T11:09:10.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.980+0000 7f05ae908700 1 -- 172.21.15.86:0/172177794 wait complete. 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05ae908700 1 Processor -- start 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05ae908700 1 -- start start 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05ae908700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a8102390 0x7f05a819e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05ae908700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8102d50 0x7f05a819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05ae908700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8108400 0x7f05a8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05ae908700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81125a0 con 0x7f05a8102d50 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05ae908700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8112420 con 0x7f05a8108400 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05ae908700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8112720 con 0x7f05a8102390 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f059ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8102d50 0x7f05a819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f059ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8102d50 0x7f05a819ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47442/0 (socket says 172.21.15.86:47442) 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f059ffff700 1 -- 172.21.15.86:0/4292797090 learned_addr learned my addr 172.21.15.86:0/4292797090 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05acea5700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8108400 0x7f05a8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05a7fff700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a8102390 0x7f05a819e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f059ffff700 1 -- 172.21.15.86:0/4292797090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a8102390 msgr2=0x7f05a819e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f059ffff700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a8102390 0x7f05a819e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f059ffff700 1 -- 172.21.15.86:0/4292797090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8108400 msgr2=0x7f05a8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f059ffff700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8108400 0x7f05a8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f059ffff700 1 -- 172.21.15.86:0/4292797090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a81990e0 con 0x7f05a8102d50 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.981+0000 7f05acea5700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8108400 0x7f05a8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.982+0000 7f059ffff700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8102d50 0x7f05a819ed00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f059000e9a0 tx=0x7f059000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.982+0000 7f05a5ffb700 1 -- 172.21.15.86:0/4292797090 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059000cbd0 con 0x7f05a8102d50 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.982+0000 7f05ae908700 1 -- 172.21.15.86:0/4292797090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a81993d0 con 0x7f05a8102d50 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.982+0000 7f05a5ffb700 1 -- 172.21.15.86:0/4292797090 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f059000cd70 con 0x7f05a8102d50 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.982+0000 7f05a5ffb700 1 -- 172.21.15.86:0/4292797090 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590018680 con 0x7f05a8102d50 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.982+0000 7f05ae908700 1 -- 172.21.15.86:0/4292797090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a81a5690 con 0x7f05a8102d50 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.984+0000 7f05a5ffb700 1 -- 172.21.15.86:0/4292797090 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0590010970 con 0x7f05a8102d50 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.985+0000 7f05a5ffb700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05940b2880 0x7f05940b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.985+0000 7f05a7fff700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05940b2880 0x7f05940b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.985+0000 7f05a5ffb700 1 -- 172.21.15.86:0/4292797090 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f05900e25f0 con 0x7f05a8102d50 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.985+0000 7f05a7fff700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05940b2880 0x7f05940b4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f059800b2e0 tx=0x7f059801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.985+0000 7f05b919bb80 1 Processor -- start 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05b919bb80 1 -- start start 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533bb60 0x56455533bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455533a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x56455534a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05b919bb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56455528c810 con 0x56455533bb60 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05b919bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56455522b770 con 0x56455533a2a0 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05b919bb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5645552887d0 con 0x56455533ac60 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533bb60 0x56455533bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533bb60 0x56455533bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47458/0 (socket says 172.21.15.86:47458) 2024-05-12T11:09:10.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 -- 172.21.15.86:0/740017949 learned_addr learned my addr 172.21.15.86:0/740017949 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f059ffff700 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455533a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05acea5700 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x56455534a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 -- 172.21.15.86:0/740017949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 msgr2=0x56455534a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x56455534a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 -- 172.21.15.86:0/740017949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 msgr2=0x56455533a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455533a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 -- 172.21.15.86:0/740017949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645551d9880 con 0x56455533bb60 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f05a7fff700 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533bb60 0x56455533bf40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0598015000 tx=0x7f059801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988e53c5ee04f143 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.986+0000 7f059e7fc700 1 -- 172.21.15.86:0/740017949 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059800be10 con 0x56455533bb60 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f059e7fc700 1 -- 172.21.15.86:0/740017949 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f059802e400 con 0x56455533bb60 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f059e7fc700 1 -- 172.21.15.86:0/740017949 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598023600 con 0x56455533bb60 2024-05-12T11:09:10.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 -- 172.21.15.86:0/740017949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533bb60 msgr2=0x56455533bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533bb60 0x56455533bf40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0598015000 tx=0x7f059801e000 comp rx=0 tx=0).stop 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 -- 172.21.15.86:0/740017949 shutdown_connections 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x56455534a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533bb60 0x56455533bf40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 --2- 172.21.15.86:0/740017949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455533a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 -- 172.21.15.86:0/740017949 >> 172.21.15.86:0/740017949 conn(0x5645552660b0 msgr2=0x564555334c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 -- 172.21.15.86:0/740017949 shutdown_connections 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.987+0000 7f05b919bb80 1 -- 172.21.15.86:0/740017949 wait complete. 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 1 -- start start 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 1 Processor -- start 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455534a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533ac60 0x5645553479c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533bb60 0x564555347f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56455534b1b0 con 0x56455533ac60 2024-05-12T11:09:10.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5645551f2be0 con 0x56455533a2a0 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56455534b330 con 0x56455533bb60 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05b919bb80 10 client.0 _ll_register_callbacks cb 0x5645552248d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f059ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533ac60 0x5645553479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f059ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533ac60 0x5645553479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47468/0 (socket says 172.21.15.86:47468) 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f059ffff700 1 -- 172.21.15.86:0/2733836932 learned_addr learned my addr 172.21.15.86:0/2733836932 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455534a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.988+0000 7f05acea5700 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533bb60 0x564555347f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f059ffff700 1 -- 172.21.15.86:0/2733836932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533bb60 msgr2=0x564555347f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f059ffff700 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533bb60 0x564555347f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f059ffff700 1 -- 172.21.15.86:0/2733836932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 msgr2=0x56455534a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f059ffff700 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455534a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f059ffff700 1 -- 172.21.15.86:0/2733836932 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564555228640 con 0x56455533ac60 2024-05-12T11:09:10.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05a7fff700 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455534a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f059ffff700 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533ac60 0x5645553479c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f05900e0120 tx=0x7f05900aa130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d82e16b813198af server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05877fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05877fe700 1 -- 172.21.15.86:0/2733836932 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05900a9bf0 con 0x56455533ac60 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05877fe700 1 -- 172.21.15.86:0/2733836932 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f05900a9060 con 0x56455533ac60 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 1 -- 172.21.15.86:0/2733836932 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f059802e400 con 0x56455533ac60 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05877fe700 1 -- 172.21.15.86:0/2733836932 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05900adfa0 con 0x56455533ac60 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 10 client.15141 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 1 -- 172.21.15.86:0/2733836932 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564555355b40 con 0x56455533ac60 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05877fe700 1 -- 172.21.15.86:0/2733836932 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f059802e400 con 0x56455533ac60 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05877fe700 1 -- 172.21.15.86:0/2733836932 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f05900e20c0 con 0x56455533ac60 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 10 client.15141 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 10 client.15141 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 20 client.15141 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x564555358120 0x564555359590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 4 client.15141 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.989+0000 7f05b919bb80 1 -- 172.21.15.86:0/2733836932 --> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564555306600 con 0x564555358120 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.990+0000 7f05a7fff700 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x564555358120 0x564555359590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.990+0000 7f05877fe700 10 client.15141 ms_handle_connect on v2:172.21.15.176:6836/2905239515 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.990+0000 7f05a7fff700 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x564555358120 0x564555359590 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44ab5a2a88ad1cd2 server_cookie=70e9636e915a0581 in_seq=0 out_seq=0 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05877fe700 1 -- 172.21.15.86:0/2733836932 <== mds.2 v2:172.21.15.176:6836/2905239515 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564555306600 con 0x564555358120 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05877fe700 10 client.15141 handle_command_reply: tid=0 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 client.15141 shutdown 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 -- 172.21.15.86:0/2733836932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533ac60 msgr2=0x5645553479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533ac60 0x5645553479c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f05900e0120 tx=0x7f05900aa130 comp rx=0 tx=0).stop 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 -- 172.21.15.86:0/2733836932 shutdown_connections 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x564555358120 0x564555359590 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533bb60 0x564555347f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533a2a0 0x56455534a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 --2- 172.21.15.86:0/2733836932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533ac60 0x5645553479c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05877fe700 0 client.15141 ms_handle_reset on v2:172.21.15.176:6836/2905239515 2024-05-12T11:09:10.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 -- 172.21.15.86:0/2733836932 >> 172.21.15.86:0/2733836932 conn(0x5645552660b0 msgr2=0x56455532f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:10.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 -- 172.21.15.86:0/2733836932 shutdown_connections 2024-05-12T11:09:10.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 1 -- 172.21.15.86:0/2733836932 wait complete. 2024-05-12T11:09:10.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:09.991+0000 7f05b919bb80 20 client.15141 trim_cache size 0 max 16384 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05b919bb80 1 Processor -- start 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05b919bb80 1 -- start start 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x564555342fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x5645553629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 0x564555362f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05b919bb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5645553578d0 con 0x56455533a2a0 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05b919bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564555357fa0 con 0x56455533bb60 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05b919bb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564555358670 con 0x56455533ac60 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x564555342fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x564555342fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47470/0 (socket says 172.21.15.86:47470) 2024-05-12T11:09:10.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05a7fff700 1 -- 172.21.15.86:0/1166736229 learned_addr learned my addr 172.21.15.86:0/1166736229 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.013+0000 7f05acea5700 1 --2- 172.21.15.86:0/1166736229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 0x564555362f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f05a7fff700 1 -- 172.21.15.86:0/1166736229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 msgr2=0x5645553629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f05a7fff700 1 --2- 172.21.15.86:0/1166736229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x5645553629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f05a7fff700 1 -- 172.21.15.86:0/1166736229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 msgr2=0x564555362f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f05a7fff700 1 --2- 172.21.15.86:0/1166736229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 0x564555362f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f05a7fff700 1 -- 172.21.15.86:0/1166736229 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645553317c0 con 0x56455533a2a0 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f05a7fff700 1 --2- 172.21.15.86:0/1166736229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x564555342fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f059802ecb0 tx=0x7f0598019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abc80e230728ca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f059dffb700 1 -- 172.21.15.86:0/1166736229 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059800fe60 con 0x56455533a2a0 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f059dffb700 1 -- 172.21.15.86:0/1166736229 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f059802e8b0 con 0x56455533a2a0 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.014+0000 7f059dffb700 1 -- 172.21.15.86:0/1166736229 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05980052d0 con 0x56455533a2a0 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 -- 172.21.15.86:0/1166736229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 msgr2=0x564555342fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1166736229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x564555342fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f059802ecb0 tx=0x7f0598019040 comp rx=0 tx=0).stop 2024-05-12T11:09:10.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 -- 172.21.15.86:0/1166736229 shutdown_connections 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1166736229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 0x564555362f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1166736229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x564555342fe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1166736229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x5645553629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 -- 172.21.15.86:0/1166736229 >> 172.21.15.86:0/1166736229 conn(0x5645552660b0 msgr2=0x5645553428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 -- 172.21.15.86:0/1166736229 shutdown_connections 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 -- 172.21.15.86:0/1166736229 wait complete. 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.015+0000 7f05b919bb80 1 -- start start 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05b919bb80 1 Processor -- start 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x56455535c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x56455535cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05b919bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 0x56455535d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05b919bb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564555359410 con 0x56455533a2a0 2024-05-12T11:09:10.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05b919bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564555358d40 con 0x56455533bb60 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05b919bb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564555359ae0 con 0x56455533ac60 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05b919bb80 10 client.0 _ll_register_callbacks cb 0x5645552248d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x56455535c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x56455535c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47482/0 (socket says 172.21.15.86:47482) 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 -- 172.21.15.86:0/1399490530 learned_addr learned my addr 172.21.15.86:0/1399490530 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f059ffff700 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x56455535cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05acea5700 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 0x56455535d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 -- 172.21.15.86:0/1399490530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 msgr2=0x56455535cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x56455535cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 -- 172.21.15.86:0/1399490530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 msgr2=0x56455535d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 0x56455535d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 -- 172.21.15.86:0/1399490530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564555361040 con 0x56455533a2a0 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05a7fff700 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x56455535c6f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0598006010 tx=0x7f059802ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348f6e2396d2b9f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.016+0000 7f05877fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:10.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.018+0000 7f05877fe700 1 -- 172.21.15.86:0/1399490530 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598048060 con 0x56455533a2a0 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.018+0000 7f05b919bb80 1 -- 172.21.15.86:0/1399490530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f059802e8b0 con 0x56455533a2a0 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.018+0000 7f05877fe700 1 -- 172.21.15.86:0/1399490530 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f059802b040 con 0x56455533a2a0 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.018+0000 7f05877fe700 1 -- 172.21.15.86:0/1399490530 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f059800fe60 con 0x56455533a2a0 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.018+0000 7f05b919bb80 10 client.15147 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.018+0000 7f05b919bb80 1 -- 172.21.15.86:0/1399490530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645553c3a10 con 0x56455533a2a0 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.018+0000 7f05877fe700 1 -- 172.21.15.86:0/1399490530 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f059802e8b0 con 0x56455533a2a0 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05877fe700 1 -- 172.21.15.86:0/1399490530 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0598022070 con 0x56455533a2a0 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05b919bb80 10 client.15147 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05b919bb80 10 client.15147 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05b919bb80 20 client.15147 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5645553c7f80 0x5645553c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05b919bb80 4 client.15147 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:10.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05b919bb80 1 -- 172.21.15.86:0/1399490530 --> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] -- command(tid 0: {"prefix": "status"}) -- 0x56455529a1f0 con 0x5645553c7f80 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f059ffff700 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5645553c7f80 0x5645553c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05877fe700 10 client.15147 ms_handle_connect on v2:172.21.15.176:6836/2905239515 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f059ffff700 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5645553c7f80 0x5645553c6c90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=114fb5634adcacac server_cookie=cfbd477ce84f06b6 in_seq=0 out_seq=0 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05877fe700 1 -- 172.21.15.86:0/1399490530 <== mds.2 v2:172.21.15.176:6836/2905239515 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56455529a1f0 con 0x5645553c7f80 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.019+0000 7f05877fe700 10 client.15147 handle_command_reply: tid=0 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 client.15147 shutdown 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 -- 172.21.15.86:0/1399490530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 msgr2=0x56455535c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x56455535c6f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0598006010 tx=0x7f059802ea60 comp rx=0 tx=0).stop 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 -- 172.21.15.86:0/1399490530 shutdown_connections 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56455533bb60 0x56455535d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56455533a2a0 0x56455535c6f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x5645553c7f80 0x5645553c6c90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 --2- 172.21.15.86:0/1399490530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56455533ac60 0x56455535cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 -- 172.21.15.86:0/1399490530 >> 172.21.15.86:0/1399490530 conn(0x5645552660b0 msgr2=0x56455532f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05877fe700 0 client.15147 ms_handle_reset on v2:172.21.15.176:6836/2905239515 2024-05-12T11:09:10.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 -- 172.21.15.86:0/1399490530 shutdown_connections 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 1 -- 172.21.15.86:0/1399490530 wait complete. 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.020+0000 7f05b919bb80 20 client.15147 trim_cache size 0 max 16384 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 2, 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24442, 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:10.020 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 169.79360369400001, 2024-05-12T11:09:10.021 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:09:10.021 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:09:10.021 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:09:10.021 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 216.39690209 2024-05-12T11:09:10.021 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:10.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 -- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05940b2880 msgr2=0x7f05940b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05940b2880 0x7f05940b4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f059800b2e0 tx=0x7f059801a040 comp rx=0 tx=0).stop 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 -- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8102d50 msgr2=0x7f05a819ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8102d50 0x7f05a819ed00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f059000e9a0 tx=0x7f059000ed60 comp rx=0 tx=0).stop 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 -- 172.21.15.86:0/4292797090 shutdown_connections 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f05940b2880 0x7f05940b4d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8108400 0x7f05a8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a8102390 0x7f05a819e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 --2- 172.21.15.86:0/4292797090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a8102d50 0x7f05a819ed00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 -- 172.21.15.86:0/4292797090 >> 172.21.15.86:0/4292797090 conn(0x7f05a8079310 msgr2=0x7f05a8101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 -- 172.21.15.86:0/4292797090 shutdown_connections 2024-05-12T11:09:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:10.021+0000 7f05ae908700 1 -- 172.21.15.86:0/4292797090 wait complete. 2024-05-12T11:09:10.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:10.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:10 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.659 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:10.659 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.659 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.659 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.659 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:10 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-12T11:09:10.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:10.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:10 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:10.938 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:11.313 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:11 smithi086 ceph-mon[30110]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:09:11.313 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:11.313 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:11.313 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:11 smithi086 ceph-mon[30110]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:11.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:11 smithi176 ceph-mon[34357]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:09:11.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:11.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:11.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:11 smithi176 ceph-mon[34357]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:11.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:11 smithi172 ceph-mon[34517]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-12T11:09:11.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:11.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:11.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:11 smithi172 ceph-mon[34517]: from='mgr.14152 172.21.15.86:0/2632409026' entity='mgr.x' 2024-05-12T11:09:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 -- 172.21.15.86:0/4185718151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 msgr2=0x7fa9a81077a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/4185718151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 0x7fa9a81077a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa998009990 tx=0x7fa998009ca0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 -- 172.21.15.86:0/4185718151 shutdown_connections 2024-05-12T11:09:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/4185718151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a8103040 0x7fa9a810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/4185718151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 0x7fa9a81077a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/4185718151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a8102680 0x7fa9a8102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 -- 172.21.15.86:0/4185718151 >> 172.21.15.86:0/4185718151 conn(0x7fa9a8079260 msgr2=0x7fa9a8079670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 -- 172.21.15.86:0/4185718151 shutdown_connections 2024-05-12T11:09:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.609+0000 7fa9ad15b700 1 -- 172.21.15.86:0/4185718151 wait complete. 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9ad15b700 1 Processor -- start 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9ad15b700 1 -- start start 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9ad15b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a8102680 0x7fa9a819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9ad15b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a8103040 0x7fa9a819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9ad15b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 0x7fa9a81a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9ad15b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81126c0 con 0x7fa9a81073c0 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9ad15b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8112540 con 0x7fa9a8102680 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9ad15b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8112840 con 0x7fa9a8103040 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 0x7fa9a81a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 0x7fa9a81a5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51376/0 (socket says 172.21.15.86:51376) 2024-05-12T11:09:12.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a759e700 1 -- 172.21.15.86:0/3800775291 learned_addr learned my addr 172.21.15.86:0/3800775291 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa99ffff700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a8103040 0x7fa9a819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a8102680 0x7fa9a819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a759e700 1 -- 172.21.15.86:0/3800775291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a8103040 msgr2=0x7fa9a819afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a8103040 0x7fa9a819afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a759e700 1 -- 172.21.15.86:0/3800775291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a8102680 msgr2=0x7fa9a819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a8102680 0x7fa9a819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.610+0000 7fa9a759e700 1 -- 172.21.15.86:0/3800775291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a81a6040 con 0x7fa9a81073c0 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.611+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 0x7fa9a81a5b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b9e0 tx=0x7fa9a000bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.611+0000 7fa9a4d99700 1 -- 172.21.15.86:0/3800775291 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000d820 con 0x7fa9a81073c0 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.611+0000 7fa9a4d99700 1 -- 172.21.15.86:0/3800775291 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a0015420 con 0x7fa9a81073c0 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.611+0000 7fa9ad15b700 1 -- 172.21.15.86:0/3800775291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a81a6270 con 0x7fa9a81073c0 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.611+0000 7fa9a4d99700 1 -- 172.21.15.86:0/3800775291 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0014610 con 0x7fa9a81073c0 2024-05-12T11:09:12.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.611+0000 7fa9ad15b700 1 -- 172.21.15.86:0/3800775291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a81a6760 con 0x7fa9a81073c0 2024-05-12T11:09:12.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.613+0000 7fa9a4d99700 1 -- 172.21.15.86:0/3800775291 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa9a00147b0 con 0x7fa9a81073c0 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.614+0000 7fa9a4d99700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa9940b2880 0x7fa9940b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.614+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa9940b2880 0x7fa9940b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.614+0000 7fa9a4d99700 1 -- 172.21.15.86:0/3800775291 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fa9a00e1ac0 con 0x7fa9a81073c0 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.614+0000 7fa9b79eeb80 1 Processor -- start 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.614+0000 7fa9b79eeb80 1 -- start start 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa9940b2880 0x7fa9940b4d40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b5c0 tx=0x7fa998005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c1447950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1441bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c1442550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5641c138f8f0 con 0x5641c1447e90 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641c12f4d50 con 0x5641c1442110 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5641c138b8b0 con 0x5641c1447570 2024-05-12T11:09:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1441bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1441bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51382/0 (socket says 172.21.15.86:51382) 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa99ffff700 1 -- 172.21.15.86:0/3771804464 learned_addr learned my addr 172.21.15.86:0/3771804464 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c1447950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa99ffff700 1 -- 172.21.15.86:0/3771804464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 msgr2=0x5641c1447950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa99ffff700 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c1447950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c1442550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa99ffff700 1 -- 172.21.15.86:0/3771804464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 msgr2=0x5641c1442550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa99ffff700 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c1442550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa99ffff700 1 -- 172.21.15.86:0/3771804464 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c12dc880 con 0x5641c1447e90 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.615+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c1442550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.616+0000 7fa99ffff700 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1441bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa99000bcf0 tx=0x7fa9900103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36885a4f89a55d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.616+0000 7fa99d7fa700 1 -- 172.21.15.86:0/3771804464 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990010dc0 con 0x5641c1447e90 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.616+0000 7fa99d7fa700 1 -- 172.21.15.86:0/3771804464 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9900044e0 con 0x5641c1447e90 2024-05-12T11:09:12.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.616+0000 7fa99d7fa700 1 -- 172.21.15.86:0/3771804464 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990005280 con 0x5641c1447e90 2024-05-12T11:09:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.616+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3771804464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 msgr2=0x5641c1441bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.616+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1441bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa99000bcf0 tx=0x7fa9900103d0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3771804464 shutdown_connections 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c1442550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c1447950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3771804464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1441bd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3771804464 >> 172.21.15.86:0/3771804464 conn(0x5641c1369b20 msgr2=0x5641c1438250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3771804464 shutdown_connections 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3771804464 wait complete. 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 -- start start 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.617+0000 7fa9b79eeb80 1 Processor -- start 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c144da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c144ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c144b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5641c144e810 con 0x5641c1447e90 2024-05-12T11:09:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641c1348e80 con 0x5641c1442110 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5641c144e990 con 0x5641c1447570 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9b79eeb80 10 client.0 _ll_register_callbacks cb 0x5641c1323560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c144b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c144b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51392/0 (socket says 172.21.15.86:51392) 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c144ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 -- 172.21.15.86:0/22695992 learned_addr learned my addr 172.21.15.86:0/22695992 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c144da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 -- 172.21.15.86:0/22695992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 msgr2=0x5641c144ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c144ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 -- 172.21.15.86:0/22695992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 msgr2=0x5641c144da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c144da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 -- 172.21.15.86:0/22695992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c1346710 con 0x5641c1447e90 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9a759e700 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c144b380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00a5140 tx=0x7fa9a00a9840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47054dcebe5a78a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa98e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa98e7fc700 1 -- 172.21.15.86:0/22695992 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00ad470 con 0x5641c1447e90 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa98e7fc700 1 -- 172.21.15.86:0/22695992 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fa9a00ad120 con 0x5641c1447e90 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.618+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/22695992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9900044e0 con 0x5641c1447e90 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa98e7fc700 1 -- 172.21.15.86:0/22695992 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa9a00b1f20 con 0x5641c1447e90 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa9b79eeb80 10 client.15159 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/22695992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641c1458fe0 con 0x5641c1447e90 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa98e7fc700 1 -- 172.21.15.86:0/22695992 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9900044e0 con 0x5641c1447e90 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa98e7fc700 1 -- 172.21.15.86:0/22695992 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa9a00a4c10 con 0x5641c1447e90 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa9b79eeb80 10 client.15159 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa9b79eeb80 10 client.15159 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa9b79eeb80 20 client.15159 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x5641c145b5d0 0x5641c145ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa9b79eeb80 4 client.15159 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.619+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/22695992 --> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641c139d2d0 con 0x5641c145b5d0 2024-05-12T11:09:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.620+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x5641c145b5d0 0x5641c145ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.620+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x5641c145b5d0 0x5641c145ca40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=271946da3c90b46b server_cookie=8e4ee0b4ffcbf0d6 in_seq=0 out_seq=0 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.620+0000 7fa98e7fc700 10 client.15159 ms_handle_connect on v2:172.21.15.172:6838/2644756211 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa98e7fc700 1 -- 172.21.15.86:0/22695992 <== mds.1 v2:172.21.15.172:6838/2644756211 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5641c139d2d0 con 0x5641c145b5d0 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa98e7fc700 10 client.15159 handle_command_reply: tid=0 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 client.15159 shutdown 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/22695992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 msgr2=0x5641c144b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c144b380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00a5140 tx=0x7fa9a00a9840 comp rx=0 tx=0).stop 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/22695992 shutdown_connections 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x5641c145b5d0 0x5641c145ca40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c144b380 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c144da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/22695992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c144ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/22695992 >> 172.21.15.86:0/22695992 conn(0x5641c1369b20 msgr2=0x5641c1432ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa98e7fc700 0 client.15159 ms_handle_reset on v2:172.21.15.172:6838/2644756211 2024-05-12T11:09:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/22695992 shutdown_connections 2024-05-12T11:09:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/22695992 wait complete. 2024-05-12T11:09:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.621+0000 7fa9b79eeb80 20 client.15159 trim_cache size 0 max 16384 2024-05-12T11:09:12.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.643+0000 7fa9b79eeb80 1 Processor -- start 2024-05-12T11:09:12.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.643+0000 7fa9b79eeb80 1 -- start start 2024-05-12T11:09:12.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c14398f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c14489b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1432bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5641c145ad80 con 0x5641c1447e90 2024-05-12T11:09:12.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641c145b450 con 0x5641c1442110 2024-05-12T11:09:12.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5641c145bb20 con 0x5641c1447570 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1432bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1432bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51398/0 (socket says 172.21.15.86:51398) 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 -- 172.21.15.86:0/3219995759 learned_addr learned my addr 172.21.15.86:0/3219995759 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c14398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 -- 172.21.15.86:0/3219995759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 msgr2=0x5641c14489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c14489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 -- 172.21.15.86:0/3219995759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 msgr2=0x5641c14398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c14398f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 -- 172.21.15.86:0/3219995759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c1434c30 con 0x5641c1447e90 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c14398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1432bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b9b0 tx=0x7fa9a00098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d84e8bceb90ddf server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa99cff9700 1 -- 172.21.15.86:0/3219995759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00a7f50 con 0x5641c1447e90 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa99cff9700 1 -- 172.21.15.86:0/3219995759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a00a80f0 con 0x5641c1447e90 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.644+0000 7fa99cff9700 1 -- 172.21.15.86:0/3219995759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00a4c90 con 0x5641c1447e90 2024-05-12T11:09:12.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3219995759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 msgr2=0x5641c1432bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1432bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b9b0 tx=0x7fa9a00098c0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3219995759 shutdown_connections 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1447e90 0x5641c1432bf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1442110 0x5641c14398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3219995759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c14489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3219995759 >> 172.21.15.86:0/3219995759 conn(0x5641c1369b20 msgr2=0x5641c14482a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3219995759 shutdown_connections 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3219995759 wait complete. 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.645+0000 7fa9b79eeb80 1 -- start start 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9b79eeb80 1 Processor -- start 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1442110 0x5641c1432240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c1432780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9b79eeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1447e90 0x5641c1464510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5641c145c8c0 con 0x5641c1442110 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641c145c1f0 con 0x5641c1447e90 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9b79eeb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5641c145cf90 con 0x5641c1447570 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9b79eeb80 10 client.0 _ll_register_callbacks cb 0x5641c1323560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1442110 0x5641c1432240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1442110 0x5641c1432240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51406/0 (socket says 172.21.15.86:51406) 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 -- 172.21.15.86:0/3605667141 learned_addr learned my addr 172.21.15.86:0/3605667141 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa99ffff700 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c1432780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1447e90 0x5641c1464510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 -- 172.21.15.86:0/3605667141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 msgr2=0x5641c1432780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c1432780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 -- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1447e90 msgr2=0x5641c1464510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1447e90 0x5641c1464510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 -- 172.21.15.86:0/3605667141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c1464a50 con 0x5641c1442110 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a759e700 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1447e90 0x5641c1464510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:12.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa9a6d9d700 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1442110 0x5641c1432240 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa998009990 tx=0x7fa998009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d03f229a8104007 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.646+0000 7fa98e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa98e7fc700 1 -- 172.21.15.86:0/3605667141 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998024a60 con 0x5641c1442110 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa98e7fc700 1 -- 172.21.15.86:0/3605667141 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fa998024c00 con 0x5641c1442110 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3605667141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9a00a80f0 con 0x5641c1442110 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa98e7fc700 1 -- 172.21.15.86:0/3605667141 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa998044050 con 0x5641c1442110 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 10 client.15165 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3605667141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641c14c70c0 con 0x5641c1442110 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa98e7fc700 1 -- 172.21.15.86:0/3605667141 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a00a80f0 con 0x5641c1442110 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa98e7fc700 1 -- 172.21.15.86:0/3605667141 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa99800f460 con 0x5641c1442110 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 10 client.15165 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 10 client.15165 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 20 client.15165 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x5641c14cbd20 0x5641c14caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:12.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 4 client.15165 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:12.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.647+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3605667141 --> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] -- command(tid 0: {"prefix": "status"}) -- 0x5641c1397370 con 0x5641c14cbd20 2024-05-12T11:09:12.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa99ffff700 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x5641c14cbd20 0x5641c14caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa98e7fc700 10 client.15165 ms_handle_connect on v2:172.21.15.172:6838/2644756211 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa99ffff700 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x5641c14cbd20 0x5641c14caa30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d83429e13086b2f server_cookie=1f434fdf7b54d6d3 in_seq=0 out_seq=0 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa98e7fc700 1 -- 172.21.15.86:0/3605667141 <== mds.1 v2:172.21.15.172:6838/2644756211 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5641c1397370 con 0x5641c14cbd20 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa98e7fc700 10 client.15165 handle_command_reply: tid=0 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 client.15165 shutdown 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3605667141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1442110 msgr2=0x5641c1432240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1442110 0x5641c1432240 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa998009990 tx=0x7fa998009ca0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3605667141 shutdown_connections 2024-05-12T11:09:12.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x5641c14cbd20 0x5641c14caa30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641c1447e90 0x5641c1464510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641c1442110 0x5641c1432240 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa98e7fc700 0 client.15165 ms_handle_reset on v2:172.21.15.172:6838/2644756211 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 --2- 172.21.15.86:0/3605667141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5641c1447570 0x5641c1432780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.648+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3605667141 >> 172.21.15.86:0/3605667141 conn(0x5641c1369b20 msgr2=0x5641c1445f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3605667141 shutdown_connections 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9b79eeb80 1 -- 172.21.15.86:0/3605667141 wait complete. 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9b79eeb80 20 client.15165 trim_cache size 0 max 16384 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:12.645 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 1, 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24443, 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 173.434741696, 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 202.76630708100001 2024-05-12T11:09:12.646 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 -- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa9940b2880 msgr2=0x7fa9940b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa9940b2880 0x7fa9940b4d40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b5c0 tx=0x7fa998005960 comp rx=0 tx=0).stop 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 -- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 msgr2=0x7fa9a81a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 0x7fa9a81a5b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b9e0 tx=0x7fa9a000bcf0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 -- 172.21.15.86:0/3800775291 shutdown_connections 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7fa9940b2880 0x7fa9940b4d40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a81073c0 0x7fa9a81a5b00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a8102680 0x7fa9a819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 --2- 172.21.15.86:0/3800775291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a8103040 0x7fa9a819afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:12.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 -- 172.21.15.86:0/3800775291 >> 172.21.15.86:0/3800775291 conn(0x7fa9a8079260 msgr2=0x7fa9a8100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:12.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 -- 172.21.15.86:0/3800775291 shutdown_connections 2024-05-12T11:09:12.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:12.649+0000 7fa9ad15b700 1 -- 172.21.15.86:0/3800775291 wait complete. 2024-05-12T11:09:13.340 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-12T11:09:13.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:13 smithi176 ceph-mon[34357]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:13.594 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:13.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:13 smithi086 ceph-mon[30110]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:13.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:13 smithi172 ceph-mon[34517]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 -- 172.21.15.86:0/3048540796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 msgr2=0x7f65cc110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 --2- 172.21.15.86:0/3048540796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 0x7f65cc110310 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f65c400b0d0 tx=0x7f65c400b3e0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 -- 172.21.15.86:0/3048540796 shutdown_connections 2024-05-12T11:09:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 --2- 172.21.15.86:0/3048540796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 0x7f65cc110310 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 --2- 172.21.15.86:0/3048540796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65cc109540 0x7f65cc109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 --2- 172.21.15.86:0/3048540796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc103560 0x7f65cc1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 -- 172.21.15.86:0/3048540796 >> 172.21.15.86:0/3048540796 conn(0x7f65cc07a660 msgr2=0x7f65cc07aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 -- 172.21.15.86:0/3048540796 shutdown_connections 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 -- 172.21.15.86:0/3048540796 wait complete. 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 Processor -- start 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.150+0000 7f65d23c0700 1 -- start start 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65d23c0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65cc103560 0x7f65cc19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65d23c0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 0x7f65cc19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65d23c0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc109540 0x7f65cc199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65d23c0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc113620 con 0x7f65cc103f20 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65d23c0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1134a0 con 0x7f65cc103560 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65d23c0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1137a0 con 0x7f65cc109540 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 0x7f65cc19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 0x7f65cc19fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51422/0 (socket says 172.21.15.86:51422) 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 -- 172.21.15.86:0/2880721518 learned_addr learned my addr 172.21.15.86:0/2880721518 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cbfff700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65cc103560 0x7f65cc19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 -- 172.21.15.86:0/2880721518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc109540 msgr2=0x7f65cc199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc109540 0x7f65cc199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 -- 172.21.15.86:0/2880721518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65cc103560 msgr2=0x7f65cc19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65cc103560 0x7f65cc19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 -- 172.21.15.86:0/2880721518 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc19a060 con 0x7f65cc103f20 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cbfff700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65cc103560 0x7f65cc19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.151+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 0x7f65cc19fbe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c920 tx=0x7f65bc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.152+0000 7f65c97fa700 1 -- 172.21.15.86:0/2880721518 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc007b00 con 0x7f65cc103f20 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.152+0000 7f65c97fa700 1 -- 172.21.15.86:0/2880721518 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65bc004ce0 con 0x7f65cc103f20 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.152+0000 7f65d23c0700 1 -- 172.21.15.86:0/2880721518 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65cc19a350 con 0x7f65cc103f20 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.152+0000 7f65c97fa700 1 -- 172.21.15.86:0/2880721518 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc005650 con 0x7f65cc103f20 2024-05-12T11:09:15.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.152+0000 7f65d23c0700 1 -- 172.21.15.86:0/2880721518 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc1a6570 con 0x7f65cc103f20 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.154+0000 7f65c97fa700 1 -- 172.21.15.86:0/2880721518 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f65bc004750 con 0x7f65cc103f20 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65c97fa700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f65b80b2880 0x7f65b80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65cbfff700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f65b80b2880 0x7f65b80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65c97fa700 1 -- 172.21.15.86:0/2880721518 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f65bc0e1e70 con 0x7f65cc103f20 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65cbfff700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f65b80b2880 0x7f65b80b4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005950 tx=0x7f65b40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65dcc53b80 1 Processor -- start 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65dcc53b80 1 -- start start 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470023540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x56547001d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x56547001e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56546ff6f8f0 con 0x565470023a80 2024-05-12T11:09:15.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56546fed4d50 con 0x565470023160 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.155+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56546ff6b8b0 con 0x56547001dd00 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x56547001d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x56547001d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51436/0 (socket says 172.21.15.86:51436) 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 -- 172.21.15.86:0/4116085817 learned_addr learned my addr 172.21.15.86:0/4116085817 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cbfff700 1 --2- 172.21.15.86:0/4116085817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470023540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 -- 172.21.15.86:0/4116085817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 msgr2=0x56547001e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/4116085817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x56547001e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 -- 172.21.15.86:0/4116085817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 msgr2=0x565470023540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/4116085817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470023540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 -- 172.21.15.86:0/4116085817 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56546febc880 con 0x565470023a80 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/4116085817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x56547001d7c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0a54f0 tx=0x7f65bc007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707d97dfc9074262 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65c27fc700 1 -- 172.21.15.86:0/4116085817 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc01d040 con 0x565470023a80 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65c27fc700 1 -- 172.21.15.86:0/4116085817 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65bc0a9470 con 0x565470023a80 2024-05-12T11:09:15.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.156+0000 7f65c27fc700 1 -- 172.21.15.86:0/4116085817 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0a96d0 con 0x565470023a80 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4116085817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 msgr2=0x56547001d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/4116085817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x56547001d7c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0a54f0 tx=0x7f65bc007ca0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4116085817 shutdown_connections 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/4116085817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x56547001e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/4116085817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470023540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/4116085817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x56547001d7c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4116085817 >> 172.21.15.86:0/4116085817 conn(0x56546ff49b20 msgr2=0x565470018250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4116085817 shutdown_connections 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4116085817 wait complete. 2024-05-12T11:09:15.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.157+0000 7f65dcc53b80 1 -- start start 2024-05-12T11:09:15.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65dcc53b80 1 Processor -- start 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700297d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470026b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x5654700270b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56547002a400 con 0x565470023a80 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56546ff28e80 con 0x565470023160 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56547002a580 con 0x56547001dd00 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65dcc53b80 10 client.0 _ll_register_callbacks cb 0x56546ff03560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x5654700270b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x5654700270b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51448/0 (socket says 172.21.15.86:51448) 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 -- 172.21.15.86:0/1342248222 learned_addr learned my addr 172.21.15.86:0/1342248222 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65cbfff700 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700297d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470026b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 -- 172.21.15.86:0/1342248222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 msgr2=0x5654700297d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700297d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 -- 172.21.15.86:0/1342248222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 msgr2=0x565470026b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470026b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 -- 172.21.15.86:0/1342248222 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56546ff26710 con 0x565470023a80 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470026b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65d095d700 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x5654700270b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f65c400cff0 tx=0x7f65c40090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f549b833a4342d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.158+0000 7f65ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65ab7fe700 1 -- 172.21.15.86:0/1342248222 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c401f070 con 0x565470023a80 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65ab7fe700 1 -- 172.21.15.86:0/1342248222 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f65c4003c00 con 0x565470023a80 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 1 -- 172.21.15.86:0/1342248222 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65bc0a9470 con 0x565470023a80 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65ab7fe700 1 -- 172.21.15.86:0/1342248222 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65c402b050 con 0x565470023a80 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 10 client.15177 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 1 -- 172.21.15.86:0/1342248222 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565470034db0 con 0x565470023a80 2024-05-12T11:09:15.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65ab7fe700 1 -- 172.21.15.86:0/1342248222 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65bc0a9470 con 0x565470023a80 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65ab7fe700 1 -- 172.21.15.86:0/1342248222 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f65c4011070 con 0x565470023a80 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 10 client.15177 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 10 client.15177 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 20 client.15177 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5654700373c0 0x565470038830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 4 client.15177 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.159+0000 7f65dcc53b80 1 -- 172.21.15.86:0/1342248222 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56546ff7d2d0 con 0x5654700373c0 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.160+0000 7f65cbfff700 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5654700373c0 0x565470038830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.160+0000 7f65ab7fe700 10 client.15177 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.160+0000 7f65cbfff700 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5654700373c0 0x565470038830 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b97d9128df96bc4f server_cookie=ecf8a7093d5da8cf in_seq=0 out_seq=0 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65ab7fe700 1 -- 172.21.15.86:0/1342248222 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56546ff7d2d0 con 0x5654700373c0 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65ab7fe700 10 client.15177 handle_command_reply: tid=0 2024-05-12T11:09:15.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 client.15177 shutdown 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 -- 172.21.15.86:0/1342248222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 msgr2=0x5654700270b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x5654700270b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f65c400cff0 tx=0x7f65c40090d0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 -- 172.21.15.86:0/1342248222 shutdown_connections 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5654700373c0 0x565470038830 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023a80 0x5654700270b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700297d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/1342248222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023160 0x565470026b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 -- 172.21.15.86:0/1342248222 >> 172.21.15.86:0/1342248222 conn(0x56546ff49b20 msgr2=0x565470012ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65ab7fe700 0 client.15177 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 -- 172.21.15.86:0/1342248222 shutdown_connections 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 1 -- 172.21.15.86:0/1342248222 wait complete. 2024-05-12T11:09:15.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.161+0000 7f65dcc53b80 20 client.15177 trim_cache size 0 max 16384 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.181+0000 7f65dcc53b80 1 Processor -- start 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.181+0000 7f65dcc53b80 1 -- start start 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x56547001d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470027120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 0x565470012bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x565470036b70 con 0x565470023160 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x565470037240 con 0x565470023a80 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x565470037910 con 0x56547001dd00 2024-05-12T11:09:15.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470027120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470027120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51464/0 (socket says 172.21.15.86:51464) 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 -- 172.21.15.86:0/4162600585 learned_addr learned my addr 172.21.15.86:0/4162600585 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 -- 172.21.15.86:0/4162600585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 msgr2=0x56547001d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65d095d700 1 --2- 172.21.15.86:0/4162600585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 0x565470012bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/4162600585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x56547001d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 -- 172.21.15.86:0/4162600585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 msgr2=0x565470012bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/4162600585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 0x565470012bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 -- 172.21.15.86:0/4162600585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56547001e600 con 0x565470023160 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/4162600585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470027120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c8f0 tx=0x7f65bc0a9370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836609523245fa07 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65c1ffb700 1 -- 172.21.15.86:0/4162600585 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc01d040 con 0x565470023160 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65c1ffb700 1 -- 172.21.15.86:0/4162600585 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65bc004e90 con 0x565470023160 2024-05-12T11:09:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.182+0000 7f65c1ffb700 1 -- 172.21.15.86:0/4162600585 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0b1e40 con 0x565470023160 2024-05-12T11:09:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4162600585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 msgr2=0x565470027120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/4162600585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470027120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c8f0 tx=0x7f65bc0a9370 comp rx=0 tx=0).stop 2024-05-12T11:09:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4162600585 shutdown_connections 2024-05-12T11:09:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/4162600585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 0x565470012bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/4162600585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x56547001d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/4162600585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470027120 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4162600585 >> 172.21.15.86:0/4162600585 conn(0x56546ff49b20 msgr2=0x565470023e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4162600585 shutdown_connections 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.183+0000 7f65dcc53b80 1 -- 172.21.15.86:0/4162600585 wait complete. 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 1 -- start start 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 1 Processor -- start 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700421a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470011be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 0x565470012120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5654700386b0 con 0x565470023160 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x565470037fe0 con 0x565470023a80 2024-05-12T11:09:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x565470038d80 con 0x56547001dd00 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65dcc53b80 10 client.0 _ll_register_callbacks cb 0x56546ff03560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.184+0000 7f65cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470011be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470011be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51468/0 (socket says 172.21.15.86:51468) 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cb7fe700 1 -- 172.21.15.86:0/2428578377 learned_addr learned my addr 172.21.15.86:0/2428578377 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65d095d700 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 0x565470012120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cbfff700 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cb7fe700 1 -- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 msgr2=0x5654700421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cb7fe700 1 -- 172.21.15.86:0/2428578377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 msgr2=0x565470012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 0x565470012120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cb7fe700 1 -- 172.21.15.86:0/2428578377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565470012910 con 0x565470023160 2024-05-12T11:09:15.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cbfff700 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65cb7fe700 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470011be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0dfcc0 tx=0x7f65bc0b2350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa70752ef07cbf9c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65ab7fe700 1 -- 172.21.15.86:0/2428578377 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0c8060 con 0x565470023160 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65ab7fe700 1 -- 172.21.15.86:0/2428578377 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f65bc0b1e40 con 0x565470023160 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65dcc53b80 1 -- 172.21.15.86:0/2428578377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65bc004e90 con 0x565470023160 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.185+0000 7f65ab7fe700 1 -- 172.21.15.86:0/2428578377 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65bc01d070 con 0x565470023160 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65dcc53b80 10 client.15183 fetch_fsmap learned FSMap version 28 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65dcc53b80 1 -- 172.21.15.86:0/2428578377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654700a6c40 con 0x565470023160 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65ab7fe700 1 -- 172.21.15.86:0/2428578377 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65bc004e90 con 0x565470023160 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65ab7fe700 1 -- 172.21.15.86:0/2428578377 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f65bc0a4de0 con 0x565470023160 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65dcc53b80 10 client.15183 fetch_fsmap finished waiting for FSMap version 28 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65dcc53b80 10 client.15183 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65dcc53b80 20 client.15183 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5654700aad30 0x5654700a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65dcc53b80 4 client.15183 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:15.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65dcc53b80 1 -- 172.21.15.86:0/2428578377 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "status"}) -- 0x56546ff77370 con 0x5654700aad30 2024-05-12T11:09:15.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.186+0000 7f65cbfff700 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5654700aad30 0x5654700a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.187+0000 7f65ab7fe700 10 client.15183 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:15.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.187+0000 7f65cbfff700 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5654700aad30 0x5654700a9a40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4da4064961d099 server_cookie=7d6f6211c163581d in_seq=0 out_seq=0 2024-05-12T11:09:15.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.187+0000 7f65ab7fe700 1 -- 172.21.15.86:0/2428578377 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56546ff77370 con 0x5654700aad30 2024-05-12T11:09:15.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.187+0000 7f65ab7fe700 10 client.15183 handle_command_reply: tid=0 2024-05-12T11:09:15.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.187+0000 7f65dcc53b80 1 client.15183 shutdown 2024-05-12T11:09:15.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.187+0000 7f65dcc53b80 1 -- 172.21.15.86:0/2428578377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 msgr2=0x565470011be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.187+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470011be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0dfcc0 tx=0x7f65bc0b2350 comp rx=0 tx=0).stop 2024-05-12T11:09:15.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 1 -- 172.21.15.86:0/2428578377 shutdown_connections 2024-05-12T11:09:15.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5654700aad30 0x5654700a9a40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565470023a80 0x565470012120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56547001dd00 0x5654700421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65ab7fe700 0 client.15183 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 1 --2- 172.21.15.86:0/2428578377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565470023160 0x565470011be0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 1 -- 172.21.15.86:0/2428578377 >> 172.21.15.86:0/2428578377 conn(0x56546ff49b20 msgr2=0x565470025090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 1 -- 172.21.15.86:0/2428578377 shutdown_connections 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 1 -- 172.21.15.86:0/2428578377 wait complete. 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.188+0000 7f65dcc53b80 20 client.15183 trim_cache size 0 max 16384 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24466, 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 188.01916414199999, 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 28, 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 82, 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 215.62431547700001 2024-05-12T11:09:15.184 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 -- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f65b80b2880 msgr2=0x7f65b80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f65b80b2880 0x7f65b80b4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005950 tx=0x7f65b40058e0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 -- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 msgr2=0x7f65cc19fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 0x7f65cc19fbe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c920 tx=0x7f65bc00cce0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 -- 172.21.15.86:0/2880721518 shutdown_connections 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f65b80b2880 0x7f65b80b4d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc109540 0x7f65cc199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65cc103560 0x7f65cc19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 --2- 172.21.15.86:0/2880721518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65cc103f20 0x7f65cc19fbe0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 -- 172.21.15.86:0/2880721518 >> 172.21.15.86:0/2880721518 conn(0x7f65cc07a660 msgr2=0x7f65cc1021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 -- 172.21.15.86:0/2880721518 shutdown_connections 2024-05-12T11:09:15.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.189+0000 7f65d23c0700 1 -- 172.21.15.86:0/2880721518 wait complete. 2024-05-12T11:09:15.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:15 smithi086 ceph-mon[30110]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:15.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:15 smithi176 ceph-mon[34357]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:15.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:15 smithi172 ceph-mon[34517]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-12T11:09:15.866 INFO:teuthology.run_tasks:Running task sequential... 2024-05-12T11:09:15.877 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-12T11:09:15.877 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-12T11:09:15.877 INFO:teuthology.task.print:Enabling mgr modules 2024-05-12T11:09:15.877 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-05-12T11:09:15.878 INFO:teuthology.task.exec:Executing custom commands... 2024-05-12T11:09:15.878 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:09:15.879 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-05-12T11:09:15.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 -- 172.21.15.86:0/308262638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558103c30 msgr2=0x7ff5581040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 --2- 172.21.15.86:0/308262638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558103c30 0x7ff5581040b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff548009900 tx=0x7ff54802a410 comp rx=0 tx=0).stop 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 -- 172.21.15.86:0/308262638 shutdown_connections 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 --2- 172.21.15.86:0/308262638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5581045f0 0x7ff55810ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 --2- 172.21.15.86:0/308262638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558103c30 0x7ff5581040b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 --2- 172.21.15.86:0/308262638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff558102a40 0x7ff558102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 -- 172.21.15.86:0/308262638 >> 172.21.15.86:0/308262638 conn(0x7ff5580fdfd0 msgr2=0x7ff5581003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 -- 172.21.15.86:0/308262638 shutdown_connections 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 -- 172.21.15.86:0/308262638 wait complete. 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 Processor -- start 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.995+0000 7ff5606a0640 1 -- start start 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff5606a0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558102a40 0x7ff558198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff5606a0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff558103c30 0x7ff5581990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff5606a0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5581045f0 0x7ff5581a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff5606a0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810e550 con 0x7ff558102a40 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff5606a0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810e3d0 con 0x7ff5581045f0 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff5606a0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810e6d0 con 0x7ff558103c30 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558102a40 0x7ff558198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558102a40 0x7ff558198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51482/0 (socket says 172.21.15.86:51482) 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 -- 172.21.15.86:0/276282970 learned_addr learned my addr 172.21.15.86:0/276282970 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 -- 172.21.15.86:0/276282970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff558103c30 msgr2=0x7ff5581990d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff558103c30 0x7ff5581990d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 -- 172.21.15.86:0/276282970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5581045f0 msgr2=0x7ff5581a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5581045f0 0x7ff5581a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 -- 172.21.15.86:0/276282970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5581a07b0 con 0x7ff558102a40 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff55e43c640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558102a40 0x7ff558198b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff55400c970 tx=0x7ff55400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff54f7fe640 1 -- 172.21.15.86:0/276282970 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554004220 con 0x7ff558102a40 2024-05-12T11:09:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff54f7fe640 1 -- 172.21.15.86:0/276282970 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5540043c0 con 0x7ff558102a40 2024-05-12T11:09:15.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5581a0aa0 con 0x7ff558102a40 2024-05-12T11:09:15.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff54f7fe640 1 -- 172.21.15.86:0/276282970 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55400f450 con 0x7ff558102a40 2024-05-12T11:09:15.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.996+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5581a0ff0 con 0x7ff558102a40 2024-05-12T11:09:15.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.997+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff558109d60 con 0x7ff558102a40 2024-05-12T11:09:15.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.998+0000 7ff54f7fe640 1 -- 172.21.15.86:0/276282970 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff554003610 con 0x7ff558102a40 2024-05-12T11:09:15.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.999+0000 7ff54f7fe640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff5440b28a0 0x7ff5440b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:15.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.999+0000 7ff55dc3b640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff5440b28a0 0x7ff5440b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:15.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:15.999+0000 7ff54f7fe640 1 -- 172.21.15.86:0/276282970 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff5540e2010 con 0x7ff558102a40 2024-05-12T11:09:15.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.000+0000 7ff55dc3b640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff5440b28a0 0x7ff5440b4d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff54802a930 tx=0x7ff548000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:15.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.004+0000 7ff54f7fe640 1 -- 172.21.15.86:0/276282970 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff554014030 con 0x7ff558102a40 2024-05-12T11:09:16.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.235+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7ff55802dda0 con 0x7ff558102a40 2024-05-12T11:09:16.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.268+0000 7ff54f7fe640 1 -- 172.21.15.86:0/276282970 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7ff5540a9db0 con 0x7ff558102a40 2024-05-12T11:09:16.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff5440b28a0 msgr2=0x7ff5440b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff5440b28a0 0x7ff5440b4d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff54802a930 tx=0x7ff548000bc0 comp rx=0 tx=0).stop 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558102a40 msgr2=0x7ff558198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558102a40 0x7ff558198b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff55400c970 tx=0x7ff55400ce30 comp rx=0 tx=0).stop 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 shutdown_connections 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7ff5440b28a0 0x7ff5440b4d60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5581045f0 0x7ff5581a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff558103c30 0x7ff5581990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 --2- 172.21.15.86:0/276282970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff558102a40 0x7ff558198b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.271+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 >> 172.21.15.86:0/276282970 conn(0x7ff5580fdfd0 msgr2=0x7ff558106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.272+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 shutdown_connections 2024-05-12T11:09:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:16.272+0000 7ff5606a0640 1 -- 172.21.15.86:0/276282970 wait complete. 2024-05-12T11:09:16.279 INFO:teuthology.run_tasks:Running task kclient... 2024-05-12T11:09:16.304 INFO:tasks.kclient:Mounting kernel clients... 2024-05-12T11:09:16.304 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-12T11:09:16.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:16.304 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-05-12T11:09:16.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:16.322 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-05-12T11:09:16.390 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2024-05-12T11:09:16.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:09:16.392 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-05-12T11:09:16.392 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-12T11:09:16.392 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-12T11:09:16.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-12T11:09:16.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:16 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/276282970' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-12T11:09:16.516 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: ignoring --setuser ceph since I am not root 2024-05-12T11:09:16.516 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: ignoring --setgroup ceph since I am not root 2024-05-12T11:09:16.516 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:16 smithi176 ceph-mgr[36380]: -- 172.21.15.176:0/2372301261 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55db40b6a5a0 con 0x55db40b3e800 2024-05-12T11:09:16.516 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:16.446+0000 7fa48f6e0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T11:09:16.626 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:16 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/276282970' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-12T11:09:16.627 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: ignoring --setuser ceph since I am not root 2024-05-12T11:09:16.627 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: ignoring --setgroup ceph since I am not root 2024-05-12T11:09:16.627 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:16 smithi172 ceph-mgr[35909]: -- 172.21.15.172:0/3879547906 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e66b9945a0 con 0x55e66b968800 2024-05-12T11:09:16.627 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:16.449+0000 7f62019de200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T11:09:16.627 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:16.635+0000 7f62019de200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T11:09:16.644 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:16 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/276282970' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-12T11:09:16.645 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: ignoring --setuser ceph since I am not root 2024-05-12T11:09:16.645 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: ignoring --setgroup ceph since I am not root 2024-05-12T11:09:16.645 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:16.456+0000 7f2c940ad200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T11:09:16.645 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:16.653+0000 7f2c940ad200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T11:09:16.686 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:16.961 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:16.774+0000 7f2c940ad200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T11:09:16.972 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:16.738+0000 7f62019de200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T11:09:17.016 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:16.631+0000 7fa48f6e0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T11:09:17.016 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:16.732+0000 7fa48f6e0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T11:09:17.212 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:17 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:17.091+0000 7f2c940ad200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T11:09:17.212 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:17 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:17.185+0000 7f2c940ad200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T11:09:17.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:17 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/276282970' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-12T11:09:17.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:17 smithi172 ceph-mon[34517]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-12T11:09:17.473 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:17 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:17.048+0000 7f62019de200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T11:09:17.473 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:17 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:17.134+0000 7f62019de200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T11:09:17.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:17 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/276282970' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-12T11:09:17.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:17 smithi176 ceph-mon[34357]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-12T11:09:17.516 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:17 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:17.036+0000 7fa48f6e0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T11:09:17.516 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:17 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:17.121+0000 7fa48f6e0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T11:09:17.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:17 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/276282970' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-12T11:09:17.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:17 smithi086 ceph-mon[30110]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-12T11:09:18.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 -- 172.21.15.86:0/1643403670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af4103ee0 msgr2=0x7f9af4110370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:18.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1643403670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af4103ee0 0x7f9af4110370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00b0a0 tx=0x7f9aec00b3b0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 -- 172.21.15.86:0/1643403670 shutdown_connections 2024-05-12T11:09:18.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1643403670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af4103ee0 0x7f9af4110370 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1643403670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af4109530 0x7f9af4109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1643403670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4103520 0x7f9af41039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 -- 172.21.15.86:0/1643403670 >> 172.21.15.86:0/1643403670 conn(0x7f9af407a650 msgr2=0x7f9af407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:18.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 -- 172.21.15.86:0/1643403670 shutdown_connections 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.378+0000 7f9afbec0700 1 -- 172.21.15.86:0/1643403670 wait complete. 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afbec0700 1 Processor -- start 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afbec0700 1 -- start start 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afbec0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4103520 0x7f9af40757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afbec0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af4103ee0 0x7f9af4075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afbec0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af4109530 0x7f9af4076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afbec0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4113660 con 0x7f9af4109530 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afbec0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41134e0 con 0x7f9af4103520 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afbec0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41137e0 con 0x7f9af4103ee0 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af9c5c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4103520 0x7f9af40757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af9c5c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4103520 0x7f9af40757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.86:43290/0 (socket says 172.21.15.86:43290) 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af9c5c700 1 -- 172.21.15.86:0/1597686772 learned_addr learned my addr 172.21.15.86:0/1597686772 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af945b700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af4103ee0 0x7f9af4075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9afa45d700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af4109530 0x7f9af4076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:18.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af945b700 1 -- 172.21.15.86:0/1597686772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4103520 msgr2=0x7f9af40757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af945b700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4103520 0x7f9af40757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af945b700 1 -- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af4109530 msgr2=0x7f9af4076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af945b700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af4109530 0x7f9af4076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af945b700 1 -- 172.21.15.86:0/1597686772 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af41a7fa0 con 0x7f9af4103ee0 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.379+0000 7f9af9c5c700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4103520 0x7f9af40757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.380+0000 7f9af945b700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af4103ee0 0x7f9af4075ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400d750 tx=0x7f9ae400da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.380+0000 7f9aeaffd700 1 -- 172.21.15.86:0/1597686772 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4014030 con 0x7f9af4103ee0 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.380+0000 7f9aeaffd700 1 -- 172.21.15.86:0/1597686772 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ae40044d0 con 0x7f9af4103ee0 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.380+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af41a8290 con 0x7f9af4103ee0 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.380+0000 7f9aeaffd700 1 -- 172.21.15.86:0/1597686772 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4005420 con 0x7f9af4103ee0 2024-05-12T11:09:18.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.380+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af41a87d0 con 0x7f9af4103ee0 2024-05-12T11:09:18.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.381+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af406a190 con 0x7f9af4103ee0 2024-05-12T11:09:18.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.382+0000 7f9aeaffd700 1 -- 172.21.15.86:0/1597686772 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f9ae4004a50 con 0x7f9af4103ee0 2024-05-12T11:09:18.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.383+0000 7f9aeaffd700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ae00b28d0 0x7f9ae00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:18.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.383+0000 7f9af9c5c700 1 -- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ae00b28d0 msgr2=0x7f9ae00b4d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/155657181 2024-05-12T11:09:18.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.383+0000 7f9aeaffd700 1 -- 172.21.15.86:0/1597686772 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9ae40e2210 con 0x7f9af4103ee0 2024-05-12T11:09:18.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.383+0000 7f9af9c5c700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ae00b28d0 0x7f9ae00b4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T11:09:18.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.386+0000 7f9aeaffd700 1 -- 172.21.15.86:0/1597686772 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9ae40a9eb0 con 0x7f9af4103ee0 2024-05-12T11:09:18.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.584+0000 7f9af9c5c700 1 -- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ae00b28d0 msgr2=0x7f9ae00b4d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/155657181 2024-05-12T11:09:18.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.584+0000 7f9af9c5c700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ae00b28d0 0x7f9ae00b4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T11:09:18.624 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:18.293+0000 7fa48f6e0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T11:09:18.624 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:18.463+0000 7fa48f6e0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T11:09:18.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.643+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9af402e6d0 con 0x7f9af4103ee0 2024-05-12T11:09:18.634 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:18.410+0000 7f2c940ad200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T11:09:18.634 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:18.588+0000 7f2c940ad200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T11:09:18.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.643+0000 7f9aeaffd700 1 -- 172.21.15.86:0/1597686772 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f9ae40a97b0 con 0x7f9af4103ee0 2024-05-12T11:09:18.635 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ae00b28d0 msgr2=0x7f9ae00b4d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ae00b28d0 0x7f9ae00b4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af4103ee0 msgr2=0x7f9af4075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af4103ee0 0x7f9af4075ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400d750 tx=0x7f9ae400da60 comp rx=0 tx=0).stop 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 shutdown_connections 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f9ae00b28d0 0x7f9ae00b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af4109530 0x7f9af4076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4103520 0x7f9af40757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 --2- 172.21.15.86:0/1597686772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af4103ee0 0x7f9af4075ce0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 >> 172.21.15.86:0/1597686772 conn(0x7f9af407a650 msgr2=0x7f9af41021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 shutdown_connections 2024-05-12T11:09:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:18.646+0000 7f9afbec0700 1 -- 172.21.15.86:0/1597686772 wait complete. 2024-05-12T11:09:18.664 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:18.328+0000 7f62019de200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T11:09:18.664 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:18.501+0000 7f62019de200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T11:09:18.664 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:18.673+0000 7f62019de200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T11:09:18.909 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:18 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1597686772' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-12T11:09:18.910 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:18.633+0000 7fa48f6e0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T11:09:18.954 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:18 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1597686772' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-12T11:09:18.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:18 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1597686772' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-12T11:09:18.962 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:18.767+0000 7f2c940ad200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T11:09:19.203 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:18.918+0000 7fa48f6e0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T11:09:19.203 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:19.009+0000 7fa48f6e0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T11:09:19.203 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:19.212+0000 7fa48f6e0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T11:09:19.222 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:18.964+0000 7f62019de200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T11:09:19.223 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:19 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:19.056+0000 7f62019de200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T11:09:19.294 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:19.063+0000 7f2c940ad200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T11:09:19.294 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:19.157+0000 7f2c940ad200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T11:09:19.324 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-12T11:09:19.324 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-12T11:09:19.324 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-05-12T11:09:19.325 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-12T11:09:19.325 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-12T11:09:19.325 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-12T11:09:19.325 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-12T11:09:19.325 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-12T11:09:19.325 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-12T11:09:19.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:19.325 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-05-12T11:09:19.342 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-05-12T11:09:19.343 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-12T11:09:19.343 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-05-12T11:09:19.343 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-12T11:09:19.343 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-05-12T11:09:19.343 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-12T11:09:19.343 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42071sec preferred_lft 42071sec 2024-05-12T11:09:19.343 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2024-05-12T11:09:19.343 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-05-12T11:09:19.343 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-12T11:09:19.343 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T11:09:19.344 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-05-12T11:09:19.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-05-12T11:09:19.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-05-12T11:09:19.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-05-12T11:09:19.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-12T11:09:19.344 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-05-12T11:09:19.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T11:09:19.516 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:19.405+0000 7fa48f6e0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T11:09:19.546 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:19.369+0000 7f2c940ad200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T11:09:19.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:19.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:19.567 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-12T11:09:19.593 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-05-12T11:09:19.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:19.595 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-05-12T11:09:19.662 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-05-12T11:09:19.662 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-12T11:09:19.662 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-12T11:09:19.662 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-12T11:09:19.662 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-12T11:09:19.663 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T11:09:19.663 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-05-12T11:09:19.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-12T11:09:19.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-12T11:09:19.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-12T11:09:19.663 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-05-12T11:09:19.723 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:19 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:19.262+0000 7f62019de200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T11:09:19.723 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:19 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:19.457+0000 7f62019de200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T11:09:19.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T11:09:19.848 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:19.578+0000 7f2c940ad200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T11:09:19.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:19.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:19.942 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-05-12T11:09:19.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:19.958 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-05-12T11:09:20.015 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T11:09:20.015 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-05-12T11:09:20.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T11:09:20.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-12T11:09:20.015 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-05-12T11:09:20.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T11:09:20.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:20.137 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-12T11:09:20.137 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T11:09:20.138 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-05-12T11:09:20.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-12T11:09:20.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-12T11:09:20.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-12T11:09:20.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-12T11:09:20.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-12T11:09:20.138 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-05-12T11:09:20.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T11:09:20.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:20.265 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:20.005+0000 7fa48f6e0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-12T11:09:20.266 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:20.225+0000 7fa48f6e0200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-12T11:09:20.273 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T11:09:20.273 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-05-12T11:09:20.273 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-05-12T11:09:20.274 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-05-12T11:09:20.274 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-05-12T11:09:20.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T11:09:20.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:20.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-12T11:09:20.358 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-12T11:09:20.374 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-12T11:09:20.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-12T11:09:20.374 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-12T11:09:20.431 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-12T11:09:20.431 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-12T11:09:20.431 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/e6561063-68f8-4dc8-9ff1-e27e8a490917 2024-05-12T11:09:20.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:20.431 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/e6561063-68f8-4dc8-9ff1-e27e8a490917 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-12T11:09:20.461 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:20.222+0000 7f2c940ad200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-12T11:09:20.461 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:20.470+0000 7f2c940ad200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-12T11:09:20.473 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:20 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:20.068+0000 7f62019de200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-12T11:09:20.473 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:20 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:20.288+0000 7f62019de200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-12T11:09:20.516 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-12T11:09:20.516 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-12T11:09:20.516 INFO:teuthology.orchestra.run.smithi086.stdout:invalid new device string format 2024-05-12T11:09:20.631 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-12T11:09:20.631 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-12T11:09:20.631 INFO:teuthology.orchestra.run.smithi086.stdout:invalid new device string format 2024-05-12T11:09:20.631 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.172:3300,172.21.15.176:3300" 2024-05-12T11:09:20.631 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.86:3300,172.21.15.172:3300,172.21.15.176:3300:/volumes/qa/sv_1/e6561063-68f8-4dc8-9ff1-e27e8a490917 2024-05-12T11:09:20.631 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=513c80a2-104e-11ef-bc98-c7b262605968" will pass to kernel 2024-05-12T11:09:20.632 INFO:teuthology.orchestra.run.smithi086.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-12T11:09:20.632 INFO:teuthology.orchestra.run.smithi086.stdout: You just mounted a file system that supports labels which does not 2024-05-12T11:09:20.632 INFO:teuthology.orchestra.run.smithi086.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-12T11:09:20.632 INFO:teuthology.orchestra.run.smithi086.stdout: applications will generate AVC messages and not be allowed access to 2024-05-12T11:09:20.632 INFO:teuthology.orchestra.run.smithi086.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-12T11:09:20.634 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-12T11:09:20.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:09:20.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-12T11:09:20.663 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-12T11:09:20.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-12T11:09:20.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:20.762 INFO:teuthology.orchestra.run.smithi086.stdout:client24758 2024-05-12T11:09:20.762 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T11:09:20.762 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T11:09:20.779 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-12T11:09:20.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-12T11:09:20.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:20.877 INFO:teuthology.orchestra.run.smithi086.stdout:client24758 2024-05-12T11:09:20.877 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-12T11:09:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-12T11:09:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:20.935 INFO:teuthology.orchestra.run.smithi086.stdout:client24758 2024-05-12T11:09:20.935 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/513c80a2-104e-11ef-bc98-c7b262605968.client24758/status') 2024-05-12T11:09:20.973 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:20 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:20.718+0000 7f62019de200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T11:09:20.973 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:20 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:20.815+0000 7f62019de200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T11:09:20.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T11:09:20.995 INFO:teuthology.orchestra.run.smithi086.stdout:instance: client.24758 (3)172.21.15.86:0/2267072650 2024-05-12T11:09:20.995 INFO:teuthology.orchestra.run.smithi086.stdout:blocklisted: false 2024-05-12T11:09:20.995 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records in 2024-05-12T11:09:20.995 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records out 2024-05-12T11:09:20.995 INFO:teuthology.orchestra.run.smithi086.stderr:71 bytes copied, 2.1771e-05 s, 3.3 MB/s 2024-05-12T11:09:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T11:09:21.003 INFO:teuthology.run_tasks:Running task exec... 2024-05-12T11:09:21.012 INFO:teuthology.task.exec:Executing custom commands... 2024-05-12T11:09:21.012 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:09:21.012 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-12T11:09:21.016 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:20.653+0000 7fa48f6e0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T11:09:21.016 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:20.751+0000 7fa48f6e0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T11:09:21.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 -- 172.21.15.86:0/283240226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034101930 msgr2=0x7f7034101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 --2- 172.21.15.86:0/283240226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034101930 0x7f7034101d50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7024009900 tx=0x7f702402a410 comp rx=0 tx=0).stop 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 -- 172.21.15.86:0/283240226 shutdown_connections 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 --2- 172.21.15.86:0/283240226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70341034e0 0x7f7034109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 --2- 172.21.15.86:0/283240226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7034102b20 0x7f7034102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 --2- 172.21.15.86:0/283240226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034101930 0x7f7034101d50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 -- 172.21.15.86:0/283240226 >> 172.21.15.86:0/283240226 conn(0x7f70340fcea0 msgr2=0x7f70340ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 -- 172.21.15.86:0/283240226 shutdown_connections 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.125+0000 7f703bb90640 1 -- 172.21.15.86:0/283240226 wait complete. 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703bb90640 1 Processor -- start 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703bb90640 1 -- start start 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703bb90640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7034101930 0x7f70341058c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703bb90640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034102b20 0x7f7034103f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:21.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703bb90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70341034e0 0x7f7034104440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703bb90640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f703410d460 con 0x7f7034102b20 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703bb90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f703410d2e0 con 0x7f70341034e0 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703bb90640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f703410d5e0 con 0x7f7034101930 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703912b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034102b20 0x7f7034103f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703912b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034102b20 0x7f7034103f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51530/0 (socket says 172.21.15.86:51530) 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703912b640 1 -- 172.21.15.86:0/3681030473 learned_addr learned my addr 172.21.15.86:0/3681030473 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703a12d640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70341034e0 0x7f7034104440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703992c640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7034101930 0x7f70341058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703912b640 1 -- 172.21.15.86:0/3681030473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7034101930 msgr2=0x7f70341058c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703912b640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7034101930 0x7f70341058c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703912b640 1 -- 172.21.15.86:0/3681030473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70341034e0 msgr2=0x7f7034104440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:21.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703912b640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70341034e0 0x7f7034104440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.126+0000 7f703912b640 1 -- 172.21.15.86:0/3681030473 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7034104cd0 con 0x7f7034102b20 2024-05-12T11:09:21.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.127+0000 7f703912b640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034102b20 0x7f7034103f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f703000d950 tx=0x7f703000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:21.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.127+0000 7f702affd640 1 -- 172.21.15.86:0/3681030473 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030017030 con 0x7f7034102b20 2024-05-12T11:09:21.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.127+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70341a2ce0 con 0x7f7034102b20 2024-05-12T11:09:21.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.127+0000 7f702affd640 1 -- 172.21.15.86:0/3681030473 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7030004020 con 0x7f7034102b20 2024-05-12T11:09:21.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.127+0000 7f702affd640 1 -- 172.21.15.86:0/3681030473 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70300047a0 con 0x7f7034102b20 2024-05-12T11:09:21.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.127+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70341a31d0 con 0x7f7034102b20 2024-05-12T11:09:21.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.128+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70341a34c0 con 0x7f7034102b20 2024-05-12T11:09:21.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.129+0000 7f702affd640 1 -- 172.21.15.86:0/3681030473 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f7030009a30 con 0x7f7034102b20 2024-05-12T11:09:21.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.130+0000 7f702affd640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f70200b28f0 0x7f70200b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:21.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.130+0000 7f703992c640 1 -- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f70200b28f0 msgr2=0x7f70200b4db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/155657181 2024-05-12T11:09:21.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.130+0000 7f702affd640 1 -- 172.21.15.86:0/3681030473 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f70300e2300 con 0x7f7034102b20 2024-05-12T11:09:21.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.130+0000 7f703992c640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f70200b28f0 0x7f70200b4db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T11:09:21.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.134+0000 7f702affd640 1 -- 172.21.15.86:0/3681030473 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f70300aa000 con 0x7f7034102b20 2024-05-12T11:09:21.212 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:20.927+0000 7f2c940ad200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T11:09:21.212 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:21.033+0000 7f2c940ad200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T11:09:21.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.331+0000 7f703992c640 1 -- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f70200b28f0 msgr2=0x7f70200b4db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/155657181 2024-05-12T11:09:21.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.331+0000 7f703992c640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f70200b28f0 0x7f70200b4db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T11:09:21.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.360+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f70341a3850 con 0x7f7034102b20 2024-05-12T11:09:21.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.412+0000 7f702affd640 1 -- 172.21.15.86:0/3681030473 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f70300a9900 con 0x7f7034102b20 2024-05-12T11:09:21.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f70200b28f0 msgr2=0x7f70200b4db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f70200b28f0 0x7f70200b4db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034102b20 msgr2=0x7f7034103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034102b20 0x7f7034103f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f703000d950 tx=0x7f703000de10 comp rx=0 tx=0).stop 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 shutdown_connections 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f70200b28f0 0x7f70200b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70341034e0 0x7f7034104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7034102b20 0x7f7034103f00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 --2- 172.21.15.86:0/3681030473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7034101930 0x7f70341058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 >> 172.21.15.86:0/3681030473 conn(0x7f70340fcea0 msgr2=0x7f70340fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 shutdown_connections 2024-05-12T11:09:21.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.415+0000 7f703bb90640 1 -- 172.21.15.86:0/3681030473 wait complete. 2024-05-12T11:09:21.408 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:21.123+0000 7fa48f6e0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-12T11:09:21.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-12T11:09:21.472 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:21 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:21.188+0000 7f62019de200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-12T11:09:21.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:21 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3681030473' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-12T11:09:21.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 -- 172.21.15.86:0/1964971536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 msgr2=0x7f780c1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:21.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 --2- 172.21.15.86:0/1964971536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 0x7f780c1058a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009900 tx=0x7f77fc02a410 comp rx=0 tx=0).stop 2024-05-12T11:09:21.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 -- 172.21.15.86:0/1964971536 shutdown_connections 2024-05-12T11:09:21.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 --2- 172.21.15.86:0/1964971536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f780c108710 0x7f780c10ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 --2- 172.21.15.86:0/1964971536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f780c105de0 0x7f780c1081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 --2- 172.21.15.86:0/1964971536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 0x7f780c1058a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 -- 172.21.15.86:0/1964971536 >> 172.21.15.86:0/1964971536 conn(0x7f780c0fcec0 msgr2=0x7f780c0ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 -- 172.21.15.86:0/1964971536 shutdown_connections 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.532+0000 7f7810c00640 1 -- 172.21.15.86:0/1964971536 wait complete. 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7810c00640 1 Processor -- start 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7810c00640 1 -- start start 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7810c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 0x7f780c102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7810c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f780c105de0 0x7f780c101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7810c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f780c108710 0x7f780c1019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7810c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f780c10e590 con 0x7f780c1034b0 2024-05-12T11:09:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7810c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f780c10e410 con 0x7f780c108710 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7810c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f780c10e710 con 0x7f780c105de0 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f780a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 0x7f780c102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f780a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 0x7f780c102e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33314/0 (socket says 172.21.15.86:33314) 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f780a59c640 1 -- 172.21.15.86:0/492352505 learned_addr learned my addr 172.21.15.86:0/492352505 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f7809d9b640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f780c105de0 0x7f780c101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.533+0000 7f780ad9d640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f780c108710 0x7f780c1019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f780a59c640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f780c105de0 msgr2=0x7f780c101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f780a59c640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f780c105de0 0x7f780c101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f780a59c640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f780c108710 msgr2=0x7f780c1019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f780a59c640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f780c108710 0x7f780c1019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f780a59c640 1 -- 172.21.15.86:0/492352505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c102230 con 0x7f780c1034b0 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f780a59c640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 0x7f780c102e20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f77fc005940 tx=0x7f77fc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc03f030 con 0x7f780c1034b0 2024-05-12T11:09:21.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780c1a2cc0 con 0x7f780c1034b0 2024-05-12T11:09:21.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77fc003aa0 con 0x7f780c1034b0 2024-05-12T11:09:21.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc035070 con 0x7f780c1034b0 2024-05-12T11:09:21.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.534+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780c1a31b0 con 0x7f780c1034b0 2024-05-12T11:09:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.535+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780c0fe9b0 con 0x7f780c1034b0 2024-05-12T11:09:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.537+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f77fc042030 con 0x7f780c1034b0 2024-05-12T11:09:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.537+0000 7f77fb7fe640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 0x7f77f40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.537+0000 7f7809d9b640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 msgr2=0x7f77f40b4db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/155657181 2024-05-12T11:09:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.537+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f77fc102ed0 con 0x7f780c1034b0 2024-05-12T11:09:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.537+0000 7f7809d9b640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 0x7f77f40b4db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T11:09:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.545+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f77fc0ca580 con 0x7f780c1034b0 2024-05-12T11:09:21.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:21 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3681030473' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-12T11:09:21.712 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:21.420+0000 7f2c940ad200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-12T11:09:21.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.738+0000 7f7809d9b640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 msgr2=0x7f77f40b4db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/155657181 2024-05-12T11:09:21.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.738+0000 7f7809d9b640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 0x7f77f40b4db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T11:09:21.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:21.761+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 --> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f780c062f50 con 0x7f77f40b28f0 2024-05-12T11:09:21.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:21 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3681030473' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-12T11:09:21.766 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:21.488+0000 7fa48f6e0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T11:09:21.766 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:21.583+0000 7fa48f6e0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T11:09:21.881 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:21 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:21.550+0000 7f62019de200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T11:09:21.881 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:21 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:21.644+0000 7f62019de200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T11:09:22.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:22.139+0000 7f7809d9b640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 msgr2=0x7f77f40b4db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/155657181 2024-05-12T11:09:22.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:22.139+0000 7f7809d9b640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 0x7f77f40b4db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T11:09:22.139 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:21.803+0000 7f2c940ad200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T11:09:22.139 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:21.898+0000 7f2c940ad200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T11:09:22.223 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:21 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:21.890+0000 7f62019de200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T11:09:22.223 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:22.024+0000 7f62019de200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T11:09:22.223 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:22.120+0000 7f62019de200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T11:09:22.266 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:21.829+0000 7fa48f6e0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T11:09:22.266 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:21.964+0000 7fa48f6e0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T11:09:22.266 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:22.061+0000 7fa48f6e0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T11:09:22.410 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:22.148+0000 7f2c940ad200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T11:09:22.410 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:22.287+0000 7f2c940ad200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T11:09:22.410 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:22.388+0000 7f2c940ad200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T11:09:22.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:22 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3681030473' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-12T11:09:22.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:22 smithi086 ceph-mon[30110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:09:22.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:22 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3681030473' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-12T11:09:22.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:22 smithi172 ceph-mon[34517]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:09:22.723 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:22.456+0000 7f62019de200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T11:09:22.723 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:22.549+0000 7f62019de200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T11:09:22.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:22 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3681030473' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-12T11:09:22.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:22 smithi176 ceph-mon[34357]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-12T11:09:22.766 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:22.397+0000 7fa48f6e0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T11:09:22.766 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:22.492+0000 7fa48f6e0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T11:09:22.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:22.940+0000 7f7809d9b640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 msgr2=0x7f77f40b4db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/155657181 2024-05-12T11:09:22.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:22.940+0000 7f7809d9b640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 0x7f77f40b4db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T11:09:22.962 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:22.719+0000 7f2c940ad200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T11:09:22.962 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:22.815+0000 7f2c940ad200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T11:09:23.412 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:23 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:23.152+0000 7f62019de200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T11:09:23.412 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:09:23 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y[35905]: 2024-05-12T11:09:23.370+0000 7f62019de200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T11:09:23.412 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:23.096+0000 7fa48f6e0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T11:09:23.412 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:09:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z[36375]: 2024-05-12T11:09:23.314+0000 7fa48f6e0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T11:09:23.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:23.435+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 20) ==== 149669+0+0 (secure 0 0 0) 0x7f77fc0c6810 con 0x7f780c1034b0 2024-05-12T11:09:23.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:23.673+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 21) ==== 149337+0+0 (secure 0 0 0) 0x7f77fc047120 con 0x7f780c1034b0 2024-05-12T11:09:23.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:23.673+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 msgr2=0x7f77f40b4db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-12T11:09:23.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:23.673+0000 7f77fb7fe640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/155657181,v1:172.21.15.86:6801/155657181] conn(0x7f77f40b28f0 0x7f77f40b4db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:23.712 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.435+0000 7f2c940ad200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T11:09:23.712 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.659+0000 7f2c940ad200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T11:09:23.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: Standby manager daemon z restarted 2024-05-12T11:09:23.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: Standby manager daemon z started 2024-05-12T11:09:23.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-12T11:09:23.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:09:23.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-12T11:09:23.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:09:23.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: Standby manager daemon y restarted 2024-05-12T11:09:23.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: Standby manager daemon y started 2024-05-12T11:09:23.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-12T11:09:23.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:09:23.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-12T11:09:23.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:23 smithi086 ceph-mon[30110]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: Standby manager daemon z restarted 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: Standby manager daemon z started 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: Standby manager daemon y restarted 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: Standby manager daemon y started 2024-05-12T11:09:23.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-12T11:09:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:09:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-12T11:09:23.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:23 smithi172 ceph-mon[34517]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:09:23.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: Standby manager daemon z restarted 2024-05-12T11:09:23.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: Standby manager daemon z started 2024-05-12T11:09:23.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-12T11:09:23.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:09:23.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-12T11:09:23.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.176:0/274784882' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:09:23.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: Standby manager daemon y restarted 2024-05-12T11:09:23.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: Standby manager daemon y started 2024-05-12T11:09:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-12T11:09:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-12T11:09:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-12T11:09:23.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:23 smithi176 ceph-mon[34357]: from='mgr.? 172.21.15.172:0/3139138321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-12T11:09:24.212 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.913+0000 7f2bf4107700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.212 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.913+0000 7f2bf4107700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.212 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.913+0000 7f2bf4107700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.212 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.913+0000 7f2bf4107700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.913+0000 7f2bf4107700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.914+0000 7f2bf18c2700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.914+0000 7f2bf18c2700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.914+0000 7f2bf18c2700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.914+0000 7f2bf18c2700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.213 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:23.914+0000 7f2bf18c2700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.680+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mon.0 v2:172.21.15.86:3300/0 9 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7f77fc100a00 con 0x7f780c1034b0 2024-05-12T11:09:24.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.681+0000 7f77fb7fe640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f77f403a360 0x7f77f403a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:24.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.681+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f780c062f50 con 0x7f77f403a360 2024-05-12T11:09:24.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.686+0000 7f7809d9b640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f77f403a360 0x7f77f403a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.688+0000 7f7809d9b640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f77f403a360 0x7f77f403a740 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f780c102b90 tx=0x7f7800005f90 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:24.688 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-05-12T11:09:24.688 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: Active manager daemon x restarted 2024-05-12T11:09:24.688 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: Activating manager daemon x 2024-05-12T11:09:24.688 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: osdmap e83: 12 total, 12 up, 12 in 2024-05-12T11:09:24.688 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: mgrmap e21: x(active, starting, since 0.0116784s), standbys: y, z 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:09:24.689 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:09:24.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: Manager daemon x is now available 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-12T11:09:24.691 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:24 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-12T11:09:24.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.710+0000 7f77fb7fe640 1 -- 172.21.15.86:0/492352505 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f780c062f50 con 0x7f77f403a360 2024-05-12T11:09:24.701 INFO:teuthology.orchestra.run.smithi086.stdout:{} 2024-05-12T11:09:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f77f403a360 msgr2=0x7f77f403a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f7810c00640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f77f403a360 0x7f77f403a740 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f780c102b90 tx=0x7f7800005f90 comp rx=0 tx=0).stop 2024-05-12T11:09:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 msgr2=0x7f780c102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f7810c00640 1 --2- 172.21.15.86:0/492352505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f780c1034b0 0x7f780c102e20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f77fc005940 tx=0x7f77fc031a50 comp rx=0 tx=0).stop 2024-05-12T11:09:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f780ad9d640 1 -- 172.21.15.86:0/492352505 reap_dead start 2024-05-12T11:09:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 shutdown_connections 2024-05-12T11:09:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 >> 172.21.15.86:0/492352505 conn(0x7f780c0fcec0 msgr2=0x7f780c104070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 shutdown_connections 2024-05-12T11:09:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.712+0000 7f7810c00640 1 -- 172.21.15.86:0/492352505 wait complete. 2024-05-12T11:09:24.714 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-12T11:09:24.726 INFO:teuthology.run_tasks:Running task exec... 2024-05-12T11:09:24.742 INFO:teuthology.task.exec:Executing custom commands... 2024-05-12T11:09:24.742 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:09:24.742 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-05-12T11:09:24.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-05-12T11:09:24.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: Active manager daemon x restarted 2024-05-12T11:09:24.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: Activating manager daemon x 2024-05-12T11:09:24.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: osdmap e83: 12 total, 12 up, 12 in 2024-05-12T11:09:24.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: mgrmap e21: x(active, starting, since 0.0116784s), standbys: y, z 2024-05-12T11:09:24.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:09:24.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:09:24.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-12T11:09:24.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-12T11:09:24.745 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-12T11:09:24.746 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: Manager daemon x is now available 2024-05-12T11:09:24.746 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:24.746 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-12T11:09:24.746 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:24 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-12T11:09:24.766 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: Active manager daemon x restarted 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: Activating manager daemon x 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: osdmap e83: 12 total, 12 up, 12 in 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: mgrmap e21: x(active, starting, since 0.0116784s), standbys: y, z 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:09:24.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-12T11:09:24.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: Manager daemon x is now available 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-12T11:09:24.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:24 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-12T11:09:24.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 -- 172.21.15.86:0/1720517270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 msgr2=0x7fb2e8108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/1720517270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 0x7fb2e8108270 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009900 tx=0x7fb2d402a410 comp rx=0 tx=0).stop 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 -- 172.21.15.86:0/1720517270 shutdown_connections 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/1720517270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e81087b0 0x7fb2e810aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/1720517270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 0x7fb2e8108270 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/1720517270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e8103550 0x7fb2e8105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 -- 172.21.15.86:0/1720517270 >> 172.21.15.86:0/1720517270 conn(0x7fb2e80fce60 msgr2=0x7fb2e80ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 -- 172.21.15.86:0/1720517270 shutdown_connections 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.860+0000 7fb2eef0a640 1 -- 172.21.15.86:0/1720517270 wait complete. 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2eef0a640 1 Processor -- start 2024-05-12T11:09:24.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2eef0a640 1 -- start start 2024-05-12T11:09:24.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2eef0a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e8103550 0x7fb2e8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:24.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2eef0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 0x7fb2e8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2eef0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e81087b0 0x7fb2e81a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2eef0a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810e620 con 0x7fb2e8105e80 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2eef0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810e4a0 con 0x7fb2e81087b0 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2eef0a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810e7a0 con 0x7fb2e8103550 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.861+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 0x7fb2e8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 0x7fb2e8199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33470/0 (socket says 172.21.15.86:33470) 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e7fff640 1 -- 172.21.15.86:0/3975489857 learned_addr learned my addr 172.21.15.86:0/3975489857 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2ecca6640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e8103550 0x7fb2e8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e7fff640 1 -- 172.21.15.86:0/3975489857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e8103550 msgr2=0x7fb2e8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e7fff640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e8103550 0x7fb2e8198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e7fff640 1 -- 172.21.15.86:0/3975489857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e81087b0 msgr2=0x7fb2e81a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2ed4a7640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e81087b0 0x7fb2e81a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:24.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e7fff640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e81087b0 0x7fb2e81a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e7fff640 1 -- 172.21.15.86:0/3975489857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e81a0950 con 0x7fb2e8105e80 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2ed4a7640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e81087b0 0x7fb2e81a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e7fff640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 0x7fb2e8199280 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4006010 tx=0x7fb2d4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e5ffb640 1 -- 172.21.15.86:0/3975489857 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d403f030 con 0x7fb2e8105e80 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e5ffb640 1 -- 172.21.15.86:0/3975489857 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2d4003cb0 con 0x7fb2e8105e80 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2e5ffb640 1 -- 172.21.15.86:0/3975489857 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4035070 con 0x7fb2e8105e80 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e81a0be0 con 0x7fb2e8105e80 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.862+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e81a10d0 con 0x7fb2e8105e80 2024-05-12T11:09:24.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.863+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e80fe950 con 0x7fb2e8105e80 2024-05-12T11:09:24.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.865+0000 7fb2e5ffb640 1 -- 172.21.15.86:0/3975489857 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7fb2d4042030 con 0x7fb2e8105e80 2024-05-12T11:09:24.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.866+0000 7fb2e5ffb640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb2d80b2690 0x7fb2d80b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:24.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.866+0000 7fb2ecca6640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb2d80b2690 0x7fb2d80b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:24.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.866+0000 7fb2e5ffb640 1 -- 172.21.15.86:0/3975489857 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fb2d4102a70 con 0x7fb2e8105e80 2024-05-12T11:09:24.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.866+0000 7fb2ecca6640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb2d80b2690 0x7fb2d80b4b50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb2e819a210 tx=0x7fb2dc009110 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:24.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:24.869+0000 7fb2e5ffb640 1 -- 172.21.15.86:0/3975489857 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb2d40ca920 con 0x7fb2e8105e80 2024-05-12T11:09:24.962 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:24.696+0000 7f2bef8be700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.962 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:24.696+0000 7f2bef8be700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:24.696+0000 7f2bef8be700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:24.696+0000 7f2bef8be700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:24.963 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:09:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:09:24.696+0000 7f2bef8be700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:09:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.063+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fb2e80636c0 con 0x7fb2e8105e80 2024-05-12T11:09:25.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.067+0000 7fb2e5ffb640 1 -- 172.21.15.86:0/3975489857 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7fb2d4003e60 con 0x7fb2e8105e80 2024-05-12T11:09:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb2d80b2690 msgr2=0x7fb2d80b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb2d80b2690 0x7fb2d80b4b50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb2e819a210 tx=0x7fb2dc009110 comp rx=0 tx=0).stop 2024-05-12T11:09:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 msgr2=0x7fb2e8199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 0x7fb2e8199280 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4006010 tx=0x7fb2d4004430 comp rx=0 tx=0).stop 2024-05-12T11:09:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 shutdown_connections 2024-05-12T11:09:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb2d80b2690 0x7fb2d80b4b50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e81087b0 0x7fb2e81a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8105e80 0x7fb2e8199280 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 --2- 172.21.15.86:0/3975489857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e8103550 0x7fb2e8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 >> 172.21.15.86:0/3975489857 conn(0x7fb2e80fce60 msgr2=0x7fb2e8104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 shutdown_connections 2024-05-12T11:09:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.070+0000 7fb2eef0a640 1 -- 172.21.15.86:0/3975489857 wait complete. 2024-05-12T11:09:25.074 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-05-12T11:09:25.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.188+0000 7f29cb017640 1 -- 172.21.15.86:0/1974465883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 msgr2=0x7f29c4109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.188+0000 7f29cb017640 1 --2- 172.21.15.86:0/1974465883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 0x7f29c4109d50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009ca0 tx=0x7f29bc02a8c0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.188+0000 7f29cb017640 1 -- 172.21.15.86:0/1974465883 shutdown_connections 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.188+0000 7f29cb017640 1 --2- 172.21.15.86:0/1974465883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 0x7f29c4109d50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.188+0000 7f29cb017640 1 --2- 172.21.15.86:0/1974465883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c4102b00 0x7f29c4102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.188+0000 7f29cb017640 1 --2- 172.21.15.86:0/1974465883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4101910 0x7f29c4101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.188+0000 7f29cb017640 1 -- 172.21.15.86:0/1974465883 >> 172.21.15.86:0/1974465883 conn(0x7f29c40fce80 msgr2=0x7f29c40ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 -- 172.21.15.86:0/1974465883 shutdown_connections 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 -- 172.21.15.86:0/1974465883 wait complete. 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 Processor -- start 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 -- start start 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c4101910 0x7f29c4198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4102b00 0x7f29c41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 0x7f29c41a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f29c410e640 con 0x7f29c41034c0 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29c410e4c0 con 0x7f29c4102b00 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29cb017640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29c410e7c0 con 0x7f29c4101910 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29c95b4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 0x7f29c41a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29c95b4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 0x7f29c41a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33492/0 (socket says 172.21.15.86:33492) 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29c95b4640 1 -- 172.21.15.86:0/2689052454 learned_addr learned my addr 172.21.15.86:0/2689052454 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.189+0000 7f29c8db3640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c4101910 0x7f29c4198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c3fff640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4102b00 0x7f29c41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c95b4640 1 -- 172.21.15.86:0/2689052454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c4101910 msgr2=0x7f29c4198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c95b4640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c4101910 0x7f29c4198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c95b4640 1 -- 172.21.15.86:0/2689052454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4102b00 msgr2=0x7f29c41992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c95b4640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4102b00 0x7f29c41992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c95b4640 1 -- 172.21.15.86:0/2689052454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c41a0920 con 0x7f29c41034c0 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c8db3640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c4101910 0x7f29c4198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c3fff640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4102b00 0x7f29c41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:25.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c95b4640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 0x7f29c41a0280 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f29bc031a20 tx=0x7f29bc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:25.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c1ffb640 1 -- 172.21.15.86:0/2689052454 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc004240 con 0x7f29c41034c0 2024-05-12T11:09:25.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c1ffb640 1 -- 172.21.15.86:0/2689052454 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29bc003e10 con 0x7f29c41034c0 2024-05-12T11:09:25.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c41a0bb0 con 0x7f29c41034c0 2024-05-12T11:09:25.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29c1ffb640 1 -- 172.21.15.86:0/2689052454 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0305c0 con 0x7f29c41034c0 2024-05-12T11:09:25.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.190+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c41a1150 con 0x7f29c41034c0 2024-05-12T11:09:25.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.191+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c4108d00 con 0x7f29c41034c0 2024-05-12T11:09:25.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.193+0000 7f29c1ffb640 1 -- 172.21.15.86:0/2689052454 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7f29bc02f660 con 0x7f29c41034c0 2024-05-12T11:09:25.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.193+0000 7f29c1ffb640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f29b40b2790 0x7f29b40b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.194+0000 7f29c8db3640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f29b40b2790 0x7f29b40b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.194+0000 7f29c1ffb640 1 -- 172.21.15.86:0/2689052454 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f29bc103ac0 con 0x7f29c41034c0 2024-05-12T11:09:25.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.194+0000 7f29c8db3640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f29b40b2790 0x7f29b40b4c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29c419a1e0 tx=0x7f29b8008040 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:25.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.197+0000 7f29c1ffb640 1 -- 172.21.15.86:0/2689052454 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f29bc0cb970 con 0x7f29c41034c0 2024-05-12T11:09:25.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.413+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f29c402dd10 con 0x7f29c41034c0 2024-05-12T11:09:25.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.417+0000 7f29c1ffb640 1 -- 172.21.15.86:0/2689052454 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) ==== 138+0+0 (secure 0 0 0) 0x7f29c402dd10 con 0x7f29c41034c0 2024-05-12T11:09:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.419+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f29b40b2790 msgr2=0x7f29b40b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.419+0000 7f29cb017640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f29b40b2790 0x7f29b40b4c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29c419a1e0 tx=0x7f29b8008040 comp rx=0 tx=0).stop 2024-05-12T11:09:25.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.419+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 msgr2=0x7f29c41a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.419+0000 7f29cb017640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 0x7f29c41a0280 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f29bc031a20 tx=0x7f29bc003c20 comp rx=0 tx=0).stop 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.420+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 shutdown_connections 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.420+0000 7f29cb017640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f29b40b2790 0x7f29b40b4c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.420+0000 7f29cb017640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29c41034c0 0x7f29c41a0280 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.420+0000 7f29cb017640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4102b00 0x7f29c41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.420+0000 7f29cb017640 1 --2- 172.21.15.86:0/2689052454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c4101910 0x7f29c4198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.420+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 >> 172.21.15.86:0/2689052454 conn(0x7f29c40fce80 msgr2=0x7f29c4105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.420+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 shutdown_connections 2024-05-12T11:09:25.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.420+0000 7f29cb017640 1 -- 172.21.15.86:0/2689052454 wait complete. 2024-05-12T11:09:25.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-05-12T11:09:25.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 -- 172.21.15.86:0/1884345755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c101930 msgr2=0x7f587c101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 --2- 172.21.15.86:0/1884345755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c101930 0x7f587c101d50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5878009900 tx=0x7f587802a410 comp rx=0 tx=0).stop 2024-05-12T11:09:25.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 -- 172.21.15.86:0/1884345755 shutdown_connections 2024-05-12T11:09:25.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 --2- 172.21.15.86:0/1884345755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f587c1034e0 0x7f587c109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 --2- 172.21.15.86:0/1884345755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f587c102b20 0x7f587c102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 --2- 172.21.15.86:0/1884345755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c101930 0x7f587c101d50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 -- 172.21.15.86:0/1884345755 >> 172.21.15.86:0/1884345755 conn(0x7f587c0fcec0 msgr2=0x7f587c0ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 -- 172.21.15.86:0/1884345755 shutdown_connections 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.545+0000 7f5883e93640 1 -- 172.21.15.86:0/1884345755 wait complete. 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f5883e93640 1 Processor -- start 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f5883e93640 1 -- start start 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f5883e93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f587c101930 0x7f587c198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f5883e93640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c102b20 0x7f587c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f5883e93640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f587c1034e0 0x7f587c1a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f5883e93640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f587c10d460 con 0x7f587c102b20 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f5883e93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f587c10d2e0 con 0x7f587c101930 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f5883e93640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f587c10d5e0 con 0x7f587c1034e0 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f588142e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c102b20 0x7f587c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f588142e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c102b20 0x7f587c199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33522/0 (socket says 172.21.15.86:33522) 2024-05-12T11:09:25.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.546+0000 7f588142e640 1 -- 172.21.15.86:0/3817291608 learned_addr learned my addr 172.21.15.86:0/3817291608 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f588142e640 1 -- 172.21.15.86:0/3817291608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f587c1034e0 msgr2=0x7f587c1a01a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f588142e640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f587c1034e0 0x7f587c1a01a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f588142e640 1 -- 172.21.15.86:0/3817291608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f587c101930 msgr2=0x7f587c198bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f588142e640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f587c101930 0x7f587c198bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f588142e640 1 -- 172.21.15.86:0/3817291608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c1a0810 con 0x7f587c102b20 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f588142e640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c102b20 0x7f587c199130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f586c00e9f0 tx=0x7f586c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f5872ffd640 1 -- 172.21.15.86:0/3817291608 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c00cd80 con 0x7f587c102b20 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f5872ffd640 1 -- 172.21.15.86:0/3817291608 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f586c0108e0 con 0x7f587c102b20 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587c1a0b00 con 0x7f587c102b20 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f5872ffd640 1 -- 172.21.15.86:0/3817291608 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c018980 con 0x7f587c102b20 2024-05-12T11:09:25.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.547+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587c1a1050 con 0x7f587c102b20 2024-05-12T11:09:25.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.548+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587c1a1280 con 0x7f587c102b20 2024-05-12T11:09:25.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.550+0000 7f5872ffd640 1 -- 172.21.15.86:0/3817291608 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7f586c010430 con 0x7f587c102b20 2024-05-12T11:09:25.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.551+0000 7f5872ffd640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f58680b2690 0x7f58680b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.551+0000 7f5881c2f640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f58680b2690 0x7f58680b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.551+0000 7f5872ffd640 1 -- 172.21.15.86:0/3817291608 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f586c0e23c0 con 0x7f587c102b20 2024-05-12T11:09:25.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.552+0000 7f5881c2f640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f58680b2690 0x7f58680b4b50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f587802a930 tx=0x7f5878000bc0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:25.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.556+0000 7f5872ffd640 1 -- 172.21.15.86:0/3817291608 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f586c0aa2b0 con 0x7f587c102b20 2024-05-12T11:09:25.645 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:25.645 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:25.645 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: mgrmap e22: x(active, since 1.02339s), standbys: y, z 2024-05-12T11:09:25.645 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: [12/May/2024:11:09:24] ENGINE Bus STARTING 2024-05-12T11:09:25.645 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: [12/May/2024:11:09:25] ENGINE Serving on http://172.21.15.86:8765 2024-05-12T11:09:25.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3975489857' entity='client.admin' 2024-05-12T11:09:25.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: [12/May/2024:11:09:25] ENGINE Serving on https://172.21.15.86:7150 2024-05-12T11:09:25.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: [12/May/2024:11:09:25] ENGINE Bus STARTED 2024-05-12T11:09:25.646 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:25 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2689052454' entity='client.admin' 2024-05-12T11:09:25.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:25.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:25.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: mgrmap e22: x(active, since 1.02339s), standbys: y, z 2024-05-12T11:09:25.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: [12/May/2024:11:09:24] ENGINE Bus STARTING 2024-05-12T11:09:25.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: [12/May/2024:11:09:25] ENGINE Serving on http://172.21.15.86:8765 2024-05-12T11:09:25.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3975489857' entity='client.admin' 2024-05-12T11:09:25.712 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: [12/May/2024:11:09:25] ENGINE Serving on https://172.21.15.86:7150 2024-05-12T11:09:25.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: [12/May/2024:11:09:25] ENGINE Bus STARTED 2024-05-12T11:09:25.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:25 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2689052454' entity='client.admin' 2024-05-12T11:09:25.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.765+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f587c1a1450 con 0x7f587c102b20 2024-05-12T11:09:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.769+0000 7f5872ffd640 1 -- 172.21.15.86:0/3817291608 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7f586c0a9bb0 con 0x7f587c102b20 2024-05-12T11:09:25.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f58680b2690 msgr2=0x7f58680b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f58680b2690 0x7f58680b4b50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f587802a930 tx=0x7f5878000bc0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c102b20 msgr2=0x7f587c199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c102b20 0x7f587c199130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f586c00e9f0 tx=0x7f586c00eeb0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 shutdown_connections 2024-05-12T11:09:25.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f58680b2690 0x7f58680b4b50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f587c1034e0 0x7f587c1a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c102b20 0x7f587c199130 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 --2- 172.21.15.86:0/3817291608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f587c101930 0x7f587c198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 >> 172.21.15.86:0/3817291608 conn(0x7f587c0fcec0 msgr2=0x7f587c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:25.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 shutdown_connections 2024-05-12T11:09:25.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.772+0000 7f5883e93640 1 -- 172.21.15.86:0/3817291608 wait complete. 2024-05-12T11:09:25.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 -- 172.21.15.86:0/598737471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 msgr2=0x7f5428105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 --2- 172.21.15.86:0/598737471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 0x7f5428105880 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5418009900 tx=0x7f541802a410 comp rx=0 tx=0).stop 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 -- 172.21.15.86:0/598737471 shutdown_connections 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 --2- 172.21.15.86:0/598737471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54281086f0 0x7f542810ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 --2- 172.21.15.86:0/598737471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5428105dc0 0x7f54281081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 --2- 172.21.15.86:0/598737471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 0x7f5428105880 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 -- 172.21.15.86:0/598737471 >> 172.21.15.86:0/598737471 conn(0x7f54280fce60 msgr2=0x7f54280ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 -- 172.21.15.86:0/598737471 shutdown_connections 2024-05-12T11:09:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.901+0000 7f542cd71640 1 -- 172.21.15.86:0/598737471 wait complete. 2024-05-12T11:09:25.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542cd71640 1 Processor -- start 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542cd71640 1 -- start start 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542cd71640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 0x7f5428198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542cd71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5428105dc0 0x7f5428199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542cd71640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54281086f0 0x7f54281a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542cd71640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f542810e570 con 0x7f5428103490 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542cd71640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f542810e3f0 con 0x7f5428105dc0 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542cd71640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f542810e6f0 con 0x7f54281086f0 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 0x7f5428198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 0x7f5428198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33550/0 (socket says 172.21.15.86:33550) 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 -- 172.21.15.86:0/2779454398 learned_addr learned my addr 172.21.15.86:0/2779454398 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f5425d9b640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5428105dc0 0x7f5428199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f5426d9d640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54281086f0 0x7f54281a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 -- 172.21.15.86:0/2779454398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54281086f0 msgr2=0x7f54281a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54281086f0 0x7f54281a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 -- 172.21.15.86:0/2779454398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5428105dc0 msgr2=0x7f5428199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5428105dc0 0x7f5428199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 -- 172.21.15.86:0/2779454398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54281a07e0 con 0x7f5428103490 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f5426d9d640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54281086f0 0x7f54281a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.902+0000 7f542659c640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 0x7f5428198c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5418005940 tx=0x7f5418004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.903+0000 7f54177fe640 1 -- 172.21.15.86:0/2779454398 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541803f030 con 0x7f5428103490 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.903+0000 7f54177fe640 1 -- 172.21.15.86:0/2779454398 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5418003cb0 con 0x7f5428103490 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.903+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54281a0a70 con 0x7f5428103490 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.903+0000 7f54177fe640 1 -- 172.21.15.86:0/2779454398 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418035070 con 0x7f5428103490 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.903+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54281a0f60 con 0x7f5428103490 2024-05-12T11:09:25.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.904+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54280fe950 con 0x7f5428103490 2024-05-12T11:09:25.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.905+0000 7f54177fe640 1 -- 172.21.15.86:0/2779454398 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7f5418042030 con 0x7f5428103490 2024-05-12T11:09:25.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.906+0000 7f54177fe640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f54100b2690 0x7f54100b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:25.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.906+0000 7f5425d9b640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f54100b2690 0x7f54100b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:25.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.906+0000 7f54177fe640 1 -- 172.21.15.86:0/2779454398 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f5418102ac0 con 0x7f5428103490 2024-05-12T11:09:25.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.906+0000 7f5425d9b640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f54100b2690 0x7f54100b4b50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f542819a0d0 tx=0x7f541c00b390 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:25.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:25.909+0000 7f54177fe640 1 -- 172.21.15.86:0/2779454398 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f54180ca9b0 con 0x7f5428103490 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: mgrmap e22: x(active, since 1.02339s), standbys: y, z 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: [12/May/2024:11:09:24] ENGINE Bus STARTING 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: [12/May/2024:11:09:25] ENGINE Serving on http://172.21.15.86:8765 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3975489857' entity='client.admin' 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: [12/May/2024:11:09:25] ENGINE Serving on https://172.21.15.86:7150 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: [12/May/2024:11:09:25] ENGINE Bus STARTED 2024-05-12T11:09:25.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:25 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2689052454' entity='client.admin' 2024-05-12T11:09:26.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.124+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5428062df0 con 0x7f54100b2690 2024-05-12T11:09:26.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.185+0000 7f54177fe640 1 -- 172.21.15.86:0/2779454398 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5428062df0 con 0x7f54100b2690 2024-05-12T11:09:26.176 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path / 2024-05-12T11:09:26.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f54100b2690 msgr2=0x7f54100b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f54100b2690 0x7f54100b4b50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f542819a0d0 tx=0x7f541c00b390 comp rx=0 tx=0).stop 2024-05-12T11:09:26.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 msgr2=0x7f5428198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 0x7f5428198c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5418005940 tx=0x7f5418004430 comp rx=0 tx=0).stop 2024-05-12T11:09:26.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 shutdown_connections 2024-05-12T11:09:26.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f54100b2690 0x7f54100b4b50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54281086f0 0x7f54281a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5428105dc0 0x7f5428199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 --2- 172.21.15.86:0/2779454398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5428103490 0x7f5428198c10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 >> 172.21.15.86:0/2779454398 conn(0x7f54280fce60 msgr2=0x7f5428103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:26.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 shutdown_connections 2024-05-12T11:09:26.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.188+0000 7f542cd71640 1 -- 172.21.15.86:0/2779454398 wait complete. 2024-05-12T11:09:26.190 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-05-12T11:09:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 -- 172.21.15.86:0/3390818119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c101910 msgr2=0x7fbb6c101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 --2- 172.21.15.86:0/3390818119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c101910 0x7fbb6c101d30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009900 tx=0x7fbb6002a410 comp rx=0 tx=0).stop 2024-05-12T11:09:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 -- 172.21.15.86:0/3390818119 shutdown_connections 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 --2- 172.21.15.86:0/3390818119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c1034c0 0x7fbb6c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 --2- 172.21.15.86:0/3390818119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb6c102b00 0x7fbb6c102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 --2- 172.21.15.86:0/3390818119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c101910 0x7fbb6c101d30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 -- 172.21.15.86:0/3390818119 >> 172.21.15.86:0/3390818119 conn(0x7fbb6c0fce80 msgr2=0x7fbb6c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 -- 172.21.15.86:0/3390818119 shutdown_connections 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.306+0000 7fbb74220640 1 -- 172.21.15.86:0/3390818119 wait complete. 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb74220640 1 Processor -- start 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb74220640 1 -- start start 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb74220640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb6c101910 0x7fbb6c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb74220640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c102b00 0x7fbb6c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb74220640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c1034c0 0x7fbb6c19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb74220640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10d500 con 0x7fbb6c1034c0 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb74220640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10d380 con 0x7fbb6c101910 2024-05-12T11:09:26.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb74220640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10d680 con 0x7fbb6c102b00 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb727bd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c1034c0 0x7fbb6c19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb727bd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c1034c0 0x7fbb6c19f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33570/0 (socket says 172.21.15.86:33570) 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb727bd640 1 -- 172.21.15.86:0/48349017 learned_addr learned my addr 172.21.15.86:0/48349017 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb717bb640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c102b00 0x7fbb6c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb71fbc640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb6c101910 0x7fbb6c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb727bd640 1 -- 172.21.15.86:0/48349017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c102b00 msgr2=0x7fbb6c198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb727bd640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c102b00 0x7fbb6c198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb727bd640 1 -- 172.21.15.86:0/48349017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb6c101910 msgr2=0x7fbb6c197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb727bd640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb6c101910 0x7fbb6c197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.307+0000 7fbb727bd640 1 -- 172.21.15.86:0/48349017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c19f760 con 0x7fbb6c1034c0 2024-05-12T11:09:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.308+0000 7fbb727bd640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c1034c0 0x7fbb6c19f0f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400eaa0 tx=0x7fbb6400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.310+0000 7fbb5effd640 1 -- 172.21.15.86:0/48349017 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64004d20 con 0x7fbb6c1034c0 2024-05-12T11:09:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.310+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c19fa50 con 0x7fbb6c1034c0 2024-05-12T11:09:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.310+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c19fff0 con 0x7fbb6c1034c0 2024-05-12T11:09:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.310+0000 7fbb5effd640 1 -- 172.21.15.86:0/48349017 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb64005020 con 0x7fbb6c1034c0 2024-05-12T11:09:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.310+0000 7fbb5effd640 1 -- 172.21.15.86:0/48349017 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6401f060 con 0x7fbb6c1034c0 2024-05-12T11:09:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.311+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb500052c0 con 0x7fbb6c1034c0 2024-05-12T11:09:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.312+0000 7fbb5effd640 1 -- 172.21.15.86:0/48349017 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 22) ==== 149464+0+0 (secure 0 0 0) 0x7fbb6400caf0 con 0x7fbb6c1034c0 2024-05-12T11:09:26.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.313+0000 7fbb5effd640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbb580b2690 0x7fbb580b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:26.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.313+0000 7fbb71fbc640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbb580b2690 0x7fbb580b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:26.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.313+0000 7fbb5effd640 1 -- 172.21.15.86:0/48349017 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fbb640e1f10 con 0x7fbb6c1034c0 2024-05-12T11:09:26.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.313+0000 7fbb71fbc640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbb580b2690 0x7fbb580b4b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbb60005ab0 tx=0x7fbb60005a20 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:26.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.318+0000 7fbb5effd640 1 -- 172.21.15.86:0/48349017 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbb64016030 con 0x7fbb6c1034c0 2024-05-12T11:09:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.547+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fbb50000c90 con 0x7fbb580b2690 2024-05-12T11:09:26.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.606+0000 7fbb5effd640 1 -- 172.21.15.86:0/48349017 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fbb50000c90 con 0x7fbb580b2690 2024-05-12T11:09:26.598 INFO:teuthology.orchestra.run.smithi086.stdout:Retention added to path / 2024-05-12T11:09:26.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.609+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbb580b2690 msgr2=0x7fbb580b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.609+0000 7fbb74220640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbb580b2690 0x7fbb580b4b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbb60005ab0 tx=0x7fbb60005a20 comp rx=0 tx=0).stop 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.609+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c1034c0 msgr2=0x7fbb6c19f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.609+0000 7fbb74220640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c1034c0 0x7fbb6c19f0f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400eaa0 tx=0x7fbb6400eea0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.610+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 shutdown_connections 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.610+0000 7fbb74220640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbb580b2690 0x7fbb580b4b50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.610+0000 7fbb74220640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb6c1034c0 0x7fbb6c19f0f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.610+0000 7fbb74220640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c102b00 0x7fbb6c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.610+0000 7fbb74220640 1 --2- 172.21.15.86:0/48349017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb6c101910 0x7fbb6c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.610+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 >> 172.21.15.86:0/48349017 conn(0x7fbb6c0fce80 msgr2=0x7fbb6c105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.610+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 shutdown_connections 2024-05-12T11:09:26.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.610+0000 7fbb74220640 1 -- 172.21.15.86:0/48349017 wait complete. 2024-05-12T11:09:26.615 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-12T11:09:26.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 -- 172.21.15.86:0/3764406935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c102580 msgr2=0x7f2f2c102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 --2- 172.21.15.86:0/3764406935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c102580 0x7f2f2c102a00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009ca0 tx=0x7f2f2402a8c0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 -- 172.21.15.86:0/3764406935 shutdown_connections 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 --2- 172.21.15.86:0/3764406935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c102580 0x7f2f2c102a00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 --2- 172.21.15.86:0/3764406935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2c101be0 0x7f2f2c102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 --2- 172.21.15.86:0/3764406935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c101280 0x7f2f2c1016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 -- 172.21.15.86:0/3764406935 >> 172.21.15.86:0/3764406935 conn(0x7f2f2c0fce80 msgr2=0x7f2f2c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 -- 172.21.15.86:0/3764406935 shutdown_connections 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 -- 172.21.15.86:0/3764406935 wait complete. 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 Processor -- start 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.739+0000 7f2f345ac640 1 -- start start 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f345ac640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c101280 0x7f2f2c19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f345ac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c101be0 0x7f2f2c19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f345ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2c102580 0x7f2f2c1a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f345ac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c110710 con 0x7f2f2c101be0 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f345ac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c110590 con 0x7f2f2c102580 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f345ac640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c110890 con 0x7f2f2c101280 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c101be0 0x7f2f2c19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c101be0 0x7f2f2c19b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33576/0 (socket says 172.21.15.86:33576) 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 -- 172.21.15.86:0/1513235622 learned_addr learned my addr 172.21.15.86:0/1513235622 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f32348640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c101280 0x7f2f2c19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f32b49640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2c102580 0x7f2f2c1a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 -- 172.21.15.86:0/1513235622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c101280 msgr2=0x7f2f2c19aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c101280 0x7f2f2c19aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 -- 172.21.15.86:0/1513235622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2c102580 msgr2=0x7f2f2c1a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2c102580 0x7f2f2c1a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 -- 172.21.15.86:0/1513235622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c1a28e0 con 0x7f2f2c101be0 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f31b47640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c101be0 0x7f2f2c19b1e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c920 tx=0x7f2f2800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f237fe640 1 -- 172.21.15.86:0/1513235622 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28007c70 con 0x7f2f2c101be0 2024-05-12T11:09:26.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f237fe640 1 -- 172.21.15.86:0/1513235622 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f28007e10 con 0x7f2f2c101be0 2024-05-12T11:09:26.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2c1a2bd0 con 0x7f2f2c101be0 2024-05-12T11:09:26.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f237fe640 1 -- 172.21.15.86:0/1513235622 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28018820 con 0x7f2f2c101be0 2024-05-12T11:09:26.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.740+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2c1a3170 con 0x7f2f2c101be0 2024-05-12T11:09:26.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.742+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2c10bfd0 con 0x7f2f2c101be0 2024-05-12T11:09:26.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.743+0000 7f2f237fe640 1 -- 172.21.15.86:0/1513235622 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 23) ==== 149823+0+0 (secure 0 0 0) 0x7f2f2800f450 con 0x7f2f2c101be0 2024-05-12T11:09:26.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.743+0000 7f2f237fe640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2f180b2b10 0x7f2f180b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:26.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.743+0000 7f2f32348640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2f180b2b10 0x7f2f180b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:26.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.744+0000 7f2f237fe640 1 -- 172.21.15.86:0/1513235622 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f2f280e27e0 con 0x7f2f2c101be0 2024-05-12T11:09:26.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.744+0000 7f2f32348640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2f180b2b10 0x7f2f180b4fd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c19bb70 tx=0x7f2f1c005f90 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:26.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:26.748+0000 7f2f237fe640 1 -- 172.21.15.86:0/1513235622 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2f28014030 con 0x7f2f2c101be0 2024-05-12T11:09:26.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:09:26.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3817291608' entity='client.admin' 2024-05-12T11:09:26.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:26.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:26.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:26.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:26.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:26.962 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:26.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:26.963 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:26 smithi086 ceph-mon[30110]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-05-12T11:09:26.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.007+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2f2c062df0 con 0x7f2f180b2b10 2024-05-12T11:09:27.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.016+0000 7f2f237fe640 1 -- 172.21.15.86:0/1513235622 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f2f2c062df0 con 0x7f2f180b2b10 2024-05-12T11:09:27.007 INFO:teuthology.orchestra.run.smithi086.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-12T00:00:00", "created": "2024-05-12T11:09:26", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-05-12T11:09:27.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2f180b2b10 msgr2=0x7f2f180b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:27.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2f180b2b10 0x7f2f180b4fd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c19bb70 tx=0x7f2f1c005f90 comp rx=0 tx=0).stop 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c101be0 msgr2=0x7f2f2c19b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c101be0 0x7f2f2c19b1e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c920 tx=0x7f2f2800cde0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 shutdown_connections 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2f180b2b10 0x7f2f180b4fd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2c102580 0x7f2f2c1a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f2c101be0 0x7f2f2c19b1e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 --2- 172.21.15.86:0/1513235622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c101280 0x7f2f2c19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 >> 172.21.15.86:0/1513235622 conn(0x7f2f2c0fce80 msgr2=0x7f2f2c0fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 shutdown_connections 2024-05-12T11:09:27.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.020+0000 7f2f345ac640 1 -- 172.21.15.86:0/1513235622 wait complete. 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3817291608' entity='client.admin' 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.016 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:26 smithi176 ceph-mon[34357]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-05-12T11:09:27.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-12T11:09:27.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 -- 172.21.15.86:0/2732897425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8105ee0 msgr2=0x7fb0a81082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2732897425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8105ee0 0x7fb0a81082d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009900 tx=0x7fb09c02a410 comp rx=0 tx=0).stop 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 -- 172.21.15.86:0/2732897425 shutdown_connections 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2732897425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a8108810 0x7fb0a810ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2732897425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8105ee0 0x7fb0a81082d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2732897425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a81035b0 0x7fb0a81059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 -- 172.21.15.86:0/2732897425 >> 172.21.15.86:0/2732897425 conn(0x7fb0a80fcf60 msgr2=0x7fb0a80ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 -- 172.21.15.86:0/2732897425 shutdown_connections 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 -- 172.21.15.86:0/2732897425 wait complete. 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 Processor -- start 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 -- start start 2024-05-12T11:09:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a81035b0 0x7fb0a8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a8105ee0 0x7fb0a81990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.140+0000 7fb0ad958640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8108810 0x7fb0a81a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0ad958640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a810e560 con 0x7fb0a8108810 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0ad958640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a810e3e0 con 0x7fb0a81035b0 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0ad958640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a810e6e0 con 0x7fb0a8105ee0 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8108810 0x7fb0a81a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8108810 0x7fb0a81a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33592/0 (socket says 172.21.15.86:33592) 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 -- 172.21.15.86:0/2979937035 learned_addr learned my addr 172.21.15.86:0/2979937035 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a6ffd640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a81035b0 0x7fb0a8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 -- 172.21.15.86:0/2979937035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a8105ee0 msgr2=0x7fb0a81990a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a8105ee0 0x7fb0a81990a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 -- 172.21.15.86:0/2979937035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a81035b0 msgr2=0x7fb0a8198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a81035b0 0x7fb0a8198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 -- 172.21.15.86:0/2979937035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a81a0780 con 0x7fb0a8108810 2024-05-12T11:09:27.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0a77fe640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8108810 0x7fb0a81a0110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c970 tx=0x7fb0a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:27.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0ac956640 1 -- 172.21.15.86:0/2979937035 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0007bb0 con 0x7fb0a8108810 2024-05-12T11:09:27.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0ac956640 1 -- 172.21.15.86:0/2979937035 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0a0007d50 con 0x7fb0a8108810 2024-05-12T11:09:27.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a81a0a70 con 0x7fb0a8108810 2024-05-12T11:09:27.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0ac956640 1 -- 172.21.15.86:0/2979937035 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0018770 con 0x7fb0a8108810 2024-05-12T11:09:27.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.141+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a81a0f70 con 0x7fb0a8108810 2024-05-12T11:09:27.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.142+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a80fea50 con 0x7fb0a8108810 2024-05-12T11:09:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.143+0000 7fb0ac956640 1 -- 172.21.15.86:0/2979937035 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 23) ==== 149823+0+0 (secure 0 0 0) 0x7fb0a000f990 con 0x7fb0a8108810 2024-05-12T11:09:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.144+0000 7fb0ac956640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb0900b2a90 0x7fb0900b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.145+0000 7fb0a6ffd640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb0900b2a90 0x7fb0900b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.145+0000 7fb0ac956640 1 -- 172.21.15.86:0/2979937035 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fb0a00e29a0 con 0x7fb0a8108810 2024-05-12T11:09:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.145+0000 7fb0a6ffd640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb0900b2a90 0x7fb0900b4f50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb098005fd0 tx=0x7fb098009680 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:27.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.148+0000 7fb0ac956640 1 -- 172.21.15.86:0/2979937035 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb0a0014030 con 0x7fb0a8108810 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3817291608' entity='client.admin' 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:27.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:26 smithi172 ceph-mon[34517]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-05-12T11:09:27.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.353+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb0a8062df0 con 0x7fb0900b2a90 2024-05-12T11:09:27.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.360+0000 7fb0ac956640 1 -- 172.21.15.86:0/2979937035 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb0a8062df0 con 0x7fb0900b2a90 2024-05-12T11:09:27.350 INFO:teuthology.orchestra.run.smithi086.stdout:/ 1m 6m3h 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb0900b2a90 msgr2=0x7fb0900b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb0900b2a90 0x7fb0900b4f50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb098005fd0 tx=0x7fb098009680 comp rx=0 tx=0).stop 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8108810 msgr2=0x7fb0a81a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8108810 0x7fb0a81a0110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c970 tx=0x7fb0a000ce30 comp rx=0 tx=0).stop 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 shutdown_connections 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb0900b2a90 0x7fb0900b4f50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0a8108810 0x7fb0a81a0110 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a8105ee0 0x7fb0a81990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 --2- 172.21.15.86:0/2979937035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a81035b0 0x7fb0a8198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 >> 172.21.15.86:0/2979937035 conn(0x7fb0a80fcf60 msgr2=0x7fb0a8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 shutdown_connections 2024-05-12T11:09:27.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:27.362+0000 7fb0ad958640 1 -- 172.21.15.86:0/2979937035 wait complete. 2024-05-12T11:09:27.364 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-05-12T11:09:27.391 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-12T11:09:27.401 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-12T11:09:27.411 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:09:27.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-12T11:09:27.435 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-12T11:09:27.450 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-12T11:09:27.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-12T11:09:27.712 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:28.101 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:28.101 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.101 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.101 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.101 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi086 to 176.2M 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: Unable to set osd_memory_target on smithi086 to 184767385: error parsing value: Value '184767385' is below minimum 939524096 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:28.103 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:27 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-12T11:09:28.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi086 to 176.2M 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: Unable to set osd_memory_target on smithi086 to 184767385: error parsing value: Value '184767385' is below minimum 939524096 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:28.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:27 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:28.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi086 to 176.2M 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: Unable to set osd_memory_target on smithi086 to 184767385: error parsing value: Value '184767385' is below minimum 939524096 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:28.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:27 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:29.143 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:29.143 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi176 to 176.2M 2024-05-12T11:09:29.143 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Unable to set osd_memory_target on smithi176 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi086:/etc/ceph/ceph.conf 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-05-12T11:09:29.144 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:29.145 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:28 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:29.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi176 to 176.2M 2024-05-12T11:09:29.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Unable to set osd_memory_target on smithi176 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi086:/etc/ceph/ceph.conf 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-05-12T11:09:29.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:29.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:28 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:09:29.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi176 to 176.2M 2024-05-12T11:09:29.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Unable to set osd_memory_target on smithi176 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-05-12T11:09:29.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi086:/etc/ceph/ceph.conf 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi176:/etc/ceph/ceph.conf 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: Updating smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-05-12T11:09:29.267 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:09:29.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:28 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 -- 172.21.15.86:0/2069880525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 msgr2=0x7fb20c116a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 --2- 172.21.15.86:0/2069880525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 0x7fb20c116a90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb20400b0a0 tx=0x7fb20400b3b0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 -- 172.21.15.86:0/2069880525 shutdown_connections 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 --2- 172.21.15.86:0/2069880525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 0x7fb20c116a90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 --2- 172.21.15.86:0/2069880525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c0756d0 0x7fb20c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 --2- 172.21.15.86:0/2069880525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb20c075ff0 0x7fb20c114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 -- 172.21.15.86:0/2069880525 >> 172.21.15.86:0/2069880525 conn(0x7fb20c07a610 msgr2=0x7fb20c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 -- 172.21.15.86:0/2069880525 shutdown_connections 2024-05-12T11:09:29.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 -- 172.21.15.86:0/2069880525 wait complete. 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 Processor -- start 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.389+0000 7fb2136ca700 1 -- start start 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2136ca700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c0756d0 0x7fb20c1a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2136ca700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb20c075ff0 0x7fb20c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2136ca700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 0x7fb20c1a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2136ca700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c119ce0 con 0x7fb20c1146a0 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2136ca700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c119b60 con 0x7fb20c0756d0 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2136ca700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c119e60 con 0x7fb20c075ff0 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 0x7fb20c1a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211466700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c0756d0 0x7fb20c1a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb210c65700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb20c075ff0 0x7fb20c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 0x7fb20c1a49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33612/0 (socket says 172.21.15.86:33612) 2024-05-12T11:09:29.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 -- 172.21.15.86:0/900601007 learned_addr learned my addr 172.21.15.86:0/900601007 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 -- 172.21.15.86:0/900601007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb20c075ff0 msgr2=0x7fb20c1a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb20c075ff0 0x7fb20c1a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 -- 172.21.15.86:0/900601007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c0756d0 msgr2=0x7fb20c1a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c0756d0 0x7fb20c1a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 -- 172.21.15.86:0/900601007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c1a5100 con 0x7fb20c1146a0 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb211c67700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 0x7fb20c1a49c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb204006070 tx=0x7fb204004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2027fc700 1 -- 172.21.15.86:0/900601007 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204021070 con 0x7fb20c1146a0 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2027fc700 1 -- 172.21.15.86:0/900601007 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb204003c00 con 0x7fb20c1146a0 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2027fc700 1 -- 172.21.15.86:0/900601007 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204004740 con 0x7fb20c1146a0 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c1a5390 con 0x7fb20c1146a0 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.390+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c1acc70 con 0x7fb20c1146a0 2024-05-12T11:09:29.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.391+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20c06a190 con 0x7fb20c1146a0 2024-05-12T11:09:29.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.393+0000 7fb2027fc700 1 -- 172.21.15.86:0/900601007 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fb204007a00 con 0x7fb20c1146a0 2024-05-12T11:09:29.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.394+0000 7fb2027fc700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb1f80b2b90 0x7fb1f80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:29.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.394+0000 7fb211466700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb1f80b2b90 0x7fb1f80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:29.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.394+0000 7fb2027fc700 1 -- 172.21.15.86:0/900601007 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fb20400f020 con 0x7fb20c1146a0 2024-05-12T11:09:29.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.395+0000 7fb211466700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb1f80b2b90 0x7fb1f80b5050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb20800ac50 tx=0x7fb20800a380 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:29.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.398+0000 7fb2027fc700 1 -- 172.21.15.86:0/900601007 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb20402a020 con 0x7fb20c1146a0 2024-05-12T11:09:29.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.597+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb20c113b00 con 0x7fb1f80b2b90 2024-05-12T11:09:29.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.605+0000 7fb2027fc700 1 -- 172.21.15.86:0/900601007 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258051 (secure 0 0 0) 0x7fb20c113b00 con 0x7fb1f80b2b90 2024-05-12T11:09:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:09:29.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb1f80b2b90 msgr2=0x7fb1f80b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb1f80b2b90 0x7fb1f80b5050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb20800ac50 tx=0x7fb20800a380 comp rx=0 tx=0).stop 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 msgr2=0x7fb20c1a49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 0x7fb20c1a49c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb204006070 tx=0x7fb204004e60 comp rx=0 tx=0).stop 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 shutdown_connections 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb1f80b2b90 0x7fb1f80b5050 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb20c1146a0 0x7fb20c1a49c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c0756d0 0x7fb20c1a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 --2- 172.21.15.86:0/900601007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb20c075ff0 0x7fb20c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 >> 172.21.15.86:0/900601007 conn(0x7fb20c07a610 msgr2=0x7fb20c1133f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 shutdown_connections 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:29.608+0000 7fb2136ca700 1 -- 172.21.15.86:0/900601007 wait complete. 2024-05-12T11:09:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-05-12T11:09:30.310 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-05-12T11:09:27.684364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190941,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2039,"num_read_kb":1163,"num_write":501,"num_write_kb":3616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":2952534,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":895,"ondisk_log_size":895,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373020,"kb_used_data":11340,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568804,"statfs":{"total":1151940427776,"available":1151558455296,"internally_reserved":0,"allocated":11612160,"data_stored":8867943,"data_compressed":286466,"data_compressed_allocated":380928,"data_compressed_original":3612672,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.989327"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976891+0000","last_change":"2024-05-12T11:06:05.173542+0000","last_active":"2024-05-12T11:09:23.976891+0000","last_peered":"2024-05-12T11:09:23.976891+0000","last_clean":"2024-05-12T11:09:23.976891+0000","last_became_active":"2024-05-12T11:06:05.173221+0000","last_became_peered":"2024-05-12T11:06:05.173221+0000","last_unstale":"2024-05-12T11:09:23.976891+0000","last_undegraded":"2024-05-12T11:09:23.976891+0000","last_fullsized":"2024-05-12T11:09:23.976891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922383+0000","last_change":"2024-05-12T11:06:05.178626+0000","last_active":"2024-05-12T11:09:23.922383+0000","last_peered":"2024-05-12T11:09:23.922383+0000","last_clean":"2024-05-12T11:09:23.922383+0000","last_became_active":"2024-05-12T11:06:05.178313+0000","last_became_peered":"2024-05-12T11:06:05.178313+0000","last_unstale":"2024-05-12T11:09:23.922383+0000","last_undegraded":"2024-05-12T11:09:23.922383+0000","last_fullsized":"2024-05-12T11:09:23.922383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:45:25.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922151+0000","last_change":"2024-05-12T11:06:05.175396+0000","last_active":"2024-05-12T11:09:23.922151+0000","last_peered":"2024-05-12T11:09:23.922151+0000","last_clean":"2024-05-12T11:09:23.922151+0000","last_became_active":"2024-05-12T11:06:05.175060+0000","last_became_peered":"2024-05-12T11:06:05.175060+0000","last_unstale":"2024-05-12T11:09:23.922151+0000","last_undegraded":"2024-05-12T11:09:23.922151+0000","last_fullsized":"2024-05-12T11:09:23.922151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:55:08.180220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671170+0000","last_change":"2024-05-12T11:06:05.172900+0000","last_active":"2024-05-12T11:09:23.671170+0000","last_peered":"2024-05-12T11:09:23.671170+0000","last_clean":"2024-05-12T11:09:23.671170+0000","last_became_active":"2024-05-12T11:06:05.172549+0000","last_became_peered":"2024-05-12T11:06:05.172549+0000","last_unstale":"2024-05-12T11:09:23.671170+0000","last_undegraded":"2024-05-12T11:09:23.671170+0000","last_fullsized":"2024-05-12T11:09:23.671170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:07:39.683046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765667+0000","last_change":"2024-05-12T11:06:05.168126+0000","last_active":"2024-05-12T11:09:23.765667+0000","last_peered":"2024-05-12T11:09:23.765667+0000","last_clean":"2024-05-12T11:09:23.765667+0000","last_became_active":"2024-05-12T11:06:05.167729+0000","last_became_peered":"2024-05-12T11:06:05.167729+0000","last_unstale":"2024-05-12T11:09:23.765667+0000","last_undegraded":"2024-05-12T11:09:23.765667+0000","last_fullsized":"2024-05-12T11:09:23.765667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:38.996242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774891+0000","last_change":"2024-05-12T11:06:05.180165+0000","last_active":"2024-05-12T11:09:23.774891+0000","last_peered":"2024-05-12T11:09:23.774891+0000","last_clean":"2024-05-12T11:09:23.774891+0000","last_became_active":"2024-05-12T11:06:05.179589+0000","last_became_peered":"2024-05-12T11:06:05.179589+0000","last_unstale":"2024-05-12T11:09:23.774891+0000","last_undegraded":"2024-05-12T11:09:23.774891+0000","last_fullsized":"2024-05-12T11:09:23.774891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:51:53.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919741+0000","last_change":"2024-05-12T11:06:05.176052+0000","last_active":"2024-05-12T11:09:23.919741+0000","last_peered":"2024-05-12T11:09:23.919741+0000","last_clean":"2024-05-12T11:09:23.919741+0000","last_became_active":"2024-05-12T11:06:05.175703+0000","last_became_peered":"2024-05-12T11:06:05.175703+0000","last_unstale":"2024-05-12T11:09:23.919741+0000","last_undegraded":"2024-05-12T11:09:23.919741+0000","last_fullsized":"2024-05-12T11:09:23.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:51:11.008516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765437+0000","last_change":"2024-05-12T11:06:05.179144+0000","last_active":"2024-05-12T11:09:23.765437+0000","last_peered":"2024-05-12T11:09:23.765437+0000","last_clean":"2024-05-12T11:09:23.765437+0000","last_became_active":"2024-05-12T11:06:05.177854+0000","last_became_peered":"2024-05-12T11:06:05.177854+0000","last_unstale":"2024-05-12T11:09:23.765437+0000","last_undegraded":"2024-05-12T11:09:23.765437+0000","last_fullsized":"2024-05-12T11:09:23.765437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:12.231086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668172+0000","last_change":"2024-05-12T11:06:45.310743+0000","last_active":"2024-05-12T11:09:23.668172+0000","last_peered":"2024-05-12T11:09:23.668172+0000","last_clean":"2024-05-12T11:09:23.668172+0000","last_became_active":"2024-05-12T11:06:45.310358+0000","last_became_peered":"2024-05-12T11:06:45.310358+0000","last_unstale":"2024-05-12T11:09:23.668172+0000","last_undegraded":"2024-05-12T11:09:23.668172+0000","last_fullsized":"2024-05-12T11:09:23.668172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:22:30.862132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.775252+0000","last_change":"2024-05-12T11:06:05.176196+0000","last_active":"2024-05-12T11:09:23.775252+0000","last_peered":"2024-05-12T11:09:23.775252+0000","last_clean":"2024-05-12T11:09:23.775252+0000","last_became_active":"2024-05-12T11:06:05.175863+0000","last_became_peered":"2024-05-12T11:06:05.175863+0000","last_unstale":"2024-05-12T11:09:23.775252+0000","last_undegraded":"2024-05-12T11:09:23.775252+0000","last_fullsized":"2024-05-12T11:09:23.775252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:26:41.815661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919973+0000","last_change":"2024-05-12T11:06:05.175901+0000","last_active":"2024-05-12T11:09:23.919973+0000","last_peered":"2024-05-12T11:09:23.919973+0000","last_clean":"2024-05-12T11:09:23.919973+0000","last_became_active":"2024-05-12T11:06:05.175514+0000","last_became_peered":"2024-05-12T11:06:05.175514+0000","last_unstale":"2024-05-12T11:09:23.919973+0000","last_undegraded":"2024-05-12T11:09:23.919973+0000","last_fullsized":"2024-05-12T11:09:23.919973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:11.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671109+0000","last_change":"2024-05-12T11:06:05.175474+0000","last_active":"2024-05-12T11:09:23.671109+0000","last_peered":"2024-05-12T11:09:23.671109+0000","last_clean":"2024-05-12T11:09:23.671109+0000","last_became_active":"2024-05-12T11:06:05.175082+0000","last_became_peered":"2024-05-12T11:06:05.175082+0000","last_unstale":"2024-05-12T11:09:23.671109+0000","last_undegraded":"2024-05-12T11:09:23.671109+0000","last_fullsized":"2024-05-12T11:09:23.671109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:10:53.548758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919727+0000","last_change":"2024-05-12T11:06:05.170426+0000","last_active":"2024-05-12T11:09:23.919727+0000","last_peered":"2024-05-12T11:09:23.919727+0000","last_clean":"2024-05-12T11:09:23.919727+0000","last_became_active":"2024-05-12T11:06:05.170111+0000","last_became_peered":"2024-05-12T11:06:05.170111+0000","last_unstale":"2024-05-12T11:09:23.919727+0000","last_undegraded":"2024-05-12T11:09:23.919727+0000","last_fullsized":"2024-05-12T11:09:23.919727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:50.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922244+0000","last_change":"2024-05-12T11:06:05.178939+0000","last_active":"2024-05-12T11:09:23.922244+0000","last_peered":"2024-05-12T11:09:23.922244+0000","last_clean":"2024-05-12T11:09:23.922244+0000","last_became_active":"2024-05-12T11:06:05.178604+0000","last_became_peered":"2024-05-12T11:06:05.178604+0000","last_unstale":"2024-05-12T11:09:23.922244+0000","last_undegraded":"2024-05-12T11:09:23.922244+0000","last_fullsized":"2024-05-12T11:09:23.922244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:36.222841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921990+0000","last_change":"2024-05-12T11:06:45.312800+0000","last_active":"2024-05-12T11:09:23.921990+0000","last_peered":"2024-05-12T11:09:23.921990+0000","last_clean":"2024-05-12T11:09:23.921990+0000","last_became_active":"2024-05-12T11:06:45.312567+0000","last_became_peered":"2024-05-12T11:06:45.312567+0000","last_unstale":"2024-05-12T11:09:23.921990+0000","last_undegraded":"2024-05-12T11:09:23.921990+0000","last_fullsized":"2024-05-12T11:09:23.921990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:30:21.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920501+0000","last_change":"2024-05-12T11:06:05.170481+0000","last_active":"2024-05-12T11:09:23.920501+0000","last_peered":"2024-05-12T11:09:23.920501+0000","last_clean":"2024-05-12T11:09:23.920501+0000","last_became_active":"2024-05-12T11:06:05.170173+0000","last_became_peered":"2024-05-12T11:06:05.170173+0000","last_unstale":"2024-05-12T11:09:23.920501+0000","last_undegraded":"2024-05-12T11:09:23.920501+0000","last_fullsized":"2024-05-12T11:09:23.920501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:01:37.775287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976993+0000","last_change":"2024-05-12T11:06:05.172942+0000","last_active":"2024-05-12T11:09:23.976993+0000","last_peered":"2024-05-12T11:09:23.976993+0000","last_clean":"2024-05-12T11:09:23.976993+0000","last_became_active":"2024-05-12T11:06:05.172612+0000","last_became_peered":"2024-05-12T11:06:05.172612+0000","last_unstale":"2024-05-12T11:09:23.976993+0000","last_undegraded":"2024-05-12T11:09:23.976993+0000","last_fullsized":"2024-05-12T11:09:23.976993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:26:51.548027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668313+0000","last_change":"2024-05-12T11:06:05.175400+0000","last_active":"2024-05-12T11:09:23.668313+0000","last_peered":"2024-05-12T11:09:23.668313+0000","last_clean":"2024-05-12T11:09:23.668313+0000","last_became_active":"2024-05-12T11:06:05.174871+0000","last_became_peered":"2024-05-12T11:06:05.174871+0000","last_unstale":"2024-05-12T11:09:23.668313+0000","last_undegraded":"2024-05-12T11:09:23.668313+0000","last_fullsized":"2024-05-12T11:09:23.668313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:48:12.566540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671676+0000","last_change":"2024-05-12T11:06:05.172584+0000","last_active":"2024-05-12T11:09:23.671676+0000","last_peered":"2024-05-12T11:09:23.671676+0000","last_clean":"2024-05-12T11:09:23.671676+0000","last_became_active":"2024-05-12T11:06:05.171545+0000","last_became_peered":"2024-05-12T11:06:05.171545+0000","last_unstale":"2024-05-12T11:09:23.671676+0000","last_undegraded":"2024-05-12T11:09:23.671676+0000","last_fullsized":"2024-05-12T11:09:23.671676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:34:45.950231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":226,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.925389+0000","last_change":"2024-05-12T11:06:02.148890+0000","last_active":"2024-05-12T11:09:23.925389+0000","last_peered":"2024-05-12T11:09:23.925389+0000","last_clean":"2024-05-12T11:09:23.925389+0000","last_became_active":"2024-05-12T11:06:02.148544+0000","last_became_peered":"2024-05-12T11:06:02.148544+0000","last_unstale":"2024-05-12T11:09:23.925389+0000","last_undegraded":"2024-05-12T11:09:23.925389+0000","last_fullsized":"2024-05-12T11:09:23.925389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:34.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":183,"num_read_kb":183,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765952+0000","last_change":"2024-05-12T11:06:05.175214+0000","last_active":"2024-05-12T11:09:23.765952+0000","last_peered":"2024-05-12T11:09:23.765952+0000","last_clean":"2024-05-12T11:09:23.765952+0000","last_became_active":"2024-05-12T11:06:05.174920+0000","last_became_peered":"2024-05-12T11:06:05.174920+0000","last_unstale":"2024-05-12T11:09:23.765952+0000","last_undegraded":"2024-05-12T11:09:23.765952+0000","last_fullsized":"2024-05-12T11:09:23.765952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:30:36.277975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.766173+0000","last_change":"2024-05-12T11:06:02.246073+0000","last_active":"2024-05-12T11:09:23.766173+0000","last_peered":"2024-05-12T11:09:23.766173+0000","last_clean":"2024-05-12T11:09:23.766173+0000","last_became_active":"2024-05-12T11:06:02.245728+0000","last_became_peered":"2024-05-12T11:06:02.245728+0000","last_unstale":"2024-05-12T11:09:23.766173+0000","last_undegraded":"2024-05-12T11:09:23.766173+0000","last_fullsized":"2024-05-12T11:09:23.766173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:43:03.273179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922550+0000","last_change":"2024-05-12T11:06:05.170448+0000","last_active":"2024-05-12T11:09:23.922550+0000","last_peered":"2024-05-12T11:09:23.922550+0000","last_clean":"2024-05-12T11:09:23.922550+0000","last_became_active":"2024-05-12T11:06:05.170133+0000","last_became_peered":"2024-05-12T11:06:05.170133+0000","last_unstale":"2024-05-12T11:09:23.922550+0000","last_undegraded":"2024-05-12T11:09:23.922550+0000","last_fullsized":"2024-05-12T11:09:23.922550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:17:30.669009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765993+0000","last_change":"2024-05-12T11:06:02.155137+0000","last_active":"2024-05-12T11:09:23.765993+0000","last_peered":"2024-05-12T11:09:23.765993+0000","last_clean":"2024-05-12T11:09:23.765993+0000","last_became_active":"2024-05-12T11:06:02.154467+0000","last_became_peered":"2024-05-12T11:06:02.154467+0000","last_unstale":"2024-05-12T11:09:23.765993+0000","last_undegraded":"2024-05-12T11:09:23.765993+0000","last_fullsized":"2024-05-12T11:09:23.765993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:38.708094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920852+0000","last_change":"2024-05-12T11:06:05.180903+0000","last_active":"2024-05-12T11:09:23.920852+0000","last_peered":"2024-05-12T11:09:23.920852+0000","last_clean":"2024-05-12T11:09:23.920852+0000","last_became_active":"2024-05-12T11:06:05.180519+0000","last_became_peered":"2024-05-12T11:06:05.180519+0000","last_unstale":"2024-05-12T11:09:23.920852+0000","last_undegraded":"2024-05-12T11:09:23.920852+0000","last_fullsized":"2024-05-12T11:09:23.920852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:57:47.535714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976684+0000","last_change":"2024-05-12T11:06:45.325333+0000","last_active":"2024-05-12T11:09:23.976684+0000","last_peered":"2024-05-12T11:09:23.976684+0000","last_clean":"2024-05-12T11:09:23.976684+0000","last_became_active":"2024-05-12T11:06:45.312552+0000","last_became_peered":"2024-05-12T11:06:45.312552+0000","last_unstale":"2024-05-12T11:09:23.976684+0000","last_undegraded":"2024-05-12T11:09:23.976684+0000","last_fullsized":"2024-05-12T11:09:23.976684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:45.862620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772039+0000","last_change":"2024-05-12T11:06:05.167052+0000","last_active":"2024-05-12T11:09:23.772039+0000","last_peered":"2024-05-12T11:09:23.772039+0000","last_clean":"2024-05-12T11:09:23.772039+0000","last_became_active":"2024-05-12T11:06:05.166689+0000","last_became_peered":"2024-05-12T11:06:05.166689+0000","last_unstale":"2024-05-12T11:09:23.772039+0000","last_undegraded":"2024-05-12T11:09:23.772039+0000","last_fullsized":"2024-05-12T11:09:23.772039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:34:05.008336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":222,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772019+0000","last_change":"2024-05-12T11:06:02.154630+0000","last_active":"2024-05-12T11:09:23.772019+0000","last_peered":"2024-05-12T11:09:23.772019+0000","last_clean":"2024-05-12T11:09:23.772019+0000","last_became_active":"2024-05-12T11:06:02.154254+0000","last_became_peered":"2024-05-12T11:06:02.154254+0000","last_unstale":"2024-05-12T11:09:23.772019+0000","last_undegraded":"2024-05-12T11:09:23.772019+0000","last_fullsized":"2024-05-12T11:09:23.772019+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:54.294058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765582+0000","last_change":"2024-05-12T11:06:05.176582+0000","last_active":"2024-05-12T11:09:23.765582+0000","last_peered":"2024-05-12T11:09:23.765582+0000","last_clean":"2024-05-12T11:09:23.765582+0000","last_became_active":"2024-05-12T11:06:05.176241+0000","last_became_peered":"2024-05-12T11:06:05.176241+0000","last_unstale":"2024-05-12T11:09:23.765582+0000","last_undegraded":"2024-05-12T11:09:23.765582+0000","last_fullsized":"2024-05-12T11:09:23.765582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:09:00.020166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774832+0000","last_change":"2024-05-12T11:06:02.148534+0000","last_active":"2024-05-12T11:09:23.774832+0000","last_peered":"2024-05-12T11:09:23.774832+0000","last_clean":"2024-05-12T11:09:23.774832+0000","last_became_active":"2024-05-12T11:06:02.148155+0000","last_became_peered":"2024-05-12T11:06:02.148155+0000","last_unstale":"2024-05-12T11:09:23.774832+0000","last_undegraded":"2024-05-12T11:09:23.774832+0000","last_fullsized":"2024-05-12T11:09:23.774832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:52:21.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772041+0000","last_change":"2024-05-12T11:06:05.169944+0000","last_active":"2024-05-12T11:09:23.772041+0000","last_peered":"2024-05-12T11:09:23.772041+0000","last_clean":"2024-05-12T11:09:23.772041+0000","last_became_active":"2024-05-12T11:06:05.169597+0000","last_became_peered":"2024-05-12T11:06:05.169597+0000","last_unstale":"2024-05-12T11:09:23.772041+0000","last_undegraded":"2024-05-12T11:09:23.772041+0000","last_fullsized":"2024-05-12T11:09:23.772041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:05:17.724037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919670+0000","last_change":"2024-05-12T11:06:02.154539+0000","last_active":"2024-05-12T11:09:23.919670+0000","last_peered":"2024-05-12T11:09:23.919670+0000","last_clean":"2024-05-12T11:09:23.919670+0000","last_became_active":"2024-05-12T11:06:02.154040+0000","last_became_peered":"2024-05-12T11:06:02.154040+0000","last_unstale":"2024-05-12T11:09:23.919670+0000","last_undegraded":"2024-05-12T11:09:23.919670+0000","last_fullsized":"2024-05-12T11:09:23.919670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:10:23.875273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.667936+0000","last_change":"2024-05-12T11:06:45.308950+0000","last_active":"2024-05-12T11:09:23.667936+0000","last_peered":"2024-05-12T11:09:23.667936+0000","last_clean":"2024-05-12T11:09:23.667936+0000","last_became_active":"2024-05-12T11:06:45.308579+0000","last_became_peered":"2024-05-12T11:06:45.308579+0000","last_unstale":"2024-05-12T11:09:23.667936+0000","last_undegraded":"2024-05-12T11:09:23.667936+0000","last_fullsized":"2024-05-12T11:09:23.667936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:01:08.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771828+0000","last_change":"2024-05-12T11:06:02.151341+0000","last_active":"2024-05-12T11:09:23.771828+0000","last_peered":"2024-05-12T11:09:23.771828+0000","last_clean":"2024-05-12T11:09:23.771828+0000","last_became_active":"2024-05-12T11:06:02.150949+0000","last_became_peered":"2024-05-12T11:06:02.150949+0000","last_unstale":"2024-05-12T11:09:23.771828+0000","last_undegraded":"2024-05-12T11:09:23.771828+0000","last_fullsized":"2024-05-12T11:09:23.771828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:07:26.699269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.667944+0000","last_change":"2024-05-12T11:06:05.173060+0000","last_active":"2024-05-12T11:09:23.667944+0000","last_peered":"2024-05-12T11:09:23.667944+0000","last_clean":"2024-05-12T11:09:23.667944+0000","last_became_active":"2024-05-12T11:06:05.172756+0000","last_became_peered":"2024-05-12T11:06:05.172756+0000","last_unstale":"2024-05-12T11:09:23.667944+0000","last_undegraded":"2024-05-12T11:09:23.667944+0000","last_fullsized":"2024-05-12T11:09:23.667944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:15:12.797466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'6","reported_seq":399,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:24.487142+0000","last_change":"2024-05-12T11:06:02.152219+0000","last_active":"2024-05-12T11:09:24.487142+0000","last_peered":"2024-05-12T11:09:24.487142+0000","last_clean":"2024-05-12T11:09:24.487142+0000","last_became_active":"2024-05-12T11:06:02.151707+0000","last_became_peered":"2024-05-12T11:06:02.151707+0000","last_unstale":"2024-05-12T11:09:24.487142+0000","last_undegraded":"2024-05-12T11:09:24.487142+0000","last_fullsized":"2024-05-12T11:09:24.487142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:43.047957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":364,"num_read_kb":364,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921355+0000","last_change":"2024-05-12T11:06:05.173436+0000","last_active":"2024-05-12T11:09:23.921355+0000","last_peered":"2024-05-12T11:09:23.921355+0000","last_clean":"2024-05-12T11:09:23.921355+0000","last_became_active":"2024-05-12T11:06:05.173057+0000","last_became_peered":"2024-05-12T11:06:05.173057+0000","last_unstale":"2024-05-12T11:09:23.921355+0000","last_undegraded":"2024-05-12T11:09:23.921355+0000","last_fullsized":"2024-05-12T11:09:23.921355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.408017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920905+0000","last_change":"2024-05-12T11:06:02.155037+0000","last_active":"2024-05-12T11:09:23.920905+0000","last_peered":"2024-05-12T11:09:23.920905+0000","last_clean":"2024-05-12T11:09:23.920905+0000","last_became_active":"2024-05-12T11:06:02.154658+0000","last_became_peered":"2024-05-12T11:06:02.154658+0000","last_unstale":"2024-05-12T11:09:23.920905+0000","last_undegraded":"2024-05-12T11:09:23.920905+0000","last_fullsized":"2024-05-12T11:09:23.920905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:58:16.633636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922370+0000","last_change":"2024-05-12T11:06:05.176100+0000","last_active":"2024-05-12T11:09:23.922370+0000","last_peered":"2024-05-12T11:09:23.922370+0000","last_clean":"2024-05-12T11:09:23.922370+0000","last_became_active":"2024-05-12T11:06:05.175385+0000","last_became_peered":"2024-05-12T11:06:05.175385+0000","last_unstale":"2024-05-12T11:09:23.922370+0000","last_undegraded":"2024-05-12T11:09:23.922370+0000","last_fullsized":"2024-05-12T11:09:23.922370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:10.627583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772185+0000","last_change":"2024-05-12T11:06:02.246427+0000","last_active":"2024-05-12T11:09:23.772185+0000","last_peered":"2024-05-12T11:09:23.772185+0000","last_clean":"2024-05-12T11:09:23.772185+0000","last_became_active":"2024-05-12T11:06:02.246068+0000","last_became_peered":"2024-05-12T11:06:02.246068+0000","last_unstale":"2024-05-12T11:09:23.772185+0000","last_undegraded":"2024-05-12T11:09:23.772185+0000","last_fullsized":"2024-05-12T11:09:23.772185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:40:25.533391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921096+0000","last_change":"2024-05-12T11:06:45.310358+0000","last_active":"2024-05-12T11:09:23.921096+0000","last_peered":"2024-05-12T11:09:23.921096+0000","last_clean":"2024-05-12T11:09:23.921096+0000","last_became_active":"2024-05-12T11:06:45.309960+0000","last_became_peered":"2024-05-12T11:06:45.309960+0000","last_unstale":"2024-05-12T11:09:23.921096+0000","last_undegraded":"2024-05-12T11:09:23.921096+0000","last_fullsized":"2024-05-12T11:09:23.921096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:28.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'39","reported_seq":444,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:24.487131+0000","last_change":"2024-05-12T11:06:02.151099+0000","last_active":"2024-05-12T11:09:24.487131+0000","last_peered":"2024-05-12T11:09:24.487131+0000","last_clean":"2024-05-12T11:09:24.487131+0000","last_became_active":"2024-05-12T11:06:02.150702+0000","last_became_peered":"2024-05-12T11:06:02.150702+0000","last_unstale":"2024-05-12T11:09:24.487131+0000","last_undegraded":"2024-05-12T11:09:24.487131+0000","last_fullsized":"2024-05-12T11:09:24.487131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:14:00.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67479,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":376,"num_read_kb":253,"num_write":41,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765773+0000","last_change":"2024-05-12T11:06:05.171016+0000","last_active":"2024-05-12T11:09:23.765773+0000","last_peered":"2024-05-12T11:09:23.765773+0000","last_clean":"2024-05-12T11:09:23.765773+0000","last_became_active":"2024-05-12T11:06:05.170659+0000","last_became_peered":"2024-05-12T11:06:05.170659+0000","last_unstale":"2024-05-12T11:09:23.765773+0000","last_undegraded":"2024-05-12T11:09:23.765773+0000","last_fullsized":"2024-05-12T11:09:23.765773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:13:00.756621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671532+0000","last_change":"2024-05-12T11:06:02.153854+0000","last_active":"2024-05-12T11:09:23.671532+0000","last_peered":"2024-05-12T11:09:23.671532+0000","last_clean":"2024-05-12T11:09:23.671532+0000","last_became_active":"2024-05-12T11:06:02.153501+0000","last_became_peered":"2024-05-12T11:06:02.153501+0000","last_unstale":"2024-05-12T11:09:23.671532+0000","last_undegraded":"2024-05-12T11:09:23.671532+0000","last_fullsized":"2024-05-12T11:09:23.671532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:42:37.608641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919448+0000","last_change":"2024-05-12T11:06:05.169348+0000","last_active":"2024-05-12T11:09:23.919448+0000","last_peered":"2024-05-12T11:09:23.919448+0000","last_clean":"2024-05-12T11:09:23.919448+0000","last_became_active":"2024-05-12T11:06:05.169031+0000","last_became_peered":"2024-05-12T11:06:05.169031+0000","last_unstale":"2024-05-12T11:09:23.919448+0000","last_undegraded":"2024-05-12T11:09:23.919448+0000","last_fullsized":"2024-05-12T11:09:23.919448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:07:13.104465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771913+0000","last_change":"2024-05-12T11:06:02.152482+0000","last_active":"2024-05-12T11:09:23.771913+0000","last_peered":"2024-05-12T11:09:23.771913+0000","last_clean":"2024-05-12T11:09:23.771913+0000","last_became_active":"2024-05-12T11:06:02.152077+0000","last_became_peered":"2024-05-12T11:06:02.152077+0000","last_unstale":"2024-05-12T11:09:23.771913+0000","last_undegraded":"2024-05-12T11:09:23.771913+0000","last_fullsized":"2024-05-12T11:09:23.771913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:42.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920242+0000","last_change":"2024-05-12T11:06:05.175228+0000","last_active":"2024-05-12T11:09:23.920242+0000","last_peered":"2024-05-12T11:09:23.920242+0000","last_clean":"2024-05-12T11:09:23.920242+0000","last_became_active":"2024-05-12T11:06:05.174892+0000","last_became_peered":"2024-05-12T11:06:05.174892+0000","last_unstale":"2024-05-12T11:09:23.920242+0000","last_undegraded":"2024-05-12T11:09:23.920242+0000","last_fullsized":"2024-05-12T11:09:23.920242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:34.581296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":220,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:24.486739+0000","last_change":"2024-05-12T11:06:02.149923+0000","last_active":"2024-05-12T11:09:24.486739+0000","last_peered":"2024-05-12T11:09:24.486739+0000","last_clean":"2024-05-12T11:09:24.486739+0000","last_became_active":"2024-05-12T11:06:02.149571+0000","last_became_peered":"2024-05-12T11:06:02.149571+0000","last_unstale":"2024-05-12T11:09:24.486739+0000","last_undegraded":"2024-05-12T11:09:24.486739+0000","last_fullsized":"2024-05-12T11:09:24.486739+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:23:36.118502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919660+0000","last_change":"2024-05-12T11:06:05.178843+0000","last_active":"2024-05-12T11:09:23.919660+0000","last_peered":"2024-05-12T11:09:23.919660+0000","last_clean":"2024-05-12T11:09:23.919660+0000","last_became_active":"2024-05-12T11:06:05.178526+0000","last_became_peered":"2024-05-12T11:06:05.178526+0000","last_unstale":"2024-05-12T11:09:23.919660+0000","last_undegraded":"2024-05-12T11:09:23.919660+0000","last_fullsized":"2024-05-12T11:09:23.919660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:57.760329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765564+0000","last_change":"2024-05-12T11:06:45.512231+0000","last_active":"2024-05-12T11:09:23.765564+0000","last_peered":"2024-05-12T11:09:23.765564+0000","last_clean":"2024-05-12T11:09:23.765564+0000","last_became_active":"2024-05-12T11:06:45.499482+0000","last_became_peered":"2024-05-12T11:06:45.499482+0000","last_unstale":"2024-05-12T11:09:23.765564+0000","last_undegraded":"2024-05-12T11:09:23.765564+0000","last_fullsized":"2024-05-12T11:09:23.765564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:34:43.986131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771846+0000","last_change":"2024-05-12T11:06:05.168307+0000","last_active":"2024-05-12T11:09:23.771846+0000","last_peered":"2024-05-12T11:09:23.771846+0000","last_clean":"2024-05-12T11:09:23.771846+0000","last_became_active":"2024-05-12T11:06:05.167606+0000","last_became_peered":"2024-05-12T11:06:05.167606+0000","last_unstale":"2024-05-12T11:09:23.771846+0000","last_undegraded":"2024-05-12T11:09:23.771846+0000","last_fullsized":"2024-05-12T11:09:23.771846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:25:09.384425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765924+0000","last_change":"2024-05-12T11:06:02.156201+0000","last_active":"2024-05-12T11:09:23.765924+0000","last_peered":"2024-05-12T11:09:23.765924+0000","last_clean":"2024-05-12T11:09:23.765924+0000","last_became_active":"2024-05-12T11:06:02.155398+0000","last_became_peered":"2024-05-12T11:06:02.155398+0000","last_unstale":"2024-05-12T11:09:23.765924+0000","last_undegraded":"2024-05-12T11:09:23.765924+0000","last_fullsized":"2024-05-12T11:09:23.765924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:23:01.157554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976796+0000","last_change":"2024-05-12T11:06:05.176837+0000","last_active":"2024-05-12T11:09:23.976796+0000","last_peered":"2024-05-12T11:09:23.976796+0000","last_clean":"2024-05-12T11:09:23.976796+0000","last_became_active":"2024-05-12T11:06:05.176450+0000","last_became_peered":"2024-05-12T11:06:05.176450+0000","last_unstale":"2024-05-12T11:09:23.976796+0000","last_undegraded":"2024-05-12T11:09:23.976796+0000","last_fullsized":"2024-05-12T11:09:23.976796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:36:17.654259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668198+0000","last_change":"2024-05-12T11:06:02.246999+0000","last_active":"2024-05-12T11:09:23.668198+0000","last_peered":"2024-05-12T11:09:23.668198+0000","last_clean":"2024-05-12T11:09:23.668198+0000","last_became_active":"2024-05-12T11:06:02.246063+0000","last_became_peered":"2024-05-12T11:06:02.246063+0000","last_unstale":"2024-05-12T11:09:23.668198+0000","last_undegraded":"2024-05-12T11:09:23.668198+0000","last_fullsized":"2024-05-12T11:09:23.668198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:39.303069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.775094+0000","last_change":"2024-05-12T11:06:05.175333+0000","last_active":"2024-05-12T11:09:23.775094+0000","last_peered":"2024-05-12T11:09:23.775094+0000","last_clean":"2024-05-12T11:09:23.775094+0000","last_became_active":"2024-05-12T11:06:05.175011+0000","last_became_peered":"2024-05-12T11:06:05.175011+0000","last_unstale":"2024-05-12T11:09:23.775094+0000","last_undegraded":"2024-05-12T11:09:23.775094+0000","last_fullsized":"2024-05-12T11:09:23.775094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:51:57.025941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:24.486885+0000","last_change":"2024-05-12T11:06:02.151044+0000","last_active":"2024-05-12T11:09:24.486885+0000","last_peered":"2024-05-12T11:09:24.486885+0000","last_clean":"2024-05-12T11:09:24.486885+0000","last_became_active":"2024-05-12T11:06:02.150011+0000","last_became_peered":"2024-05-12T11:06:02.150011+0000","last_unstale":"2024-05-12T11:09:24.486885+0000","last_undegraded":"2024-05-12T11:09:24.486885+0000","last_fullsized":"2024-05-12T11:09:24.486885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:16:14.058893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774954+0000","last_change":"2024-05-12T11:06:05.179210+0000","last_active":"2024-05-12T11:09:23.774954+0000","last_peered":"2024-05-12T11:09:23.774954+0000","last_clean":"2024-05-12T11:09:23.774954+0000","last_became_active":"2024-05-12T11:06:05.178853+0000","last_became_peered":"2024-05-12T11:06:05.178853+0000","last_unstale":"2024-05-12T11:09:23.774954+0000","last_undegraded":"2024-05-12T11:09:23.774954+0000","last_fullsized":"2024-05-12T11:09:23.774954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:50:05.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772157+0000","last_change":"2024-05-12T11:06:05.170860+0000","last_active":"2024-05-12T11:09:23.772157+0000","last_peered":"2024-05-12T11:09:23.772157+0000","last_clean":"2024-05-12T11:09:23.772157+0000","last_became_active":"2024-05-12T11:06:05.170502+0000","last_became_peered":"2024-05-12T11:06:05.170502+0000","last_unstale":"2024-05-12T11:09:23.772157+0000","last_undegraded":"2024-05-12T11:09:23.772157+0000","last_fullsized":"2024-05-12T11:09:23.772157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:26:46.495176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'6","reported_seq":218,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921670+0000","last_change":"2024-05-12T11:06:02.245996+0000","last_active":"2024-05-12T11:09:23.921670+0000","last_peered":"2024-05-12T11:09:23.921670+0000","last_clean":"2024-05-12T11:09:23.921670+0000","last_became_active":"2024-05-12T11:06:02.245629+0000","last_became_peered":"2024-05-12T11:06:02.245629+0000","last_unstale":"2024-05-12T11:09:23.921670+0000","last_undegraded":"2024-05-12T11:09:23.921670+0000","last_fullsized":"2024-05-12T11:09:23.921670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:02:54.794852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":183,"num_read_kb":183,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765708+0000","last_change":"2024-05-12T11:06:05.174731+0000","last_active":"2024-05-12T11:09:23.765708+0000","last_peered":"2024-05-12T11:09:23.765708+0000","last_clean":"2024-05-12T11:09:23.765708+0000","last_became_active":"2024-05-12T11:06:05.174396+0000","last_became_peered":"2024-05-12T11:06:05.174396+0000","last_unstale":"2024-05-12T11:09:23.765708+0000","last_undegraded":"2024-05-12T11:09:23.765708+0000","last_fullsized":"2024-05-12T11:09:23.765708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:30:48.352011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.670989+0000","last_change":"2024-05-12T11:06:02.153635+0000","last_active":"2024-05-12T11:09:23.670989+0000","last_peered":"2024-05-12T11:09:23.670989+0000","last_clean":"2024-05-12T11:09:23.670989+0000","last_became_active":"2024-05-12T11:06:02.153268+0000","last_became_peered":"2024-05-12T11:06:02.153268+0000","last_unstale":"2024-05-12T11:09:23.670989+0000","last_undegraded":"2024-05-12T11:09:23.670989+0000","last_fullsized":"2024-05-12T11:09:23.670989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:55.245138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":104,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919796+0000","last_change":"2024-05-12T11:04:37.106045+0000","last_active":"2024-05-12T11:09:23.919796+0000","last_peered":"2024-05-12T11:09:23.919796+0000","last_clean":"2024-05-12T11:09:23.919796+0000","last_became_active":"2024-05-12T11:04:37.101364+0000","last_became_peered":"2024-05-12T11:04:37.101364+0000","last_unstale":"2024-05-12T11:09:23.919796+0000","last_undegraded":"2024-05-12T11:09:23.919796+0000","last_fullsized":"2024-05-12T11:09:23.919796+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_clean_scrub_stamp":"2024-05-12T11:01:12.632157+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:53:22.531168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919347+0000","last_change":"2024-05-12T11:06:05.163927+0000","last_active":"2024-05-12T11:09:23.919347+0000","last_peered":"2024-05-12T11:09:23.919347+0000","last_clean":"2024-05-12T11:09:23.919347+0000","last_became_active":"2024-05-12T11:06:05.163610+0000","last_became_peered":"2024-05-12T11:06:05.163610+0000","last_unstale":"2024-05-12T11:09:23.919347+0000","last_undegraded":"2024-05-12T11:09:23.919347+0000","last_fullsized":"2024-05-12T11:09:23.919347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:58:31.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919949+0000","last_change":"2024-05-12T11:06:02.152658+0000","last_active":"2024-05-12T11:09:23.919949+0000","last_peered":"2024-05-12T11:09:23.919949+0000","last_clean":"2024-05-12T11:09:23.919949+0000","last_became_active":"2024-05-12T11:06:02.151770+0000","last_became_peered":"2024-05-12T11:06:02.151770+0000","last_unstale":"2024-05-12T11:09:23.919949+0000","last_undegraded":"2024-05-12T11:09:23.919949+0000","last_fullsized":"2024-05-12T11:09:23.919949+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:18.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765861+0000","last_change":"2024-05-12T11:06:02.246421+0000","last_active":"2024-05-12T11:09:23.765861+0000","last_peered":"2024-05-12T11:09:23.765861+0000","last_clean":"2024-05-12T11:09:23.765861+0000","last_became_active":"2024-05-12T11:06:02.246065+0000","last_became_peered":"2024-05-12T11:06:02.246065+0000","last_unstale":"2024-05-12T11:09:23.765861+0000","last_undegraded":"2024-05-12T11:09:23.765861+0000","last_fullsized":"2024-05-12T11:09:23.765861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:34:28.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919819+0000","last_change":"2024-05-12T11:06:05.166916+0000","last_active":"2024-05-12T11:09:23.919819+0000","last_peered":"2024-05-12T11:09:23.919819+0000","last_clean":"2024-05-12T11:09:23.919819+0000","last_became_active":"2024-05-12T11:06:05.165877+0000","last_became_peered":"2024-05-12T11:06:05.165877+0000","last_unstale":"2024-05-12T11:09:23.919819+0000","last_undegraded":"2024-05-12T11:09:23.919819+0000","last_fullsized":"2024-05-12T11:09:23.919819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:46:47.935159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'52","reported_seq":104,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.881953+0000","last_change":"2024-05-12T11:06:02.151339+0000","last_active":"2024-05-12T11:09:23.881953+0000","last_peered":"2024-05-12T11:09:23.881953+0000","last_clean":"2024-05-12T11:09:23.881953+0000","last_became_active":"2024-05-12T11:06:02.150968+0000","last_became_peered":"2024-05-12T11:06:02.150968+0000","last_unstale":"2024-05-12T11:09:23.881953+0000","last_undegraded":"2024-05-12T11:09:23.881953+0000","last_fullsized":"2024-05-12T11:09:23.881953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:22:39.625972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":93,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.766041+0000","last_change":"2024-05-12T11:06:05.165277+0000","last_active":"2024-05-12T11:09:23.766041+0000","last_peered":"2024-05-12T11:09:23.766041+0000","last_clean":"2024-05-12T11:09:23.766041+0000","last_became_active":"2024-05-12T11:06:05.164992+0000","last_became_peered":"2024-05-12T11:06:05.164992+0000","last_unstale":"2024-05-12T11:09:23.766041+0000","last_undegraded":"2024-05-12T11:09:23.766041+0000","last_fullsized":"2024-05-12T11:09:23.766041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:18.193170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671252+0000","last_change":"2024-05-12T11:06:02.151167+0000","last_active":"2024-05-12T11:09:23.671252+0000","last_peered":"2024-05-12T11:09:23.671252+0000","last_clean":"2024-05-12T11:09:23.671252+0000","last_became_active":"2024-05-12T11:06:02.150815+0000","last_became_peered":"2024-05-12T11:06:02.150815+0000","last_unstale":"2024-05-12T11:09:23.671252+0000","last_undegraded":"2024-05-12T11:09:23.671252+0000","last_fullsized":"2024-05-12T11:09:23.671252+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:50.811297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922434+0000","last_change":"2024-05-12T11:06:45.352790+0000","last_active":"2024-05-12T11:09:23.922434+0000","last_peered":"2024-05-12T11:09:23.922434+0000","last_clean":"2024-05-12T11:09:23.922434+0000","last_became_active":"2024-05-12T11:06:45.352409+0000","last_became_peered":"2024-05-12T11:06:45.352409+0000","last_unstale":"2024-05-12T11:09:23.922434+0000","last_undegraded":"2024-05-12T11:09:23.922434+0000","last_fullsized":"2024-05-12T11:09:23.922434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:16.535709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920508+0000","last_change":"2024-05-12T11:06:02.246676+0000","last_active":"2024-05-12T11:09:23.920508+0000","last_peered":"2024-05-12T11:09:23.920508+0000","last_clean":"2024-05-12T11:09:23.920508+0000","last_became_active":"2024-05-12T11:06:02.246344+0000","last_became_peered":"2024-05-12T11:06:02.246344+0000","last_unstale":"2024-05-12T11:09:23.920508+0000","last_undegraded":"2024-05-12T11:09:23.920508+0000","last_fullsized":"2024-05-12T11:09:23.920508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:17.805058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765550+0000","last_change":"2024-05-12T11:06:05.175597+0000","last_active":"2024-05-12T11:09:23.765550+0000","last_peered":"2024-05-12T11:09:23.765550+0000","last_clean":"2024-05-12T11:09:23.765550+0000","last_became_active":"2024-05-12T11:06:05.175237+0000","last_became_peered":"2024-05-12T11:06:05.175237+0000","last_unstale":"2024-05-12T11:09:23.765550+0000","last_undegraded":"2024-05-12T11:09:23.765550+0000","last_fullsized":"2024-05-12T11:09:23.765550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:50:12.872570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765526+0000","last_change":"2024-05-12T11:06:02.148706+0000","last_active":"2024-05-12T11:09:23.765526+0000","last_peered":"2024-05-12T11:09:23.765526+0000","last_clean":"2024-05-12T11:09:23.765526+0000","last_became_active":"2024-05-12T11:06:02.148437+0000","last_became_peered":"2024-05-12T11:06:02.148437+0000","last_unstale":"2024-05-12T11:09:23.765526+0000","last_undegraded":"2024-05-12T11:09:23.765526+0000","last_fullsized":"2024-05-12T11:09:23.765526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:54:39.969677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976534+0000","last_change":"2024-05-12T11:06:05.174248+0000","last_active":"2024-05-12T11:09:23.976534+0000","last_peered":"2024-05-12T11:09:23.976534+0000","last_clean":"2024-05-12T11:09:23.976534+0000","last_became_active":"2024-05-12T11:06:05.173934+0000","last_became_peered":"2024-05-12T11:06:05.173934+0000","last_unstale":"2024-05-12T11:09:23.976534+0000","last_undegraded":"2024-05-12T11:09:23.976534+0000","last_fullsized":"2024-05-12T11:09:23.976534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:04:58.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976602+0000","last_change":"2024-05-12T11:06:45.316406+0000","last_active":"2024-05-12T11:09:23.976602+0000","last_peered":"2024-05-12T11:09:23.976602+0000","last_clean":"2024-05-12T11:09:23.976602+0000","last_became_active":"2024-05-12T11:06:45.310351+0000","last_became_peered":"2024-05-12T11:06:45.310351+0000","last_unstale":"2024-05-12T11:09:23.976602+0000","last_undegraded":"2024-05-12T11:09:23.976602+0000","last_fullsized":"2024-05-12T11:09:23.976602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:11.687974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765821+0000","last_change":"2024-05-12T11:06:05.177548+0000","last_active":"2024-05-12T11:09:23.765821+0000","last_peered":"2024-05-12T11:09:23.765821+0000","last_clean":"2024-05-12T11:09:23.765821+0000","last_became_active":"2024-05-12T11:06:05.176871+0000","last_became_peered":"2024-05-12T11:06:05.176871+0000","last_unstale":"2024-05-12T11:09:23.765821+0000","last_undegraded":"2024-05-12T11:09:23.765821+0000","last_fullsized":"2024-05-12T11:09:23.765821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:38:08.347801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765672+0000","last_change":"2024-05-12T11:06:02.155096+0000","last_active":"2024-05-12T11:09:23.765672+0000","last_peered":"2024-05-12T11:09:23.765672+0000","last_clean":"2024-05-12T11:09:23.765672+0000","last_became_active":"2024-05-12T11:06:02.154721+0000","last_became_peered":"2024-05-12T11:06:02.154721+0000","last_unstale":"2024-05-12T11:09:23.765672+0000","last_undegraded":"2024-05-12T11:09:23.765672+0000","last_fullsized":"2024-05-12T11:09:23.765672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:01.407453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920661+0000","last_change":"2024-05-12T11:06:05.170305+0000","last_active":"2024-05-12T11:09:23.920661+0000","last_peered":"2024-05-12T11:09:23.920661+0000","last_clean":"2024-05-12T11:09:23.920661+0000","last_became_active":"2024-05-12T11:06:05.169970+0000","last_became_peered":"2024-05-12T11:06:05.169970+0000","last_unstale":"2024-05-12T11:09:23.920661+0000","last_undegraded":"2024-05-12T11:09:23.920661+0000","last_fullsized":"2024-05-12T11:09:23.920661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:48:11.680873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":220,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671690+0000","last_change":"2024-05-12T11:06:02.246541+0000","last_active":"2024-05-12T11:09:23.671690+0000","last_peered":"2024-05-12T11:09:23.671690+0000","last_clean":"2024-05-12T11:09:23.671690+0000","last_became_active":"2024-05-12T11:06:02.246071+0000","last_became_peered":"2024-05-12T11:06:02.246071+0000","last_unstale":"2024-05-12T11:09:23.671690+0000","last_undegraded":"2024-05-12T11:09:23.671690+0000","last_fullsized":"2024-05-12T11:09:23.671690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:27:16.649146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1478,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920824+0000","last_change":"2024-05-12T11:06:05.170566+0000","last_active":"2024-05-12T11:09:23.920824+0000","last_peered":"2024-05-12T11:09:23.920824+0000","last_clean":"2024-05-12T11:09:23.920824+0000","last_became_active":"2024-05-12T11:06:05.170225+0000","last_became_peered":"2024-05-12T11:06:05.170225+0000","last_unstale":"2024-05-12T11:09:23.920824+0000","last_undegraded":"2024-05-12T11:09:23.920824+0000","last_fullsized":"2024-05-12T11:09:23.920824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:42.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.876495+0000","last_change":"2024-05-12T11:06:02.151920+0000","last_active":"2024-05-12T11:09:23.876495+0000","last_peered":"2024-05-12T11:09:23.876495+0000","last_clean":"2024-05-12T11:09:23.876495+0000","last_became_active":"2024-05-12T11:06:02.151551+0000","last_became_peered":"2024-05-12T11:06:02.151551+0000","last_unstale":"2024-05-12T11:09:23.876495+0000","last_undegraded":"2024-05-12T11:09:23.876495+0000","last_fullsized":"2024-05-12T11:09:23.876495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:11:10.230956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919985+0000","last_change":"2024-05-12T11:06:05.174964+0000","last_active":"2024-05-12T11:09:23.919985+0000","last_peered":"2024-05-12T11:09:23.919985+0000","last_clean":"2024-05-12T11:09:23.919985+0000","last_became_active":"2024-05-12T11:06:05.174562+0000","last_became_peered":"2024-05-12T11:06:05.174562+0000","last_unstale":"2024-05-12T11:09:23.919985+0000","last_undegraded":"2024-05-12T11:09:23.919985+0000","last_fullsized":"2024-05-12T11:09:23.919985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:37:22.252200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919578+0000","last_change":"2024-05-12T11:06:45.319312+0000","last_active":"2024-05-12T11:09:23.919578+0000","last_peered":"2024-05-12T11:09:23.919578+0000","last_clean":"2024-05-12T11:09:23.919578+0000","last_became_active":"2024-05-12T11:06:45.310683+0000","last_became_peered":"2024-05-12T11:06:45.310683+0000","last_unstale":"2024-05-12T11:09:23.919578+0000","last_undegraded":"2024-05-12T11:09:23.919578+0000","last_fullsized":"2024-05-12T11:09:23.919578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:24:21.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921060+0000","last_change":"2024-05-12T11:06:05.176798+0000","last_active":"2024-05-12T11:09:23.921060+0000","last_peered":"2024-05-12T11:09:23.921060+0000","last_clean":"2024-05-12T11:09:23.921060+0000","last_became_active":"2024-05-12T11:06:05.176476+0000","last_became_peered":"2024-05-12T11:06:05.176476+0000","last_unstale":"2024-05-12T11:09:23.921060+0000","last_undegraded":"2024-05-12T11:09:23.921060+0000","last_fullsized":"2024-05-12T11:09:23.921060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:16.111038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976635+0000","last_change":"2024-05-12T11:06:05.180278+0000","last_active":"2024-05-12T11:09:23.976635+0000","last_peered":"2024-05-12T11:09:23.976635+0000","last_clean":"2024-05-12T11:09:23.976635+0000","last_became_active":"2024-05-12T11:06:05.179863+0000","last_became_peered":"2024-05-12T11:06:05.179863+0000","last_unstale":"2024-05-12T11:09:23.976635+0000","last_undegraded":"2024-05-12T11:09:23.976635+0000","last_fullsized":"2024-05-12T11:09:23.976635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:13:32.588753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671258+0000","last_change":"2024-05-12T11:06:45.499552+0000","last_active":"2024-05-12T11:09:23.671258+0000","last_peered":"2024-05-12T11:09:23.671258+0000","last_clean":"2024-05-12T11:09:23.671258+0000","last_became_active":"2024-05-12T11:06:45.499078+0000","last_became_peered":"2024-05-12T11:06:45.499078+0000","last_unstale":"2024-05-12T11:09:23.671258+0000","last_undegraded":"2024-05-12T11:09:23.671258+0000","last_fullsized":"2024-05-12T11:09:23.671258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:41:37.019535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671159+0000","last_change":"2024-05-12T11:06:05.172282+0000","last_active":"2024-05-12T11:09:23.671159+0000","last_peered":"2024-05-12T11:09:23.671159+0000","last_clean":"2024-05-12T11:09:23.671159+0000","last_became_active":"2024-05-12T11:06:05.171930+0000","last_became_peered":"2024-05-12T11:06:05.171930+0000","last_unstale":"2024-05-12T11:09:23.671159+0000","last_undegraded":"2024-05-12T11:09:23.671159+0000","last_fullsized":"2024-05-12T11:09:23.671159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:20:56.314181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922703+0000","last_change":"2024-05-12T11:06:05.173726+0000","last_active":"2024-05-12T11:09:23.922703+0000","last_peered":"2024-05-12T11:09:23.922703+0000","last_clean":"2024-05-12T11:09:23.922703+0000","last_became_active":"2024-05-12T11:06:05.173195+0000","last_became_peered":"2024-05-12T11:06:05.173195+0000","last_unstale":"2024-05-12T11:09:23.922703+0000","last_undegraded":"2024-05-12T11:09:23.922703+0000","last_fullsized":"2024-05-12T11:09:23.922703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:19.397213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919890+0000","last_change":"2024-05-12T11:06:05.167841+0000","last_active":"2024-05-12T11:09:23.919890+0000","last_peered":"2024-05-12T11:09:23.919890+0000","last_clean":"2024-05-12T11:09:23.919890+0000","last_became_active":"2024-05-12T11:06:05.166577+0000","last_became_peered":"2024-05-12T11:06:05.166577+0000","last_unstale":"2024-05-12T11:09:23.919890+0000","last_undegraded":"2024-05-12T11:09:23.919890+0000","last_fullsized":"2024-05-12T11:09:23.919890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:01.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976819+0000","last_change":"2024-05-12T11:06:05.170753+0000","last_active":"2024-05-12T11:09:23.976819+0000","last_peered":"2024-05-12T11:09:23.976819+0000","last_clean":"2024-05-12T11:09:23.976819+0000","last_became_active":"2024-05-12T11:06:05.169410+0000","last_became_peered":"2024-05-12T11:06:05.169410+0000","last_unstale":"2024-05-12T11:09:23.976819+0000","last_undegraded":"2024-05-12T11:09:23.976819+0000","last_fullsized":"2024-05-12T11:09:23.976819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:42:30.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671774+0000","last_change":"2024-05-12T11:06:05.170692+0000","last_active":"2024-05-12T11:09:23.671774+0000","last_peered":"2024-05-12T11:09:23.671774+0000","last_clean":"2024-05-12T11:09:23.671774+0000","last_became_active":"2024-05-12T11:06:05.170349+0000","last_became_peered":"2024-05-12T11:06:05.170349+0000","last_unstale":"2024-05-12T11:09:23.671774+0000","last_undegraded":"2024-05-12T11:09:23.671774+0000","last_fullsized":"2024-05-12T11:09:23.671774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:13:19.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765923+0000","last_change":"2024-05-12T11:06:05.173600+0000","last_active":"2024-05-12T11:09:23.765923+0000","last_peered":"2024-05-12T11:09:23.765923+0000","last_clean":"2024-05-12T11:09:23.765923+0000","last_became_active":"2024-05-12T11:06:05.173288+0000","last_became_peered":"2024-05-12T11:06:05.173288+0000","last_unstale":"2024-05-12T11:09:23.765923+0000","last_undegraded":"2024-05-12T11:09:23.765923+0000","last_fullsized":"2024-05-12T11:09:23.765923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:06:45.082031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771886+0000","last_change":"2024-05-12T11:06:05.169864+0000","last_active":"2024-05-12T11:09:23.771886+0000","last_peered":"2024-05-12T11:09:23.771886+0000","last_clean":"2024-05-12T11:09:23.771886+0000","last_became_active":"2024-05-12T11:06:05.169521+0000","last_became_peered":"2024-05-12T11:06:05.169521+0000","last_unstale":"2024-05-12T11:09:23.771886+0000","last_undegraded":"2024-05-12T11:09:23.771886+0000","last_fullsized":"2024-05-12T11:09:23.771886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.825436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765482+0000","last_change":"2024-05-12T11:06:05.176370+0000","last_active":"2024-05-12T11:09:23.765482+0000","last_peered":"2024-05-12T11:09:23.765482+0000","last_clean":"2024-05-12T11:09:23.765482+0000","last_became_active":"2024-05-12T11:06:05.176031+0000","last_became_peered":"2024-05-12T11:06:05.176031+0000","last_unstale":"2024-05-12T11:09:23.765482+0000","last_undegraded":"2024-05-12T11:09:23.765482+0000","last_fullsized":"2024-05-12T11:09:23.765482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:32:52.893909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920674+0000","last_change":"2024-05-12T11:06:05.170708+0000","last_active":"2024-05-12T11:09:23.920674+0000","last_peered":"2024-05-12T11:09:23.920674+0000","last_clean":"2024-05-12T11:09:23.920674+0000","last_became_active":"2024-05-12T11:06:05.169591+0000","last_became_peered":"2024-05-12T11:06:05.169591+0000","last_unstale":"2024-05-12T11:09:23.920674+0000","last_undegraded":"2024-05-12T11:09:23.920674+0000","last_fullsized":"2024-05-12T11:09:23.920674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:08.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919879+0000","last_change":"2024-05-12T11:06:05.172614+0000","last_active":"2024-05-12T11:09:23.919879+0000","last_peered":"2024-05-12T11:09:23.919879+0000","last_clean":"2024-05-12T11:09:23.919879+0000","last_became_active":"2024-05-12T11:06:05.172290+0000","last_became_peered":"2024-05-12T11:06:05.172290+0000","last_unstale":"2024-05-12T11:09:23.919879+0000","last_undegraded":"2024-05-12T11:09:23.919879+0000","last_fullsized":"2024-05-12T11:09:23.919879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:32.169139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976714+0000","last_change":"2024-05-12T11:06:05.171333+0000","last_active":"2024-05-12T11:09:23.976714+0000","last_peered":"2024-05-12T11:09:23.976714+0000","last_clean":"2024-05-12T11:09:23.976714+0000","last_became_active":"2024-05-12T11:06:05.170035+0000","last_became_peered":"2024-05-12T11:06:05.170035+0000","last_unstale":"2024-05-12T11:09:23.976714+0000","last_undegraded":"2024-05-12T11:09:23.976714+0000","last_fullsized":"2024-05-12T11:09:23.976714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:18.852851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107193,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600339,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1958,"num_read_kb":1094,"num_write":376,"num_write_kb":1464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1801017,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645367,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":443342,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841596,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":1232951,"data_compressed":50504,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005122,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":835598,"data_compressed":27726,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201351,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":946176,"data_stored":835394,"data_compressed":27763,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397580,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":1036201,"data_compressed":44348,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561105,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":913408,"data_stored":442490,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":510882,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":443746,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411430,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":511439,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149791,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":966740,"data_compressed":33919,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953563,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":921600,"data_stored":442463,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757334,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1011712,"data_stored":1166697,"data_compressed":50504,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":134952,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":394134,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":201206,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T11:09:30.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-12T11:09:30.556 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:31.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:30 smithi086 ceph-mon[30110]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:31.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:30 smithi086 ceph-mon[30110]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-05-12T11:09:31.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:30 smithi172 ceph-mon[34517]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:31.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:30 smithi172 ceph-mon[34517]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-05-12T11:09:31.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:30 smithi176 ceph-mon[34357]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:31.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:30 smithi176 ceph-mon[34357]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-05-12T11:09:32.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 -- 172.21.15.86:0/2721205516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06bb40 msgr2=0x7effac110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 --2- 172.21.15.86:0/2721205516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06bb40 0x7effac110330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7effa400b0a0 tx=0x7effa400b3b0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 -- 172.21.15.86:0/2721205516 shutdown_connections 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 --2- 172.21.15.86:0/2721205516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06bb40 0x7effac110330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 --2- 172.21.15.86:0/2721205516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effac109510 0x7effac1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 --2- 172.21.15.86:0/2721205516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effac06b180 0x7effac06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 -- 172.21.15.86:0/2721205516 >> 172.21.15.86:0/2721205516 conn(0x7effac079350 msgr2=0x7effac079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 -- 172.21.15.86:0/2721205516 shutdown_connections 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.207+0000 7effb1da5700 1 -- 172.21.15.86:0/2721205516 wait complete. 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effb1da5700 1 Processor -- start 2024-05-12T11:09:32.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effb1da5700 1 -- start start 2024-05-12T11:09:32.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effb1da5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06b180 0x7effac19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:32.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effb1da5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effac06bb40 0x7effac19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:32.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effb1da5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effac109510 0x7effac1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effb1da5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7effac1136a0 con 0x7effac06b180 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effb1da5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effac113520 con 0x7effac06bb40 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effb1da5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7effac113820 con 0x7effac109510 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effab7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06b180 0x7effac19f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effab7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06b180 0x7effac19f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35790/0 (socket says 172.21.15.86:35790) 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effab7fe700 1 -- 172.21.15.86:0/257759091 learned_addr learned my addr 172.21.15.86:0/257759091 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effa3fff700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effac06bb40 0x7effac19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effabfff700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effac109510 0x7effac1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.208+0000 7effab7fe700 1 -- 172.21.15.86:0/257759091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effac109510 msgr2=0x7effac1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effab7fe700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effac109510 0x7effac1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effab7fe700 1 -- 172.21.15.86:0/257759091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effac06bb40 msgr2=0x7effac19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effab7fe700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effac06bb40 0x7effac19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effab7fe700 1 -- 172.21.15.86:0/257759091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac19a100 con 0x7effac06b180 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effabfff700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effac109510 0x7effac1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effa3fff700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effac06bb40 0x7effac19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effab7fe700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06b180 0x7effac19f790 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00d950 tx=0x7eff9c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effa97fa700 1 -- 172.21.15.86:0/257759091 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c016070 con 0x7effac06b180 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effa97fa700 1 -- 172.21.15.86:0/257759091 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff9c010460 con 0x7effac06b180 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effa97fa700 1 -- 172.21.15.86:0/257759091 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00f620 con 0x7effac06b180 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac19a3f0 con 0x7effac06b180 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.209+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac1a6660 con 0x7effac06b180 2024-05-12T11:09:32.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.210+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effac06a190 con 0x7effac06b180 2024-05-12T11:09:32.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.212+0000 7effa97fa700 1 -- 172.21.15.86:0/257759091 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7eff9c019070 con 0x7effac06b180 2024-05-12T11:09:32.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.213+0000 7effa97fa700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff980b2b90 0x7eff980b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:32.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.213+0000 7effa3fff700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff980b2b90 0x7eff980b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:32.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.213+0000 7effa97fa700 1 -- 172.21.15.86:0/257759091 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7eff9c0e2480 con 0x7effac06b180 2024-05-12T11:09:32.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.213+0000 7effa3fff700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff980b2b90 0x7eff980b5050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7effac079950 tx=0x7eff94008040 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:32.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.216+0000 7effa97fa700 1 -- 172.21.15.86:0/257759091 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7eff9c0a9c10 con 0x7effac06b180 2024-05-12T11:09:32.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.416+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effac0638e0 con 0x7eff980b2b90 2024-05-12T11:09:32.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.423+0000 7effa97fa700 1 -- 172.21.15.86:0/257759091 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258085 (secure 0 0 0) 0x7effac0638e0 con 0x7eff980b2b90 2024-05-12T11:09:32.418 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:09:32.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff980b2b90 msgr2=0x7eff980b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff980b2b90 0x7eff980b5050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7effac079950 tx=0x7eff94008040 comp rx=0 tx=0).stop 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06b180 msgr2=0x7effac19f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06b180 0x7effac19f790 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00d950 tx=0x7eff9c00dd10 comp rx=0 tx=0).stop 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 shutdown_connections 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effac109510 0x7effac1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff980b2b90 0x7eff980b5050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effac06b180 0x7effac19f790 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 --2- 172.21.15.86:0/257759091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effac06bb40 0x7effac19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 >> 172.21.15.86:0/257759091 conn(0x7effac079350 msgr2=0x7effac1010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 shutdown_connections 2024-05-12T11:09:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:32.426+0000 7effb1da5700 1 -- 172.21.15.86:0/257759091 wait complete. 2024-05-12T11:09:32.421 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-05-12T11:09:33.134 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:32 smithi086 ceph-mon[30110]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-05-12T11:09:33.174 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-05-12T11:09:31.685259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1391266,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2408,"num_read_kb":1600,"num_write":648,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":2952534,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":988,"ondisk_log_size":988,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377252,"kb_used_data":11412,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564572,"statfs":{"total":1151940427776,"available":1151554121728,"internally_reserved":0,"allocated":11685888,"data_stored":9461358,"data_compressed":314070,"data_compressed_allocated":417792,"data_compressed_original":4165632,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200325,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":437,"num_write":147,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.990222"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976891+0000","last_change":"2024-05-12T11:06:05.173542+0000","last_active":"2024-05-12T11:09:23.976891+0000","last_peered":"2024-05-12T11:09:23.976891+0000","last_clean":"2024-05-12T11:09:23.976891+0000","last_became_active":"2024-05-12T11:06:05.173221+0000","last_became_peered":"2024-05-12T11:06:05.173221+0000","last_unstale":"2024-05-12T11:09:23.976891+0000","last_undegraded":"2024-05-12T11:09:23.976891+0000","last_fullsized":"2024-05-12T11:09:23.976891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922383+0000","last_change":"2024-05-12T11:06:05.178626+0000","last_active":"2024-05-12T11:09:23.922383+0000","last_peered":"2024-05-12T11:09:23.922383+0000","last_clean":"2024-05-12T11:09:23.922383+0000","last_became_active":"2024-05-12T11:06:05.178313+0000","last_became_peered":"2024-05-12T11:06:05.178313+0000","last_unstale":"2024-05-12T11:09:23.922383+0000","last_undegraded":"2024-05-12T11:09:23.922383+0000","last_fullsized":"2024-05-12T11:09:23.922383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:45:25.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922151+0000","last_change":"2024-05-12T11:06:05.175396+0000","last_active":"2024-05-12T11:09:23.922151+0000","last_peered":"2024-05-12T11:09:23.922151+0000","last_clean":"2024-05-12T11:09:23.922151+0000","last_became_active":"2024-05-12T11:06:05.175060+0000","last_became_peered":"2024-05-12T11:06:05.175060+0000","last_unstale":"2024-05-12T11:09:23.922151+0000","last_undegraded":"2024-05-12T11:09:23.922151+0000","last_fullsized":"2024-05-12T11:09:23.922151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:55:08.180220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671170+0000","last_change":"2024-05-12T11:06:05.172900+0000","last_active":"2024-05-12T11:09:23.671170+0000","last_peered":"2024-05-12T11:09:23.671170+0000","last_clean":"2024-05-12T11:09:23.671170+0000","last_became_active":"2024-05-12T11:06:05.172549+0000","last_became_peered":"2024-05-12T11:06:05.172549+0000","last_unstale":"2024-05-12T11:09:23.671170+0000","last_undegraded":"2024-05-12T11:09:23.671170+0000","last_fullsized":"2024-05-12T11:09:23.671170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:07:39.683046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765667+0000","last_change":"2024-05-12T11:06:05.168126+0000","last_active":"2024-05-12T11:09:23.765667+0000","last_peered":"2024-05-12T11:09:23.765667+0000","last_clean":"2024-05-12T11:09:23.765667+0000","last_became_active":"2024-05-12T11:06:05.167729+0000","last_became_peered":"2024-05-12T11:06:05.167729+0000","last_unstale":"2024-05-12T11:09:23.765667+0000","last_undegraded":"2024-05-12T11:09:23.765667+0000","last_fullsized":"2024-05-12T11:09:23.765667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:38.996242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774891+0000","last_change":"2024-05-12T11:06:05.180165+0000","last_active":"2024-05-12T11:09:23.774891+0000","last_peered":"2024-05-12T11:09:23.774891+0000","last_clean":"2024-05-12T11:09:23.774891+0000","last_became_active":"2024-05-12T11:06:05.179589+0000","last_became_peered":"2024-05-12T11:06:05.179589+0000","last_unstale":"2024-05-12T11:09:23.774891+0000","last_undegraded":"2024-05-12T11:09:23.774891+0000","last_fullsized":"2024-05-12T11:09:23.774891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:51:53.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919741+0000","last_change":"2024-05-12T11:06:05.176052+0000","last_active":"2024-05-12T11:09:23.919741+0000","last_peered":"2024-05-12T11:09:23.919741+0000","last_clean":"2024-05-12T11:09:23.919741+0000","last_became_active":"2024-05-12T11:06:05.175703+0000","last_became_peered":"2024-05-12T11:06:05.175703+0000","last_unstale":"2024-05-12T11:09:23.919741+0000","last_undegraded":"2024-05-12T11:09:23.919741+0000","last_fullsized":"2024-05-12T11:09:23.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:51:11.008516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765437+0000","last_change":"2024-05-12T11:06:05.179144+0000","last_active":"2024-05-12T11:09:23.765437+0000","last_peered":"2024-05-12T11:09:23.765437+0000","last_clean":"2024-05-12T11:09:23.765437+0000","last_became_active":"2024-05-12T11:06:05.177854+0000","last_became_peered":"2024-05-12T11:06:05.177854+0000","last_unstale":"2024-05-12T11:09:23.765437+0000","last_undegraded":"2024-05-12T11:09:23.765437+0000","last_fullsized":"2024-05-12T11:09:23.765437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:12.231086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668172+0000","last_change":"2024-05-12T11:06:45.310743+0000","last_active":"2024-05-12T11:09:23.668172+0000","last_peered":"2024-05-12T11:09:23.668172+0000","last_clean":"2024-05-12T11:09:23.668172+0000","last_became_active":"2024-05-12T11:06:45.310358+0000","last_became_peered":"2024-05-12T11:06:45.310358+0000","last_unstale":"2024-05-12T11:09:23.668172+0000","last_undegraded":"2024-05-12T11:09:23.668172+0000","last_fullsized":"2024-05-12T11:09:23.668172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:22:30.862132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.775252+0000","last_change":"2024-05-12T11:06:05.176196+0000","last_active":"2024-05-12T11:09:23.775252+0000","last_peered":"2024-05-12T11:09:23.775252+0000","last_clean":"2024-05-12T11:09:23.775252+0000","last_became_active":"2024-05-12T11:06:05.175863+0000","last_became_peered":"2024-05-12T11:06:05.175863+0000","last_unstale":"2024-05-12T11:09:23.775252+0000","last_undegraded":"2024-05-12T11:09:23.775252+0000","last_fullsized":"2024-05-12T11:09:23.775252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:26:41.815661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919973+0000","last_change":"2024-05-12T11:06:05.175901+0000","last_active":"2024-05-12T11:09:23.919973+0000","last_peered":"2024-05-12T11:09:23.919973+0000","last_clean":"2024-05-12T11:09:23.919973+0000","last_became_active":"2024-05-12T11:06:05.175514+0000","last_became_peered":"2024-05-12T11:06:05.175514+0000","last_unstale":"2024-05-12T11:09:23.919973+0000","last_undegraded":"2024-05-12T11:09:23.919973+0000","last_fullsized":"2024-05-12T11:09:23.919973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:11.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671109+0000","last_change":"2024-05-12T11:06:05.175474+0000","last_active":"2024-05-12T11:09:23.671109+0000","last_peered":"2024-05-12T11:09:23.671109+0000","last_clean":"2024-05-12T11:09:23.671109+0000","last_became_active":"2024-05-12T11:06:05.175082+0000","last_became_peered":"2024-05-12T11:06:05.175082+0000","last_unstale":"2024-05-12T11:09:23.671109+0000","last_undegraded":"2024-05-12T11:09:23.671109+0000","last_fullsized":"2024-05-12T11:09:23.671109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:10:53.548758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919727+0000","last_change":"2024-05-12T11:06:05.170426+0000","last_active":"2024-05-12T11:09:23.919727+0000","last_peered":"2024-05-12T11:09:23.919727+0000","last_clean":"2024-05-12T11:09:23.919727+0000","last_became_active":"2024-05-12T11:06:05.170111+0000","last_became_peered":"2024-05-12T11:06:05.170111+0000","last_unstale":"2024-05-12T11:09:23.919727+0000","last_undegraded":"2024-05-12T11:09:23.919727+0000","last_fullsized":"2024-05-12T11:09:23.919727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:50.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922244+0000","last_change":"2024-05-12T11:06:05.178939+0000","last_active":"2024-05-12T11:09:23.922244+0000","last_peered":"2024-05-12T11:09:23.922244+0000","last_clean":"2024-05-12T11:09:23.922244+0000","last_became_active":"2024-05-12T11:06:05.178604+0000","last_became_peered":"2024-05-12T11:06:05.178604+0000","last_unstale":"2024-05-12T11:09:23.922244+0000","last_undegraded":"2024-05-12T11:09:23.922244+0000","last_fullsized":"2024-05-12T11:09:23.922244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:36.222841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921990+0000","last_change":"2024-05-12T11:06:45.312800+0000","last_active":"2024-05-12T11:09:23.921990+0000","last_peered":"2024-05-12T11:09:23.921990+0000","last_clean":"2024-05-12T11:09:23.921990+0000","last_became_active":"2024-05-12T11:06:45.312567+0000","last_became_peered":"2024-05-12T11:06:45.312567+0000","last_unstale":"2024-05-12T11:09:23.921990+0000","last_undegraded":"2024-05-12T11:09:23.921990+0000","last_fullsized":"2024-05-12T11:09:23.921990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:30:21.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920501+0000","last_change":"2024-05-12T11:06:05.170481+0000","last_active":"2024-05-12T11:09:23.920501+0000","last_peered":"2024-05-12T11:09:23.920501+0000","last_clean":"2024-05-12T11:09:23.920501+0000","last_became_active":"2024-05-12T11:06:05.170173+0000","last_became_peered":"2024-05-12T11:06:05.170173+0000","last_unstale":"2024-05-12T11:09:23.920501+0000","last_undegraded":"2024-05-12T11:09:23.920501+0000","last_fullsized":"2024-05-12T11:09:23.920501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:01:37.775287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976993+0000","last_change":"2024-05-12T11:06:05.172942+0000","last_active":"2024-05-12T11:09:23.976993+0000","last_peered":"2024-05-12T11:09:23.976993+0000","last_clean":"2024-05-12T11:09:23.976993+0000","last_became_active":"2024-05-12T11:06:05.172612+0000","last_became_peered":"2024-05-12T11:06:05.172612+0000","last_unstale":"2024-05-12T11:09:23.976993+0000","last_undegraded":"2024-05-12T11:09:23.976993+0000","last_fullsized":"2024-05-12T11:09:23.976993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:26:51.548027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668313+0000","last_change":"2024-05-12T11:06:05.175400+0000","last_active":"2024-05-12T11:09:23.668313+0000","last_peered":"2024-05-12T11:09:23.668313+0000","last_clean":"2024-05-12T11:09:23.668313+0000","last_became_active":"2024-05-12T11:06:05.174871+0000","last_became_peered":"2024-05-12T11:06:05.174871+0000","last_unstale":"2024-05-12T11:09:23.668313+0000","last_undegraded":"2024-05-12T11:09:23.668313+0000","last_fullsized":"2024-05-12T11:09:23.668313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:48:12.566540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671676+0000","last_change":"2024-05-12T11:06:05.172584+0000","last_active":"2024-05-12T11:09:23.671676+0000","last_peered":"2024-05-12T11:09:23.671676+0000","last_clean":"2024-05-12T11:09:23.671676+0000","last_became_active":"2024-05-12T11:06:05.171545+0000","last_became_peered":"2024-05-12T11:06:05.171545+0000","last_unstale":"2024-05-12T11:09:23.671676+0000","last_undegraded":"2024-05-12T11:09:23.671676+0000","last_fullsized":"2024-05-12T11:09:23.671676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:34:45.950231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":231,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.492525+0000","last_change":"2024-05-12T11:06:02.148890+0000","last_active":"2024-05-12T11:09:28.492525+0000","last_peered":"2024-05-12T11:09:28.492525+0000","last_clean":"2024-05-12T11:09:28.492525+0000","last_became_active":"2024-05-12T11:06:02.148544+0000","last_became_peered":"2024-05-12T11:06:02.148544+0000","last_unstale":"2024-05-12T11:09:28.492525+0000","last_undegraded":"2024-05-12T11:09:28.492525+0000","last_fullsized":"2024-05-12T11:09:28.492525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:34.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":188,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765952+0000","last_change":"2024-05-12T11:06:05.175214+0000","last_active":"2024-05-12T11:09:23.765952+0000","last_peered":"2024-05-12T11:09:23.765952+0000","last_clean":"2024-05-12T11:09:23.765952+0000","last_became_active":"2024-05-12T11:06:05.174920+0000","last_became_peered":"2024-05-12T11:06:05.174920+0000","last_unstale":"2024-05-12T11:09:23.765952+0000","last_undegraded":"2024-05-12T11:09:23.765952+0000","last_fullsized":"2024-05-12T11:09:23.765952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:30:36.277975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.766173+0000","last_change":"2024-05-12T11:06:02.246073+0000","last_active":"2024-05-12T11:09:23.766173+0000","last_peered":"2024-05-12T11:09:23.766173+0000","last_clean":"2024-05-12T11:09:23.766173+0000","last_became_active":"2024-05-12T11:06:02.245728+0000","last_became_peered":"2024-05-12T11:06:02.245728+0000","last_unstale":"2024-05-12T11:09:23.766173+0000","last_undegraded":"2024-05-12T11:09:23.766173+0000","last_fullsized":"2024-05-12T11:09:23.766173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:43:03.273179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922550+0000","last_change":"2024-05-12T11:06:05.170448+0000","last_active":"2024-05-12T11:09:23.922550+0000","last_peered":"2024-05-12T11:09:23.922550+0000","last_clean":"2024-05-12T11:09:23.922550+0000","last_became_active":"2024-05-12T11:06:05.170133+0000","last_became_peered":"2024-05-12T11:06:05.170133+0000","last_unstale":"2024-05-12T11:09:23.922550+0000","last_undegraded":"2024-05-12T11:09:23.922550+0000","last_fullsized":"2024-05-12T11:09:23.922550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:17:30.669009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765993+0000","last_change":"2024-05-12T11:06:02.155137+0000","last_active":"2024-05-12T11:09:23.765993+0000","last_peered":"2024-05-12T11:09:23.765993+0000","last_clean":"2024-05-12T11:09:23.765993+0000","last_became_active":"2024-05-12T11:06:02.154467+0000","last_became_peered":"2024-05-12T11:06:02.154467+0000","last_unstale":"2024-05-12T11:09:23.765993+0000","last_undegraded":"2024-05-12T11:09:23.765993+0000","last_fullsized":"2024-05-12T11:09:23.765993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:38.708094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920852+0000","last_change":"2024-05-12T11:06:05.180903+0000","last_active":"2024-05-12T11:09:23.920852+0000","last_peered":"2024-05-12T11:09:23.920852+0000","last_clean":"2024-05-12T11:09:23.920852+0000","last_became_active":"2024-05-12T11:06:05.180519+0000","last_became_peered":"2024-05-12T11:06:05.180519+0000","last_unstale":"2024-05-12T11:09:23.920852+0000","last_undegraded":"2024-05-12T11:09:23.920852+0000","last_fullsized":"2024-05-12T11:09:23.920852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:57:47.535714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976684+0000","last_change":"2024-05-12T11:06:45.325333+0000","last_active":"2024-05-12T11:09:23.976684+0000","last_peered":"2024-05-12T11:09:23.976684+0000","last_clean":"2024-05-12T11:09:23.976684+0000","last_became_active":"2024-05-12T11:06:45.312552+0000","last_became_peered":"2024-05-12T11:06:45.312552+0000","last_unstale":"2024-05-12T11:09:23.976684+0000","last_undegraded":"2024-05-12T11:09:23.976684+0000","last_fullsized":"2024-05-12T11:09:23.976684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:45.862620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772039+0000","last_change":"2024-05-12T11:06:05.167052+0000","last_active":"2024-05-12T11:09:23.772039+0000","last_peered":"2024-05-12T11:09:23.772039+0000","last_clean":"2024-05-12T11:09:23.772039+0000","last_became_active":"2024-05-12T11:06:05.166689+0000","last_became_peered":"2024-05-12T11:06:05.166689+0000","last_unstale":"2024-05-12T11:09:23.772039+0000","last_undegraded":"2024-05-12T11:09:23.772039+0000","last_fullsized":"2024-05-12T11:09:23.772039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:34:05.008336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'8","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.492749+0000","last_change":"2024-05-12T11:06:02.154630+0000","last_active":"2024-05-12T11:09:28.492749+0000","last_peered":"2024-05-12T11:09:28.492749+0000","last_clean":"2024-05-12T11:09:28.492749+0000","last_became_active":"2024-05-12T11:06:02.154254+0000","last_became_peered":"2024-05-12T11:06:02.154254+0000","last_unstale":"2024-05-12T11:09:28.492749+0000","last_undegraded":"2024-05-12T11:09:28.492749+0000","last_fullsized":"2024-05-12T11:09:28.492749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:54.294058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":192,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765582+0000","last_change":"2024-05-12T11:06:05.176582+0000","last_active":"2024-05-12T11:09:23.765582+0000","last_peered":"2024-05-12T11:09:23.765582+0000","last_clean":"2024-05-12T11:09:23.765582+0000","last_became_active":"2024-05-12T11:06:05.176241+0000","last_became_peered":"2024-05-12T11:06:05.176241+0000","last_unstale":"2024-05-12T11:09:23.765582+0000","last_undegraded":"2024-05-12T11:09:23.765582+0000","last_fullsized":"2024-05-12T11:09:23.765582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:09:00.020166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774832+0000","last_change":"2024-05-12T11:06:02.148534+0000","last_active":"2024-05-12T11:09:23.774832+0000","last_peered":"2024-05-12T11:09:23.774832+0000","last_clean":"2024-05-12T11:09:23.774832+0000","last_became_active":"2024-05-12T11:06:02.148155+0000","last_became_peered":"2024-05-12T11:06:02.148155+0000","last_unstale":"2024-05-12T11:09:23.774832+0000","last_undegraded":"2024-05-12T11:09:23.774832+0000","last_fullsized":"2024-05-12T11:09:23.774832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:52:21.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772041+0000","last_change":"2024-05-12T11:06:05.169944+0000","last_active":"2024-05-12T11:09:23.772041+0000","last_peered":"2024-05-12T11:09:23.772041+0000","last_clean":"2024-05-12T11:09:23.772041+0000","last_became_active":"2024-05-12T11:06:05.169597+0000","last_became_peered":"2024-05-12T11:06:05.169597+0000","last_unstale":"2024-05-12T11:09:23.772041+0000","last_undegraded":"2024-05-12T11:09:23.772041+0000","last_fullsized":"2024-05-12T11:09:23.772041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:05:17.724037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919670+0000","last_change":"2024-05-12T11:06:02.154539+0000","last_active":"2024-05-12T11:09:23.919670+0000","last_peered":"2024-05-12T11:09:23.919670+0000","last_clean":"2024-05-12T11:09:23.919670+0000","last_became_active":"2024-05-12T11:06:02.154040+0000","last_became_peered":"2024-05-12T11:06:02.154040+0000","last_unstale":"2024-05-12T11:09:23.919670+0000","last_undegraded":"2024-05-12T11:09:23.919670+0000","last_fullsized":"2024-05-12T11:09:23.919670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:10:23.875273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.667936+0000","last_change":"2024-05-12T11:06:45.308950+0000","last_active":"2024-05-12T11:09:23.667936+0000","last_peered":"2024-05-12T11:09:23.667936+0000","last_clean":"2024-05-12T11:09:23.667936+0000","last_became_active":"2024-05-12T11:06:45.308579+0000","last_became_peered":"2024-05-12T11:06:45.308579+0000","last_unstale":"2024-05-12T11:09:23.667936+0000","last_undegraded":"2024-05-12T11:09:23.667936+0000","last_fullsized":"2024-05-12T11:09:23.667936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:01:08.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771828+0000","last_change":"2024-05-12T11:06:02.151341+0000","last_active":"2024-05-12T11:09:23.771828+0000","last_peered":"2024-05-12T11:09:23.771828+0000","last_clean":"2024-05-12T11:09:23.771828+0000","last_became_active":"2024-05-12T11:06:02.150949+0000","last_became_peered":"2024-05-12T11:06:02.150949+0000","last_unstale":"2024-05-12T11:09:23.771828+0000","last_undegraded":"2024-05-12T11:09:23.771828+0000","last_fullsized":"2024-05-12T11:09:23.771828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:07:26.699269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.667944+0000","last_change":"2024-05-12T11:06:05.173060+0000","last_active":"2024-05-12T11:09:23.667944+0000","last_peered":"2024-05-12T11:09:23.667944+0000","last_clean":"2024-05-12T11:09:23.667944+0000","last_became_active":"2024-05-12T11:06:05.172756+0000","last_became_peered":"2024-05-12T11:06:05.172756+0000","last_unstale":"2024-05-12T11:09:23.667944+0000","last_undegraded":"2024-05-12T11:09:23.667944+0000","last_fullsized":"2024-05-12T11:09:23.667944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:15:12.797466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'7","reported_seq":410,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:29.493336+0000","last_change":"2024-05-12T11:06:02.152219+0000","last_active":"2024-05-12T11:09:29.493336+0000","last_peered":"2024-05-12T11:09:29.493336+0000","last_clean":"2024-05-12T11:09:29.493336+0000","last_became_active":"2024-05-12T11:06:02.151707+0000","last_became_peered":"2024-05-12T11:06:02.151707+0000","last_unstale":"2024-05-12T11:09:29.493336+0000","last_undegraded":"2024-05-12T11:09:29.493336+0000","last_fullsized":"2024-05-12T11:09:29.493336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:43.047957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":374,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921355+0000","last_change":"2024-05-12T11:06:05.173436+0000","last_active":"2024-05-12T11:09:23.921355+0000","last_peered":"2024-05-12T11:09:23.921355+0000","last_clean":"2024-05-12T11:09:23.921355+0000","last_became_active":"2024-05-12T11:06:05.173057+0000","last_became_peered":"2024-05-12T11:06:05.173057+0000","last_unstale":"2024-05-12T11:09:23.921355+0000","last_undegraded":"2024-05-12T11:09:23.921355+0000","last_fullsized":"2024-05-12T11:09:23.921355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.408017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920905+0000","last_change":"2024-05-12T11:06:02.155037+0000","last_active":"2024-05-12T11:09:23.920905+0000","last_peered":"2024-05-12T11:09:23.920905+0000","last_clean":"2024-05-12T11:09:23.920905+0000","last_became_active":"2024-05-12T11:06:02.154658+0000","last_became_peered":"2024-05-12T11:06:02.154658+0000","last_unstale":"2024-05-12T11:09:23.920905+0000","last_undegraded":"2024-05-12T11:09:23.920905+0000","last_fullsized":"2024-05-12T11:09:23.920905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:58:16.633636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922370+0000","last_change":"2024-05-12T11:06:05.176100+0000","last_active":"2024-05-12T11:09:23.922370+0000","last_peered":"2024-05-12T11:09:23.922370+0000","last_clean":"2024-05-12T11:09:23.922370+0000","last_became_active":"2024-05-12T11:06:05.175385+0000","last_became_peered":"2024-05-12T11:06:05.175385+0000","last_unstale":"2024-05-12T11:09:23.922370+0000","last_undegraded":"2024-05-12T11:09:23.922370+0000","last_fullsized":"2024-05-12T11:09:23.922370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:10.627583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772185+0000","last_change":"2024-05-12T11:06:02.246427+0000","last_active":"2024-05-12T11:09:23.772185+0000","last_peered":"2024-05-12T11:09:23.772185+0000","last_clean":"2024-05-12T11:09:23.772185+0000","last_became_active":"2024-05-12T11:06:02.246068+0000","last_became_peered":"2024-05-12T11:06:02.246068+0000","last_unstale":"2024-05-12T11:09:23.772185+0000","last_undegraded":"2024-05-12T11:09:23.772185+0000","last_fullsized":"2024-05-12T11:09:23.772185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:40:25.533391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921096+0000","last_change":"2024-05-12T11:06:45.310358+0000","last_active":"2024-05-12T11:09:23.921096+0000","last_peered":"2024-05-12T11:09:23.921096+0000","last_clean":"2024-05-12T11:09:23.921096+0000","last_became_active":"2024-05-12T11:06:45.309960+0000","last_became_peered":"2024-05-12T11:06:45.309960+0000","last_unstale":"2024-05-12T11:09:23.921096+0000","last_undegraded":"2024-05-12T11:09:23.921096+0000","last_fullsized":"2024-05-12T11:09:23.921096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:28.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'41","reported_seq":457,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:29.493585+0000","last_change":"2024-05-12T11:06:02.151099+0000","last_active":"2024-05-12T11:09:29.493585+0000","last_peered":"2024-05-12T11:09:29.493585+0000","last_clean":"2024-05-12T11:09:29.493585+0000","last_became_active":"2024-05-12T11:06:02.150702+0000","last_became_peered":"2024-05-12T11:06:02.150702+0000","last_unstale":"2024-05-12T11:09:29.493585+0000","last_undegraded":"2024-05-12T11:09:29.493585+0000","last_fullsized":"2024-05-12T11:09:29.493585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:14:00.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70390,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":387,"num_read_kb":259,"num_write":43,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765773+0000","last_change":"2024-05-12T11:06:05.171016+0000","last_active":"2024-05-12T11:09:23.765773+0000","last_peered":"2024-05-12T11:09:23.765773+0000","last_clean":"2024-05-12T11:09:23.765773+0000","last_became_active":"2024-05-12T11:06:05.170659+0000","last_became_peered":"2024-05-12T11:06:05.170659+0000","last_unstale":"2024-05-12T11:09:23.765773+0000","last_undegraded":"2024-05-12T11:09:23.765773+0000","last_fullsized":"2024-05-12T11:09:23.765773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:13:00.756621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671532+0000","last_change":"2024-05-12T11:06:02.153854+0000","last_active":"2024-05-12T11:09:23.671532+0000","last_peered":"2024-05-12T11:09:23.671532+0000","last_clean":"2024-05-12T11:09:23.671532+0000","last_became_active":"2024-05-12T11:06:02.153501+0000","last_became_peered":"2024-05-12T11:06:02.153501+0000","last_unstale":"2024-05-12T11:09:23.671532+0000","last_undegraded":"2024-05-12T11:09:23.671532+0000","last_fullsized":"2024-05-12T11:09:23.671532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:42:37.608641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919448+0000","last_change":"2024-05-12T11:06:05.169348+0000","last_active":"2024-05-12T11:09:23.919448+0000","last_peered":"2024-05-12T11:09:23.919448+0000","last_clean":"2024-05-12T11:09:23.919448+0000","last_became_active":"2024-05-12T11:06:05.169031+0000","last_became_peered":"2024-05-12T11:06:05.169031+0000","last_unstale":"2024-05-12T11:09:23.919448+0000","last_undegraded":"2024-05-12T11:09:23.919448+0000","last_fullsized":"2024-05-12T11:09:23.919448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:07:13.104465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771913+0000","last_change":"2024-05-12T11:06:02.152482+0000","last_active":"2024-05-12T11:09:23.771913+0000","last_peered":"2024-05-12T11:09:23.771913+0000","last_clean":"2024-05-12T11:09:23.771913+0000","last_became_active":"2024-05-12T11:06:02.152077+0000","last_became_peered":"2024-05-12T11:06:02.152077+0000","last_unstale":"2024-05-12T11:09:23.771913+0000","last_undegraded":"2024-05-12T11:09:23.771913+0000","last_fullsized":"2024-05-12T11:09:23.771913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:42.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920242+0000","last_change":"2024-05-12T11:06:05.175228+0000","last_active":"2024-05-12T11:09:23.920242+0000","last_peered":"2024-05-12T11:09:23.920242+0000","last_clean":"2024-05-12T11:09:23.920242+0000","last_became_active":"2024-05-12T11:06:05.174892+0000","last_became_peered":"2024-05-12T11:06:05.174892+0000","last_unstale":"2024-05-12T11:09:23.920242+0000","last_undegraded":"2024-05-12T11:09:23.920242+0000","last_fullsized":"2024-05-12T11:09:23.920242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:34.581296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":225,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.492638+0000","last_change":"2024-05-12T11:06:02.149923+0000","last_active":"2024-05-12T11:09:28.492638+0000","last_peered":"2024-05-12T11:09:28.492638+0000","last_clean":"2024-05-12T11:09:28.492638+0000","last_became_active":"2024-05-12T11:06:02.149571+0000","last_became_peered":"2024-05-12T11:06:02.149571+0000","last_unstale":"2024-05-12T11:09:28.492638+0000","last_undegraded":"2024-05-12T11:09:28.492638+0000","last_fullsized":"2024-05-12T11:09:28.492638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:23:36.118502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919660+0000","last_change":"2024-05-12T11:06:05.178843+0000","last_active":"2024-05-12T11:09:23.919660+0000","last_peered":"2024-05-12T11:09:23.919660+0000","last_clean":"2024-05-12T11:09:23.919660+0000","last_became_active":"2024-05-12T11:06:05.178526+0000","last_became_peered":"2024-05-12T11:06:05.178526+0000","last_unstale":"2024-05-12T11:09:23.919660+0000","last_undegraded":"2024-05-12T11:09:23.919660+0000","last_fullsized":"2024-05-12T11:09:23.919660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:57.760329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765564+0000","last_change":"2024-05-12T11:06:45.512231+0000","last_active":"2024-05-12T11:09:23.765564+0000","last_peered":"2024-05-12T11:09:23.765564+0000","last_clean":"2024-05-12T11:09:23.765564+0000","last_became_active":"2024-05-12T11:06:45.499482+0000","last_became_peered":"2024-05-12T11:06:45.499482+0000","last_unstale":"2024-05-12T11:09:23.765564+0000","last_undegraded":"2024-05-12T11:09:23.765564+0000","last_fullsized":"2024-05-12T11:09:23.765564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:34:43.986131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771846+0000","last_change":"2024-05-12T11:06:05.168307+0000","last_active":"2024-05-12T11:09:23.771846+0000","last_peered":"2024-05-12T11:09:23.771846+0000","last_clean":"2024-05-12T11:09:23.771846+0000","last_became_active":"2024-05-12T11:06:05.167606+0000","last_became_peered":"2024-05-12T11:06:05.167606+0000","last_unstale":"2024-05-12T11:09:23.771846+0000","last_undegraded":"2024-05-12T11:09:23.771846+0000","last_fullsized":"2024-05-12T11:09:23.771846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:25:09.384425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765924+0000","last_change":"2024-05-12T11:06:02.156201+0000","last_active":"2024-05-12T11:09:23.765924+0000","last_peered":"2024-05-12T11:09:23.765924+0000","last_clean":"2024-05-12T11:09:23.765924+0000","last_became_active":"2024-05-12T11:06:02.155398+0000","last_became_peered":"2024-05-12T11:06:02.155398+0000","last_unstale":"2024-05-12T11:09:23.765924+0000","last_undegraded":"2024-05-12T11:09:23.765924+0000","last_fullsized":"2024-05-12T11:09:23.765924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:23:01.157554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976796+0000","last_change":"2024-05-12T11:06:05.176837+0000","last_active":"2024-05-12T11:09:23.976796+0000","last_peered":"2024-05-12T11:09:23.976796+0000","last_clean":"2024-05-12T11:09:23.976796+0000","last_became_active":"2024-05-12T11:06:05.176450+0000","last_became_peered":"2024-05-12T11:06:05.176450+0000","last_unstale":"2024-05-12T11:09:23.976796+0000","last_undegraded":"2024-05-12T11:09:23.976796+0000","last_fullsized":"2024-05-12T11:09:23.976796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:36:17.654259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668198+0000","last_change":"2024-05-12T11:06:02.246999+0000","last_active":"2024-05-12T11:09:23.668198+0000","last_peered":"2024-05-12T11:09:23.668198+0000","last_clean":"2024-05-12T11:09:23.668198+0000","last_became_active":"2024-05-12T11:06:02.246063+0000","last_became_peered":"2024-05-12T11:06:02.246063+0000","last_unstale":"2024-05-12T11:09:23.668198+0000","last_undegraded":"2024-05-12T11:09:23.668198+0000","last_fullsized":"2024-05-12T11:09:23.668198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:39.303069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.775094+0000","last_change":"2024-05-12T11:06:05.175333+0000","last_active":"2024-05-12T11:09:23.775094+0000","last_peered":"2024-05-12T11:09:23.775094+0000","last_clean":"2024-05-12T11:09:23.775094+0000","last_became_active":"2024-05-12T11:06:05.175011+0000","last_became_peered":"2024-05-12T11:06:05.175011+0000","last_unstale":"2024-05-12T11:09:23.775094+0000","last_undegraded":"2024-05-12T11:09:23.775094+0000","last_fullsized":"2024-05-12T11:09:23.775094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:51:57.025941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'7","reported_seq":226,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.493098+0000","last_change":"2024-05-12T11:06:02.151044+0000","last_active":"2024-05-12T11:09:28.493098+0000","last_peered":"2024-05-12T11:09:28.493098+0000","last_clean":"2024-05-12T11:09:28.493098+0000","last_became_active":"2024-05-12T11:06:02.150011+0000","last_became_peered":"2024-05-12T11:06:02.150011+0000","last_unstale":"2024-05-12T11:09:28.493098+0000","last_undegraded":"2024-05-12T11:09:28.493098+0000","last_fullsized":"2024-05-12T11:09:28.493098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:16:14.058893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774954+0000","last_change":"2024-05-12T11:06:05.179210+0000","last_active":"2024-05-12T11:09:23.774954+0000","last_peered":"2024-05-12T11:09:23.774954+0000","last_clean":"2024-05-12T11:09:23.774954+0000","last_became_active":"2024-05-12T11:06:05.178853+0000","last_became_peered":"2024-05-12T11:06:05.178853+0000","last_unstale":"2024-05-12T11:09:23.774954+0000","last_undegraded":"2024-05-12T11:09:23.774954+0000","last_fullsized":"2024-05-12T11:09:23.774954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:50:05.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772157+0000","last_change":"2024-05-12T11:06:05.170860+0000","last_active":"2024-05-12T11:09:23.772157+0000","last_peered":"2024-05-12T11:09:23.772157+0000","last_clean":"2024-05-12T11:09:23.772157+0000","last_became_active":"2024-05-12T11:06:05.170502+0000","last_became_peered":"2024-05-12T11:06:05.170502+0000","last_unstale":"2024-05-12T11:09:23.772157+0000","last_undegraded":"2024-05-12T11:09:23.772157+0000","last_fullsized":"2024-05-12T11:09:23.772157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:26:46.495176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'6","reported_seq":223,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.492212+0000","last_change":"2024-05-12T11:06:02.245996+0000","last_active":"2024-05-12T11:09:28.492212+0000","last_peered":"2024-05-12T11:09:28.492212+0000","last_clean":"2024-05-12T11:09:28.492212+0000","last_became_active":"2024-05-12T11:06:02.245629+0000","last_became_peered":"2024-05-12T11:06:02.245629+0000","last_unstale":"2024-05-12T11:09:28.492212+0000","last_undegraded":"2024-05-12T11:09:28.492212+0000","last_fullsized":"2024-05-12T11:09:28.492212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:02:54.794852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":188,"num_read_kb":188,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765708+0000","last_change":"2024-05-12T11:06:05.174731+0000","last_active":"2024-05-12T11:09:23.765708+0000","last_peered":"2024-05-12T11:09:23.765708+0000","last_clean":"2024-05-12T11:09:23.765708+0000","last_became_active":"2024-05-12T11:06:05.174396+0000","last_became_peered":"2024-05-12T11:06:05.174396+0000","last_unstale":"2024-05-12T11:09:23.765708+0000","last_undegraded":"2024-05-12T11:09:23.765708+0000","last_fullsized":"2024-05-12T11:09:23.765708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:30:48.352011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.670989+0000","last_change":"2024-05-12T11:06:02.153635+0000","last_active":"2024-05-12T11:09:23.670989+0000","last_peered":"2024-05-12T11:09:23.670989+0000","last_clean":"2024-05-12T11:09:23.670989+0000","last_became_active":"2024-05-12T11:06:02.153268+0000","last_became_peered":"2024-05-12T11:06:02.153268+0000","last_unstale":"2024-05-12T11:09:23.670989+0000","last_undegraded":"2024-05-12T11:09:23.670989+0000","last_fullsized":"2024-05-12T11:09:23.670989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:55.245138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"83'99","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:25.789660+0000","last_change":"2024-05-12T11:04:37.106045+0000","last_active":"2024-05-12T11:09:25.789660+0000","last_peered":"2024-05-12T11:09:25.789660+0000","last_clean":"2024-05-12T11:09:25.789660+0000","last_became_active":"2024-05-12T11:04:37.101364+0000","last_became_peered":"2024-05-12T11:04:37.101364+0000","last_unstale":"2024-05-12T11:09:25.789660+0000","last_undegraded":"2024-05-12T11:09:25.789660+0000","last_fullsized":"2024-05-12T11:09:25.789660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_clean_scrub_stamp":"2024-05-12T11:01:12.632157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:53:22.531168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919347+0000","last_change":"2024-05-12T11:06:05.163927+0000","last_active":"2024-05-12T11:09:23.919347+0000","last_peered":"2024-05-12T11:09:23.919347+0000","last_clean":"2024-05-12T11:09:23.919347+0000","last_became_active":"2024-05-12T11:06:05.163610+0000","last_became_peered":"2024-05-12T11:06:05.163610+0000","last_unstale":"2024-05-12T11:09:23.919347+0000","last_undegraded":"2024-05-12T11:09:23.919347+0000","last_fullsized":"2024-05-12T11:09:23.919347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:58:31.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919949+0000","last_change":"2024-05-12T11:06:02.152658+0000","last_active":"2024-05-12T11:09:23.919949+0000","last_peered":"2024-05-12T11:09:23.919949+0000","last_clean":"2024-05-12T11:09:23.919949+0000","last_became_active":"2024-05-12T11:06:02.151770+0000","last_became_peered":"2024-05-12T11:06:02.151770+0000","last_unstale":"2024-05-12T11:09:23.919949+0000","last_undegraded":"2024-05-12T11:09:23.919949+0000","last_fullsized":"2024-05-12T11:09:23.919949+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:18.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765861+0000","last_change":"2024-05-12T11:06:02.246421+0000","last_active":"2024-05-12T11:09:23.765861+0000","last_peered":"2024-05-12T11:09:23.765861+0000","last_clean":"2024-05-12T11:09:23.765861+0000","last_became_active":"2024-05-12T11:06:02.246065+0000","last_became_peered":"2024-05-12T11:06:02.246065+0000","last_unstale":"2024-05-12T11:09:23.765861+0000","last_undegraded":"2024-05-12T11:09:23.765861+0000","last_fullsized":"2024-05-12T11:09:23.765861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:34:28.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919819+0000","last_change":"2024-05-12T11:06:05.166916+0000","last_active":"2024-05-12T11:09:23.919819+0000","last_peered":"2024-05-12T11:09:23.919819+0000","last_clean":"2024-05-12T11:09:23.919819+0000","last_became_active":"2024-05-12T11:06:05.165877+0000","last_became_peered":"2024-05-12T11:06:05.165877+0000","last_unstale":"2024-05-12T11:09:23.919819+0000","last_undegraded":"2024-05-12T11:09:23.919819+0000","last_fullsized":"2024-05-12T11:09:23.919819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:46:47.935159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'106","reported_seq":227,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:27.358500+0000","last_change":"2024-05-12T11:06:02.151339+0000","last_active":"2024-05-12T11:09:27.358500+0000","last_peered":"2024-05-12T11:09:27.358500+0000","last_clean":"2024-05-12T11:09:27.358500+0000","last_became_active":"2024-05-12T11:06:02.150968+0000","last_became_peered":"2024-05-12T11:06:02.150968+0000","last_unstale":"2024-05-12T11:09:27.358500+0000","last_undegraded":"2024-05-12T11:09:27.358500+0000","last_fullsized":"2024-05-12T11:09:27.358500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:22:39.625972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":194,"num_write_kb":1288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.766041+0000","last_change":"2024-05-12T11:06:05.165277+0000","last_active":"2024-05-12T11:09:23.766041+0000","last_peered":"2024-05-12T11:09:23.766041+0000","last_clean":"2024-05-12T11:09:23.766041+0000","last_became_active":"2024-05-12T11:06:05.164992+0000","last_became_peered":"2024-05-12T11:06:05.164992+0000","last_unstale":"2024-05-12T11:09:23.766041+0000","last_undegraded":"2024-05-12T11:09:23.766041+0000","last_fullsized":"2024-05-12T11:09:23.766041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:18.193170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671252+0000","last_change":"2024-05-12T11:06:02.151167+0000","last_active":"2024-05-12T11:09:23.671252+0000","last_peered":"2024-05-12T11:09:23.671252+0000","last_clean":"2024-05-12T11:09:23.671252+0000","last_became_active":"2024-05-12T11:06:02.150815+0000","last_became_peered":"2024-05-12T11:06:02.150815+0000","last_unstale":"2024-05-12T11:09:23.671252+0000","last_undegraded":"2024-05-12T11:09:23.671252+0000","last_fullsized":"2024-05-12T11:09:23.671252+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:50.811297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922434+0000","last_change":"2024-05-12T11:06:45.352790+0000","last_active":"2024-05-12T11:09:23.922434+0000","last_peered":"2024-05-12T11:09:23.922434+0000","last_clean":"2024-05-12T11:09:23.922434+0000","last_became_active":"2024-05-12T11:06:45.352409+0000","last_became_peered":"2024-05-12T11:06:45.352409+0000","last_unstale":"2024-05-12T11:09:23.922434+0000","last_undegraded":"2024-05-12T11:09:23.922434+0000","last_fullsized":"2024-05-12T11:09:23.922434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:16.535709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920508+0000","last_change":"2024-05-12T11:06:02.246676+0000","last_active":"2024-05-12T11:09:23.920508+0000","last_peered":"2024-05-12T11:09:23.920508+0000","last_clean":"2024-05-12T11:09:23.920508+0000","last_became_active":"2024-05-12T11:06:02.246344+0000","last_became_peered":"2024-05-12T11:06:02.246344+0000","last_unstale":"2024-05-12T11:09:23.920508+0000","last_undegraded":"2024-05-12T11:09:23.920508+0000","last_fullsized":"2024-05-12T11:09:23.920508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:17.805058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765550+0000","last_change":"2024-05-12T11:06:05.175597+0000","last_active":"2024-05-12T11:09:23.765550+0000","last_peered":"2024-05-12T11:09:23.765550+0000","last_clean":"2024-05-12T11:09:23.765550+0000","last_became_active":"2024-05-12T11:06:05.175237+0000","last_became_peered":"2024-05-12T11:06:05.175237+0000","last_unstale":"2024-05-12T11:09:23.765550+0000","last_undegraded":"2024-05-12T11:09:23.765550+0000","last_fullsized":"2024-05-12T11:09:23.765550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:50:12.872570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765526+0000","last_change":"2024-05-12T11:06:02.148706+0000","last_active":"2024-05-12T11:09:23.765526+0000","last_peered":"2024-05-12T11:09:23.765526+0000","last_clean":"2024-05-12T11:09:23.765526+0000","last_became_active":"2024-05-12T11:06:02.148437+0000","last_became_peered":"2024-05-12T11:06:02.148437+0000","last_unstale":"2024-05-12T11:09:23.765526+0000","last_undegraded":"2024-05-12T11:09:23.765526+0000","last_fullsized":"2024-05-12T11:09:23.765526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:54:39.969677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976534+0000","last_change":"2024-05-12T11:06:05.174248+0000","last_active":"2024-05-12T11:09:23.976534+0000","last_peered":"2024-05-12T11:09:23.976534+0000","last_clean":"2024-05-12T11:09:23.976534+0000","last_became_active":"2024-05-12T11:06:05.173934+0000","last_became_peered":"2024-05-12T11:06:05.173934+0000","last_unstale":"2024-05-12T11:09:23.976534+0000","last_undegraded":"2024-05-12T11:09:23.976534+0000","last_fullsized":"2024-05-12T11:09:23.976534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:04:58.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976644+0000","last_change":"2024-05-12T11:06:45.316406+0000","last_active":"2024-05-12T11:09:23.976644+0000","last_peered":"2024-05-12T11:09:23.976644+0000","last_clean":"2024-05-12T11:09:23.976644+0000","last_became_active":"2024-05-12T11:06:45.310351+0000","last_became_peered":"2024-05-12T11:06:45.310351+0000","last_unstale":"2024-05-12T11:09:23.976644+0000","last_undegraded":"2024-05-12T11:09:23.976644+0000","last_fullsized":"2024-05-12T11:09:23.976644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:11.687974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765821+0000","last_change":"2024-05-12T11:06:05.177548+0000","last_active":"2024-05-12T11:09:23.765821+0000","last_peered":"2024-05-12T11:09:23.765821+0000","last_clean":"2024-05-12T11:09:23.765821+0000","last_became_active":"2024-05-12T11:06:05.176871+0000","last_became_peered":"2024-05-12T11:06:05.176871+0000","last_unstale":"2024-05-12T11:09:23.765821+0000","last_undegraded":"2024-05-12T11:09:23.765821+0000","last_fullsized":"2024-05-12T11:09:23.765821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:38:08.347801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765672+0000","last_change":"2024-05-12T11:06:02.155096+0000","last_active":"2024-05-12T11:09:23.765672+0000","last_peered":"2024-05-12T11:09:23.765672+0000","last_clean":"2024-05-12T11:09:23.765672+0000","last_became_active":"2024-05-12T11:06:02.154721+0000","last_became_peered":"2024-05-12T11:06:02.154721+0000","last_unstale":"2024-05-12T11:09:23.765672+0000","last_undegraded":"2024-05-12T11:09:23.765672+0000","last_fullsized":"2024-05-12T11:09:23.765672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:01.407453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920661+0000","last_change":"2024-05-12T11:06:05.170305+0000","last_active":"2024-05-12T11:09:23.920661+0000","last_peered":"2024-05-12T11:09:23.920661+0000","last_clean":"2024-05-12T11:09:23.920661+0000","last_became_active":"2024-05-12T11:06:05.169970+0000","last_became_peered":"2024-05-12T11:06:05.169970+0000","last_unstale":"2024-05-12T11:09:23.920661+0000","last_undegraded":"2024-05-12T11:09:23.920661+0000","last_fullsized":"2024-05-12T11:09:23.920661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:48:11.680873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":225,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.493376+0000","last_change":"2024-05-12T11:06:02.246541+0000","last_active":"2024-05-12T11:09:28.493376+0000","last_peered":"2024-05-12T11:09:28.493376+0000","last_clean":"2024-05-12T11:09:28.493376+0000","last_became_active":"2024-05-12T11:06:02.246071+0000","last_became_peered":"2024-05-12T11:06:02.246071+0000","last_unstale":"2024-05-12T11:09:28.493376+0000","last_undegraded":"2024-05-12T11:09:28.493376+0000","last_fullsized":"2024-05-12T11:09:28.493376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:27:16.649146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1478,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920824+0000","last_change":"2024-05-12T11:06:05.170566+0000","last_active":"2024-05-12T11:09:23.920824+0000","last_peered":"2024-05-12T11:09:23.920824+0000","last_clean":"2024-05-12T11:09:23.920824+0000","last_became_active":"2024-05-12T11:06:05.170225+0000","last_became_peered":"2024-05-12T11:06:05.170225+0000","last_unstale":"2024-05-12T11:09:23.920824+0000","last_undegraded":"2024-05-12T11:09:23.920824+0000","last_fullsized":"2024-05-12T11:09:23.920824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:42.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'67","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:27.012789+0000","last_change":"2024-05-12T11:06:02.151920+0000","last_active":"2024-05-12T11:09:27.012789+0000","last_peered":"2024-05-12T11:09:27.012789+0000","last_clean":"2024-05-12T11:09:27.012789+0000","last_became_active":"2024-05-12T11:06:02.151551+0000","last_became_peered":"2024-05-12T11:06:02.151551+0000","last_unstale":"2024-05-12T11:09:27.012789+0000","last_undegraded":"2024-05-12T11:09:27.012789+0000","last_fullsized":"2024-05-12T11:09:27.012789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:11:10.230956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919985+0000","last_change":"2024-05-12T11:06:05.174964+0000","last_active":"2024-05-12T11:09:23.919985+0000","last_peered":"2024-05-12T11:09:23.919985+0000","last_clean":"2024-05-12T11:09:23.919985+0000","last_became_active":"2024-05-12T11:06:05.174562+0000","last_became_peered":"2024-05-12T11:06:05.174562+0000","last_unstale":"2024-05-12T11:09:23.919985+0000","last_undegraded":"2024-05-12T11:09:23.919985+0000","last_fullsized":"2024-05-12T11:09:23.919985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:37:22.252200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919578+0000","last_change":"2024-05-12T11:06:45.319312+0000","last_active":"2024-05-12T11:09:23.919578+0000","last_peered":"2024-05-12T11:09:23.919578+0000","last_clean":"2024-05-12T11:09:23.919578+0000","last_became_active":"2024-05-12T11:06:45.310683+0000","last_became_peered":"2024-05-12T11:06:45.310683+0000","last_unstale":"2024-05-12T11:09:23.919578+0000","last_undegraded":"2024-05-12T11:09:23.919578+0000","last_fullsized":"2024-05-12T11:09:23.919578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:24:21.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921060+0000","last_change":"2024-05-12T11:06:05.176798+0000","last_active":"2024-05-12T11:09:23.921060+0000","last_peered":"2024-05-12T11:09:23.921060+0000","last_clean":"2024-05-12T11:09:23.921060+0000","last_became_active":"2024-05-12T11:06:05.176476+0000","last_became_peered":"2024-05-12T11:06:05.176476+0000","last_unstale":"2024-05-12T11:09:23.921060+0000","last_undegraded":"2024-05-12T11:09:23.921060+0000","last_fullsized":"2024-05-12T11:09:23.921060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:16.111038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976635+0000","last_change":"2024-05-12T11:06:05.180278+0000","last_active":"2024-05-12T11:09:23.976635+0000","last_peered":"2024-05-12T11:09:23.976635+0000","last_clean":"2024-05-12T11:09:23.976635+0000","last_became_active":"2024-05-12T11:06:05.179863+0000","last_became_peered":"2024-05-12T11:06:05.179863+0000","last_unstale":"2024-05-12T11:09:23.976635+0000","last_undegraded":"2024-05-12T11:09:23.976635+0000","last_fullsized":"2024-05-12T11:09:23.976635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:13:32.588753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671258+0000","last_change":"2024-05-12T11:06:45.499552+0000","last_active":"2024-05-12T11:09:23.671258+0000","last_peered":"2024-05-12T11:09:23.671258+0000","last_clean":"2024-05-12T11:09:23.671258+0000","last_became_active":"2024-05-12T11:06:45.499078+0000","last_became_peered":"2024-05-12T11:06:45.499078+0000","last_unstale":"2024-05-12T11:09:23.671258+0000","last_undegraded":"2024-05-12T11:09:23.671258+0000","last_fullsized":"2024-05-12T11:09:23.671258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:41:37.019535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671159+0000","last_change":"2024-05-12T11:06:05.172282+0000","last_active":"2024-05-12T11:09:23.671159+0000","last_peered":"2024-05-12T11:09:23.671159+0000","last_clean":"2024-05-12T11:09:23.671159+0000","last_became_active":"2024-05-12T11:06:05.171930+0000","last_became_peered":"2024-05-12T11:06:05.171930+0000","last_unstale":"2024-05-12T11:09:23.671159+0000","last_undegraded":"2024-05-12T11:09:23.671159+0000","last_fullsized":"2024-05-12T11:09:23.671159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:20:56.314181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922703+0000","last_change":"2024-05-12T11:06:05.173726+0000","last_active":"2024-05-12T11:09:23.922703+0000","last_peered":"2024-05-12T11:09:23.922703+0000","last_clean":"2024-05-12T11:09:23.922703+0000","last_became_active":"2024-05-12T11:06:05.173195+0000","last_became_peered":"2024-05-12T11:06:05.173195+0000","last_unstale":"2024-05-12T11:09:23.922703+0000","last_undegraded":"2024-05-12T11:09:23.922703+0000","last_fullsized":"2024-05-12T11:09:23.922703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:19.397213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919890+0000","last_change":"2024-05-12T11:06:05.167841+0000","last_active":"2024-05-12T11:09:23.919890+0000","last_peered":"2024-05-12T11:09:23.919890+0000","last_clean":"2024-05-12T11:09:23.919890+0000","last_became_active":"2024-05-12T11:06:05.166577+0000","last_became_peered":"2024-05-12T11:06:05.166577+0000","last_unstale":"2024-05-12T11:09:23.919890+0000","last_undegraded":"2024-05-12T11:09:23.919890+0000","last_fullsized":"2024-05-12T11:09:23.919890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:01.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976819+0000","last_change":"2024-05-12T11:06:05.170753+0000","last_active":"2024-05-12T11:09:23.976819+0000","last_peered":"2024-05-12T11:09:23.976819+0000","last_clean":"2024-05-12T11:09:23.976819+0000","last_became_active":"2024-05-12T11:06:05.169410+0000","last_became_peered":"2024-05-12T11:06:05.169410+0000","last_unstale":"2024-05-12T11:09:23.976819+0000","last_undegraded":"2024-05-12T11:09:23.976819+0000","last_fullsized":"2024-05-12T11:09:23.976819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:42:30.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671774+0000","last_change":"2024-05-12T11:06:05.170692+0000","last_active":"2024-05-12T11:09:23.671774+0000","last_peered":"2024-05-12T11:09:23.671774+0000","last_clean":"2024-05-12T11:09:23.671774+0000","last_became_active":"2024-05-12T11:06:05.170349+0000","last_became_peered":"2024-05-12T11:06:05.170349+0000","last_unstale":"2024-05-12T11:09:23.671774+0000","last_undegraded":"2024-05-12T11:09:23.671774+0000","last_fullsized":"2024-05-12T11:09:23.671774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:13:19.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765923+0000","last_change":"2024-05-12T11:06:05.173600+0000","last_active":"2024-05-12T11:09:23.765923+0000","last_peered":"2024-05-12T11:09:23.765923+0000","last_clean":"2024-05-12T11:09:23.765923+0000","last_became_active":"2024-05-12T11:06:05.173288+0000","last_became_peered":"2024-05-12T11:06:05.173288+0000","last_unstale":"2024-05-12T11:09:23.765923+0000","last_undegraded":"2024-05-12T11:09:23.765923+0000","last_fullsized":"2024-05-12T11:09:23.765923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:06:45.082031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771886+0000","last_change":"2024-05-12T11:06:05.169864+0000","last_active":"2024-05-12T11:09:23.771886+0000","last_peered":"2024-05-12T11:09:23.771886+0000","last_clean":"2024-05-12T11:09:23.771886+0000","last_became_active":"2024-05-12T11:06:05.169521+0000","last_became_peered":"2024-05-12T11:06:05.169521+0000","last_unstale":"2024-05-12T11:09:23.771886+0000","last_undegraded":"2024-05-12T11:09:23.771886+0000","last_fullsized":"2024-05-12T11:09:23.771886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.825436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765482+0000","last_change":"2024-05-12T11:06:05.176370+0000","last_active":"2024-05-12T11:09:23.765482+0000","last_peered":"2024-05-12T11:09:23.765482+0000","last_clean":"2024-05-12T11:09:23.765482+0000","last_became_active":"2024-05-12T11:06:05.176031+0000","last_became_peered":"2024-05-12T11:06:05.176031+0000","last_unstale":"2024-05-12T11:09:23.765482+0000","last_undegraded":"2024-05-12T11:09:23.765482+0000","last_fullsized":"2024-05-12T11:09:23.765482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:32:52.893909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920674+0000","last_change":"2024-05-12T11:06:05.170708+0000","last_active":"2024-05-12T11:09:23.920674+0000","last_peered":"2024-05-12T11:09:23.920674+0000","last_clean":"2024-05-12T11:09:23.920674+0000","last_became_active":"2024-05-12T11:06:05.169591+0000","last_became_peered":"2024-05-12T11:06:05.169591+0000","last_unstale":"2024-05-12T11:09:23.920674+0000","last_undegraded":"2024-05-12T11:09:23.920674+0000","last_fullsized":"2024-05-12T11:09:23.920674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:08.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919879+0000","last_change":"2024-05-12T11:06:05.172614+0000","last_active":"2024-05-12T11:09:23.919879+0000","last_peered":"2024-05-12T11:09:23.919879+0000","last_clean":"2024-05-12T11:09:23.919879+0000","last_became_active":"2024-05-12T11:06:05.172290+0000","last_became_peered":"2024-05-12T11:06:05.172290+0000","last_unstale":"2024-05-12T11:09:23.919879+0000","last_undegraded":"2024-05-12T11:09:23.919879+0000","last_fullsized":"2024-05-12T11:09:23.919879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:32.169139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976714+0000","last_change":"2024-05-12T11:06:05.171333+0000","last_active":"2024-05-12T11:09:23.976714+0000","last_peered":"2024-05-12T11:09:23.976714+0000","last_clean":"2024-05-12T11:09:23.976714+0000","last_became_active":"2024-05-12T11:06:05.170035+0000","last_became_peered":"2024-05-12T11:06:05.170035+0000","last_unstale":"2024-05-12T11:09:23.976714+0000","last_undegraded":"2024-05-12T11:09:23.976714+0000","last_fullsized":"2024-05-12T11:09:23.976714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:18.852851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107193,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":800664,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2264,"num_read_kb":1352,"num_write":511,"num_write_kb":2387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":811008,"data_stored":2401992,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645368,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":443342,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841597,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1429974,"data_compressed":59550,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005123,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":835598,"data_compressed":27906,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201352,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":835394,"data_compressed":27906,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397581,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":1036983,"data_compressed":44348,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561106,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":913408,"data_stored":442881,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":983040,"data_stored":511664,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738480,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":443746,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":512221,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149792,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":1163372,"data_compressed":43108,"data_compressed_allocated":57344,"data_compressed_original":724992,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953564,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":921600,"data_stored":442463,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757335,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":1363720,"data_compressed":59550,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":721878,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":331975,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":394134,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":400749,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T11:09:33.179 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-12T11:09:33.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-12T11:09:33.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:32 smithi172 ceph-mon[34517]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-05-12T11:09:33.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:32 smithi176 ceph-mon[34357]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-05-12T11:09:33.430 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:34.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:33 smithi086 ceph-mon[30110]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:34.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:33 smithi172 ceph-mon[34517]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:34.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:33 smithi176 ceph-mon[34357]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:35.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 -- 172.21.15.86:0/1069196253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b00109510 msgr2=0x7f4b001098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 --2- 172.21.15.86:0/1069196253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b00109510 0x7f4b001098f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009990 tx=0x7f4af0009ca0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 -- 172.21.15.86:0/1069196253 shutdown_connections 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 --2- 172.21.15.86:0/1069196253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b0006c5b0 0x7f4b00110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 --2- 172.21.15.86:0/1069196253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b00109510 0x7f4b001098f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 --2- 172.21.15.86:0/1069196253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b0006bbf0 0x7f4b0006c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 -- 172.21.15.86:0/1069196253 >> 172.21.15.86:0/1069196253 conn(0x7f4b00079370 msgr2=0x7f4b00079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 -- 172.21.15.86:0/1069196253 shutdown_connections 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.106+0000 7f4b064b4700 1 -- 172.21.15.86:0/1069196253 wait complete. 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b064b4700 1 Processor -- start 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b064b4700 1 -- start start 2024-05-12T11:09:35.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b064b4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b0006bbf0 0x7f4b0019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b064b4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b0006c5b0 0x7f4b0019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b064b4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b00109510 0x7f4b00199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b064b4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b00113620 con 0x7f4b0006c5b0 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b064b4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001134a0 con 0x7f4b00109510 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b064b4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001137a0 con 0x7f4b0006bbf0 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4aff7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b0006c5b0 0x7f4b0019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4aff7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b0006c5b0 0x7f4b0019fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35806/0 (socket says 172.21.15.86:35806) 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4aff7fe700 1 -- 172.21.15.86:0/3182961479 learned_addr learned my addr 172.21.15.86:0/3182961479 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4afffff700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b0006bbf0 0x7f4b0019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4b04a51700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b00109510 0x7f4b00199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4aff7fe700 1 -- 172.21.15.86:0/3182961479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b0006bbf0 msgr2=0x7f4b0019f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4aff7fe700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b0006bbf0 0x7f4b0019f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4aff7fe700 1 -- 172.21.15.86:0/3182961479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b00109510 msgr2=0x7f4b00199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:35.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.107+0000 7f4aff7fe700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b00109510 0x7f4b00199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.108+0000 7f4aff7fe700 1 -- 172.21.15.86:0/3182961479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0019a1e0 con 0x7f4b0006c5b0 2024-05-12T11:09:35.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.108+0000 7f4aff7fe700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b0006c5b0 0x7f4b0019fe00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4af400d950 tx=0x7f4af400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:35.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.108+0000 7f4afd7fa700 1 -- 172.21.15.86:0/3182961479 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4016070 con 0x7f4b0006c5b0 2024-05-12T11:09:35.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.108+0000 7f4afd7fa700 1 -- 172.21.15.86:0/3182961479 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af400fd40 con 0x7f4b0006c5b0 2024-05-12T11:09:35.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.108+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0019a4d0 con 0x7f4b0006c5b0 2024-05-12T11:09:35.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.108+0000 7f4afd7fa700 1 -- 172.21.15.86:0/3182961479 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af400e3b0 con 0x7f4b0006c5b0 2024-05-12T11:09:35.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.108+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b001a6790 con 0x7f4b0006c5b0 2024-05-12T11:09:35.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.109+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b0010b9f0 con 0x7f4b0006c5b0 2024-05-12T11:09:35.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.110+0000 7f4afd7fa700 1 -- 172.21.15.86:0/3182961479 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f4af4019070 con 0x7f4b0006c5b0 2024-05-12T11:09:35.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.111+0000 7f4afd7fa700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4ae80b2b10 0x7f4ae80b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.111+0000 7f4afffff700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4ae80b2b10 0x7f4ae80b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.111+0000 7f4afd7fa700 1 -- 172.21.15.86:0/3182961479 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4af40e23c0 con 0x7f4b0006c5b0 2024-05-12T11:09:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.111+0000 7f4afffff700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4ae80b2b10 0x7f4ae80b4fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4af000b5c0 tx=0x7f4af0005960 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:35.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.115+0000 7f4afd7fa700 1 -- 172.21.15.86:0/3182961479 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4af40a9b50 con 0x7f4b0006c5b0 2024-05-12T11:09:35.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:34 smithi086 ceph-mon[30110]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 57 op/s 2024-05-12T11:09:35.222 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:34 smithi172 ceph-mon[34517]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 57 op/s 2024-05-12T11:09:35.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:34 smithi176 ceph-mon[34357]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 57 op/s 2024-05-12T11:09:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.312+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b0019afb0 con 0x7f4ae80b2b10 2024-05-12T11:09:35.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.319+0000 7f4afd7fa700 1 -- 172.21.15.86:0/3182961479 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258085 (secure 0 0 0) 0x7f4b0019afb0 con 0x7f4ae80b2b10 2024-05-12T11:09:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:09:35.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.322+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4ae80b2b10 msgr2=0x7f4ae80b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:35.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.322+0000 7f4b064b4700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4ae80b2b10 0x7f4ae80b4fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4af000b5c0 tx=0x7f4af0005960 comp rx=0 tx=0).stop 2024-05-12T11:09:35.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.322+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b0006c5b0 msgr2=0x7f4b0019fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:35.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.322+0000 7f4b064b4700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b0006c5b0 0x7f4b0019fe00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4af400d950 tx=0x7f4af400dc60 comp rx=0 tx=0).stop 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.323+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 shutdown_connections 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.323+0000 7f4b064b4700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b00109510 0x7f4b00199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.323+0000 7f4b064b4700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b0006bbf0 0x7f4b0019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.323+0000 7f4b064b4700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4ae80b2b10 0x7f4ae80b4fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.323+0000 7f4b064b4700 1 --2- 172.21.15.86:0/3182961479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b0006c5b0 0x7f4b0019fe00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.323+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 >> 172.21.15.86:0/3182961479 conn(0x7f4b00079370 msgr2=0x7f4b00101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.323+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 shutdown_connections 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:35.323+0000 7f4b064b4700 1 -- 172.21.15.86:0/3182961479 wait complete. 2024-05-12T11:09:35.316 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-05-12T11:09:36.037 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-05-12T11:09:33.685770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1391266,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2408,"num_read_kb":1600,"num_write":648,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":2952534,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":988,"ondisk_log_size":988,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377252,"kb_used_data":11412,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564572,"statfs":{"total":1151940427776,"available":1151554121728,"internally_reserved":0,"allocated":11685888,"data_stored":9461358,"data_compressed":314070,"data_compressed_allocated":417792,"data_compressed_original":4165632,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200325,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":437,"num_write":147,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.990733"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976891+0000","last_change":"2024-05-12T11:06:05.173542+0000","last_active":"2024-05-12T11:09:23.976891+0000","last_peered":"2024-05-12T11:09:23.976891+0000","last_clean":"2024-05-12T11:09:23.976891+0000","last_became_active":"2024-05-12T11:06:05.173221+0000","last_became_peered":"2024-05-12T11:06:05.173221+0000","last_unstale":"2024-05-12T11:09:23.976891+0000","last_undegraded":"2024-05-12T11:09:23.976891+0000","last_fullsized":"2024-05-12T11:09:23.976891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:54:21.755807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922383+0000","last_change":"2024-05-12T11:06:05.178626+0000","last_active":"2024-05-12T11:09:23.922383+0000","last_peered":"2024-05-12T11:09:23.922383+0000","last_clean":"2024-05-12T11:09:23.922383+0000","last_became_active":"2024-05-12T11:06:05.178313+0000","last_became_peered":"2024-05-12T11:06:05.178313+0000","last_unstale":"2024-05-12T11:09:23.922383+0000","last_undegraded":"2024-05-12T11:09:23.922383+0000","last_fullsized":"2024-05-12T11:09:23.922383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:45:25.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922151+0000","last_change":"2024-05-12T11:06:05.175396+0000","last_active":"2024-05-12T11:09:23.922151+0000","last_peered":"2024-05-12T11:09:23.922151+0000","last_clean":"2024-05-12T11:09:23.922151+0000","last_became_active":"2024-05-12T11:06:05.175060+0000","last_became_peered":"2024-05-12T11:06:05.175060+0000","last_unstale":"2024-05-12T11:09:23.922151+0000","last_undegraded":"2024-05-12T11:09:23.922151+0000","last_fullsized":"2024-05-12T11:09:23.922151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:55:08.180220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671170+0000","last_change":"2024-05-12T11:06:05.172900+0000","last_active":"2024-05-12T11:09:23.671170+0000","last_peered":"2024-05-12T11:09:23.671170+0000","last_clean":"2024-05-12T11:09:23.671170+0000","last_became_active":"2024-05-12T11:06:05.172549+0000","last_became_peered":"2024-05-12T11:06:05.172549+0000","last_unstale":"2024-05-12T11:09:23.671170+0000","last_undegraded":"2024-05-12T11:09:23.671170+0000","last_fullsized":"2024-05-12T11:09:23.671170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:07:39.683046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765667+0000","last_change":"2024-05-12T11:06:05.168126+0000","last_active":"2024-05-12T11:09:23.765667+0000","last_peered":"2024-05-12T11:09:23.765667+0000","last_clean":"2024-05-12T11:09:23.765667+0000","last_became_active":"2024-05-12T11:06:05.167729+0000","last_became_peered":"2024-05-12T11:06:05.167729+0000","last_unstale":"2024-05-12T11:09:23.765667+0000","last_undegraded":"2024-05-12T11:09:23.765667+0000","last_fullsized":"2024-05-12T11:09:23.765667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:28:38.996242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774891+0000","last_change":"2024-05-12T11:06:05.180165+0000","last_active":"2024-05-12T11:09:23.774891+0000","last_peered":"2024-05-12T11:09:23.774891+0000","last_clean":"2024-05-12T11:09:23.774891+0000","last_became_active":"2024-05-12T11:06:05.179589+0000","last_became_peered":"2024-05-12T11:06:05.179589+0000","last_unstale":"2024-05-12T11:09:23.774891+0000","last_undegraded":"2024-05-12T11:09:23.774891+0000","last_fullsized":"2024-05-12T11:09:23.774891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:51:53.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919741+0000","last_change":"2024-05-12T11:06:05.176052+0000","last_active":"2024-05-12T11:09:23.919741+0000","last_peered":"2024-05-12T11:09:23.919741+0000","last_clean":"2024-05-12T11:09:23.919741+0000","last_became_active":"2024-05-12T11:06:05.175703+0000","last_became_peered":"2024-05-12T11:06:05.175703+0000","last_unstale":"2024-05-12T11:09:23.919741+0000","last_undegraded":"2024-05-12T11:09:23.919741+0000","last_fullsized":"2024-05-12T11:09:23.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:51:11.008516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765437+0000","last_change":"2024-05-12T11:06:05.179144+0000","last_active":"2024-05-12T11:09:23.765437+0000","last_peered":"2024-05-12T11:09:23.765437+0000","last_clean":"2024-05-12T11:09:23.765437+0000","last_became_active":"2024-05-12T11:06:05.177854+0000","last_became_peered":"2024-05-12T11:06:05.177854+0000","last_unstale":"2024-05-12T11:09:23.765437+0000","last_undegraded":"2024-05-12T11:09:23.765437+0000","last_fullsized":"2024-05-12T11:09:23.765437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:12.231086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668172+0000","last_change":"2024-05-12T11:06:45.310743+0000","last_active":"2024-05-12T11:09:23.668172+0000","last_peered":"2024-05-12T11:09:23.668172+0000","last_clean":"2024-05-12T11:09:23.668172+0000","last_became_active":"2024-05-12T11:06:45.310358+0000","last_became_peered":"2024-05-12T11:06:45.310358+0000","last_unstale":"2024-05-12T11:09:23.668172+0000","last_undegraded":"2024-05-12T11:09:23.668172+0000","last_fullsized":"2024-05-12T11:09:23.668172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:22:30.862132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.775252+0000","last_change":"2024-05-12T11:06:05.176196+0000","last_active":"2024-05-12T11:09:23.775252+0000","last_peered":"2024-05-12T11:09:23.775252+0000","last_clean":"2024-05-12T11:09:23.775252+0000","last_became_active":"2024-05-12T11:06:05.175863+0000","last_became_peered":"2024-05-12T11:06:05.175863+0000","last_unstale":"2024-05-12T11:09:23.775252+0000","last_undegraded":"2024-05-12T11:09:23.775252+0000","last_fullsized":"2024-05-12T11:09:23.775252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:26:41.815661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919973+0000","last_change":"2024-05-12T11:06:05.175901+0000","last_active":"2024-05-12T11:09:23.919973+0000","last_peered":"2024-05-12T11:09:23.919973+0000","last_clean":"2024-05-12T11:09:23.919973+0000","last_became_active":"2024-05-12T11:06:05.175514+0000","last_became_peered":"2024-05-12T11:06:05.175514+0000","last_unstale":"2024-05-12T11:09:23.919973+0000","last_undegraded":"2024-05-12T11:09:23.919973+0000","last_fullsized":"2024-05-12T11:09:23.919973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:45:11.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671109+0000","last_change":"2024-05-12T11:06:05.175474+0000","last_active":"2024-05-12T11:09:23.671109+0000","last_peered":"2024-05-12T11:09:23.671109+0000","last_clean":"2024-05-12T11:09:23.671109+0000","last_became_active":"2024-05-12T11:06:05.175082+0000","last_became_peered":"2024-05-12T11:06:05.175082+0000","last_unstale":"2024-05-12T11:09:23.671109+0000","last_undegraded":"2024-05-12T11:09:23.671109+0000","last_fullsized":"2024-05-12T11:09:23.671109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:10:53.548758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919727+0000","last_change":"2024-05-12T11:06:05.170426+0000","last_active":"2024-05-12T11:09:23.919727+0000","last_peered":"2024-05-12T11:09:23.919727+0000","last_clean":"2024-05-12T11:09:23.919727+0000","last_became_active":"2024-05-12T11:06:05.170111+0000","last_became_peered":"2024-05-12T11:06:05.170111+0000","last_unstale":"2024-05-12T11:09:23.919727+0000","last_undegraded":"2024-05-12T11:09:23.919727+0000","last_fullsized":"2024-05-12T11:09:23.919727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:50.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922244+0000","last_change":"2024-05-12T11:06:05.178939+0000","last_active":"2024-05-12T11:09:23.922244+0000","last_peered":"2024-05-12T11:09:23.922244+0000","last_clean":"2024-05-12T11:09:23.922244+0000","last_became_active":"2024-05-12T11:06:05.178604+0000","last_became_peered":"2024-05-12T11:06:05.178604+0000","last_unstale":"2024-05-12T11:09:23.922244+0000","last_undegraded":"2024-05-12T11:09:23.922244+0000","last_fullsized":"2024-05-12T11:09:23.922244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:09:36.222841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921990+0000","last_change":"2024-05-12T11:06:45.312800+0000","last_active":"2024-05-12T11:09:23.921990+0000","last_peered":"2024-05-12T11:09:23.921990+0000","last_clean":"2024-05-12T11:09:23.921990+0000","last_became_active":"2024-05-12T11:06:45.312567+0000","last_became_peered":"2024-05-12T11:06:45.312567+0000","last_unstale":"2024-05-12T11:09:23.921990+0000","last_undegraded":"2024-05-12T11:09:23.921990+0000","last_fullsized":"2024-05-12T11:09:23.921990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:30:21.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920501+0000","last_change":"2024-05-12T11:06:05.170481+0000","last_active":"2024-05-12T11:09:23.920501+0000","last_peered":"2024-05-12T11:09:23.920501+0000","last_clean":"2024-05-12T11:09:23.920501+0000","last_became_active":"2024-05-12T11:06:05.170173+0000","last_became_peered":"2024-05-12T11:06:05.170173+0000","last_unstale":"2024-05-12T11:09:23.920501+0000","last_undegraded":"2024-05-12T11:09:23.920501+0000","last_fullsized":"2024-05-12T11:09:23.920501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:01:37.775287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976993+0000","last_change":"2024-05-12T11:06:05.172942+0000","last_active":"2024-05-12T11:09:23.976993+0000","last_peered":"2024-05-12T11:09:23.976993+0000","last_clean":"2024-05-12T11:09:23.976993+0000","last_became_active":"2024-05-12T11:06:05.172612+0000","last_became_peered":"2024-05-12T11:06:05.172612+0000","last_unstale":"2024-05-12T11:09:23.976993+0000","last_undegraded":"2024-05-12T11:09:23.976993+0000","last_fullsized":"2024-05-12T11:09:23.976993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:26:51.548027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668313+0000","last_change":"2024-05-12T11:06:05.175400+0000","last_active":"2024-05-12T11:09:23.668313+0000","last_peered":"2024-05-12T11:09:23.668313+0000","last_clean":"2024-05-12T11:09:23.668313+0000","last_became_active":"2024-05-12T11:06:05.174871+0000","last_became_peered":"2024-05-12T11:06:05.174871+0000","last_unstale":"2024-05-12T11:09:23.668313+0000","last_undegraded":"2024-05-12T11:09:23.668313+0000","last_fullsized":"2024-05-12T11:09:23.668313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:48:12.566540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671676+0000","last_change":"2024-05-12T11:06:05.172584+0000","last_active":"2024-05-12T11:09:23.671676+0000","last_peered":"2024-05-12T11:09:23.671676+0000","last_clean":"2024-05-12T11:09:23.671676+0000","last_became_active":"2024-05-12T11:06:05.171545+0000","last_became_peered":"2024-05-12T11:06:05.171545+0000","last_unstale":"2024-05-12T11:09:23.671676+0000","last_undegraded":"2024-05-12T11:09:23.671676+0000","last_fullsized":"2024-05-12T11:09:23.671676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:34:45.950231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":231,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.492525+0000","last_change":"2024-05-12T11:06:02.148890+0000","last_active":"2024-05-12T11:09:28.492525+0000","last_peered":"2024-05-12T11:09:28.492525+0000","last_clean":"2024-05-12T11:09:28.492525+0000","last_became_active":"2024-05-12T11:06:02.148544+0000","last_became_peered":"2024-05-12T11:06:02.148544+0000","last_unstale":"2024-05-12T11:09:28.492525+0000","last_undegraded":"2024-05-12T11:09:28.492525+0000","last_fullsized":"2024-05-12T11:09:28.492525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:12:34.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":188,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765952+0000","last_change":"2024-05-12T11:06:05.175214+0000","last_active":"2024-05-12T11:09:23.765952+0000","last_peered":"2024-05-12T11:09:23.765952+0000","last_clean":"2024-05-12T11:09:23.765952+0000","last_became_active":"2024-05-12T11:06:05.174920+0000","last_became_peered":"2024-05-12T11:06:05.174920+0000","last_unstale":"2024-05-12T11:09:23.765952+0000","last_undegraded":"2024-05-12T11:09:23.765952+0000","last_fullsized":"2024-05-12T11:09:23.765952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:30:36.277975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.766173+0000","last_change":"2024-05-12T11:06:02.246073+0000","last_active":"2024-05-12T11:09:23.766173+0000","last_peered":"2024-05-12T11:09:23.766173+0000","last_clean":"2024-05-12T11:09:23.766173+0000","last_became_active":"2024-05-12T11:06:02.245728+0000","last_became_peered":"2024-05-12T11:06:02.245728+0000","last_unstale":"2024-05-12T11:09:23.766173+0000","last_undegraded":"2024-05-12T11:09:23.766173+0000","last_fullsized":"2024-05-12T11:09:23.766173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:43:03.273179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922550+0000","last_change":"2024-05-12T11:06:05.170448+0000","last_active":"2024-05-12T11:09:23.922550+0000","last_peered":"2024-05-12T11:09:23.922550+0000","last_clean":"2024-05-12T11:09:23.922550+0000","last_became_active":"2024-05-12T11:06:05.170133+0000","last_became_peered":"2024-05-12T11:06:05.170133+0000","last_unstale":"2024-05-12T11:09:23.922550+0000","last_undegraded":"2024-05-12T11:09:23.922550+0000","last_fullsized":"2024-05-12T11:09:23.922550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:17:30.669009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765993+0000","last_change":"2024-05-12T11:06:02.155137+0000","last_active":"2024-05-12T11:09:23.765993+0000","last_peered":"2024-05-12T11:09:23.765993+0000","last_clean":"2024-05-12T11:09:23.765993+0000","last_became_active":"2024-05-12T11:06:02.154467+0000","last_became_peered":"2024-05-12T11:06:02.154467+0000","last_unstale":"2024-05-12T11:09:23.765993+0000","last_undegraded":"2024-05-12T11:09:23.765993+0000","last_fullsized":"2024-05-12T11:09:23.765993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:38.708094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920852+0000","last_change":"2024-05-12T11:06:05.180903+0000","last_active":"2024-05-12T11:09:23.920852+0000","last_peered":"2024-05-12T11:09:23.920852+0000","last_clean":"2024-05-12T11:09:23.920852+0000","last_became_active":"2024-05-12T11:06:05.180519+0000","last_became_peered":"2024-05-12T11:06:05.180519+0000","last_unstale":"2024-05-12T11:09:23.920852+0000","last_undegraded":"2024-05-12T11:09:23.920852+0000","last_fullsized":"2024-05-12T11:09:23.920852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:57:47.535714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976684+0000","last_change":"2024-05-12T11:06:45.325333+0000","last_active":"2024-05-12T11:09:23.976684+0000","last_peered":"2024-05-12T11:09:23.976684+0000","last_clean":"2024-05-12T11:09:23.976684+0000","last_became_active":"2024-05-12T11:06:45.312552+0000","last_became_peered":"2024-05-12T11:06:45.312552+0000","last_unstale":"2024-05-12T11:09:23.976684+0000","last_undegraded":"2024-05-12T11:09:23.976684+0000","last_fullsized":"2024-05-12T11:09:23.976684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:34:45.862620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772039+0000","last_change":"2024-05-12T11:06:05.167052+0000","last_active":"2024-05-12T11:09:23.772039+0000","last_peered":"2024-05-12T11:09:23.772039+0000","last_clean":"2024-05-12T11:09:23.772039+0000","last_became_active":"2024-05-12T11:06:05.166689+0000","last_became_peered":"2024-05-12T11:06:05.166689+0000","last_unstale":"2024-05-12T11:09:23.772039+0000","last_undegraded":"2024-05-12T11:09:23.772039+0000","last_fullsized":"2024-05-12T11:09:23.772039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:34:05.008336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'8","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.492749+0000","last_change":"2024-05-12T11:06:02.154630+0000","last_active":"2024-05-12T11:09:28.492749+0000","last_peered":"2024-05-12T11:09:28.492749+0000","last_clean":"2024-05-12T11:09:28.492749+0000","last_became_active":"2024-05-12T11:06:02.154254+0000","last_became_peered":"2024-05-12T11:06:02.154254+0000","last_unstale":"2024-05-12T11:09:28.492749+0000","last_undegraded":"2024-05-12T11:09:28.492749+0000","last_fullsized":"2024-05-12T11:09:28.492749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:17:54.294058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":192,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765582+0000","last_change":"2024-05-12T11:06:05.176582+0000","last_active":"2024-05-12T11:09:23.765582+0000","last_peered":"2024-05-12T11:09:23.765582+0000","last_clean":"2024-05-12T11:09:23.765582+0000","last_became_active":"2024-05-12T11:06:05.176241+0000","last_became_peered":"2024-05-12T11:06:05.176241+0000","last_unstale":"2024-05-12T11:09:23.765582+0000","last_undegraded":"2024-05-12T11:09:23.765582+0000","last_fullsized":"2024-05-12T11:09:23.765582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:09:00.020166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774832+0000","last_change":"2024-05-12T11:06:02.148534+0000","last_active":"2024-05-12T11:09:23.774832+0000","last_peered":"2024-05-12T11:09:23.774832+0000","last_clean":"2024-05-12T11:09:23.774832+0000","last_became_active":"2024-05-12T11:06:02.148155+0000","last_became_peered":"2024-05-12T11:06:02.148155+0000","last_unstale":"2024-05-12T11:09:23.774832+0000","last_undegraded":"2024-05-12T11:09:23.774832+0000","last_fullsized":"2024-05-12T11:09:23.774832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:52:21.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772041+0000","last_change":"2024-05-12T11:06:05.169944+0000","last_active":"2024-05-12T11:09:23.772041+0000","last_peered":"2024-05-12T11:09:23.772041+0000","last_clean":"2024-05-12T11:09:23.772041+0000","last_became_active":"2024-05-12T11:06:05.169597+0000","last_became_peered":"2024-05-12T11:06:05.169597+0000","last_unstale":"2024-05-12T11:09:23.772041+0000","last_undegraded":"2024-05-12T11:09:23.772041+0000","last_fullsized":"2024-05-12T11:09:23.772041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:05:17.724037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919670+0000","last_change":"2024-05-12T11:06:02.154539+0000","last_active":"2024-05-12T11:09:23.919670+0000","last_peered":"2024-05-12T11:09:23.919670+0000","last_clean":"2024-05-12T11:09:23.919670+0000","last_became_active":"2024-05-12T11:06:02.154040+0000","last_became_peered":"2024-05-12T11:06:02.154040+0000","last_unstale":"2024-05-12T11:09:23.919670+0000","last_undegraded":"2024-05-12T11:09:23.919670+0000","last_fullsized":"2024-05-12T11:09:23.919670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:10:23.875273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.667936+0000","last_change":"2024-05-12T11:06:45.308950+0000","last_active":"2024-05-12T11:09:23.667936+0000","last_peered":"2024-05-12T11:09:23.667936+0000","last_clean":"2024-05-12T11:09:23.667936+0000","last_became_active":"2024-05-12T11:06:45.308579+0000","last_became_peered":"2024-05-12T11:06:45.308579+0000","last_unstale":"2024-05-12T11:09:23.667936+0000","last_undegraded":"2024-05-12T11:09:23.667936+0000","last_fullsized":"2024-05-12T11:09:23.667936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:01:08.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771828+0000","last_change":"2024-05-12T11:06:02.151341+0000","last_active":"2024-05-12T11:09:23.771828+0000","last_peered":"2024-05-12T11:09:23.771828+0000","last_clean":"2024-05-12T11:09:23.771828+0000","last_became_active":"2024-05-12T11:06:02.150949+0000","last_became_peered":"2024-05-12T11:06:02.150949+0000","last_unstale":"2024-05-12T11:09:23.771828+0000","last_undegraded":"2024-05-12T11:09:23.771828+0000","last_fullsized":"2024-05-12T11:09:23.771828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:07:26.699269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.667944+0000","last_change":"2024-05-12T11:06:05.173060+0000","last_active":"2024-05-12T11:09:23.667944+0000","last_peered":"2024-05-12T11:09:23.667944+0000","last_clean":"2024-05-12T11:09:23.667944+0000","last_became_active":"2024-05-12T11:06:05.172756+0000","last_became_peered":"2024-05-12T11:06:05.172756+0000","last_unstale":"2024-05-12T11:09:23.667944+0000","last_undegraded":"2024-05-12T11:09:23.667944+0000","last_fullsized":"2024-05-12T11:09:23.667944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:15:12.797466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'7","reported_seq":410,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:29.493336+0000","last_change":"2024-05-12T11:06:02.152219+0000","last_active":"2024-05-12T11:09:29.493336+0000","last_peered":"2024-05-12T11:09:29.493336+0000","last_clean":"2024-05-12T11:09:29.493336+0000","last_became_active":"2024-05-12T11:06:02.151707+0000","last_became_peered":"2024-05-12T11:06:02.151707+0000","last_unstale":"2024-05-12T11:09:29.493336+0000","last_undegraded":"2024-05-12T11:09:29.493336+0000","last_fullsized":"2024-05-12T11:09:29.493336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:43.047957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":374,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921355+0000","last_change":"2024-05-12T11:06:05.173436+0000","last_active":"2024-05-12T11:09:23.921355+0000","last_peered":"2024-05-12T11:09:23.921355+0000","last_clean":"2024-05-12T11:09:23.921355+0000","last_became_active":"2024-05-12T11:06:05.173057+0000","last_became_peered":"2024-05-12T11:06:05.173057+0000","last_unstale":"2024-05-12T11:09:23.921355+0000","last_undegraded":"2024-05-12T11:09:23.921355+0000","last_fullsized":"2024-05-12T11:09:23.921355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.408017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920905+0000","last_change":"2024-05-12T11:06:02.155037+0000","last_active":"2024-05-12T11:09:23.920905+0000","last_peered":"2024-05-12T11:09:23.920905+0000","last_clean":"2024-05-12T11:09:23.920905+0000","last_became_active":"2024-05-12T11:06:02.154658+0000","last_became_peered":"2024-05-12T11:06:02.154658+0000","last_unstale":"2024-05-12T11:09:23.920905+0000","last_undegraded":"2024-05-12T11:09:23.920905+0000","last_fullsized":"2024-05-12T11:09:23.920905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:58:16.633636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922370+0000","last_change":"2024-05-12T11:06:05.176100+0000","last_active":"2024-05-12T11:09:23.922370+0000","last_peered":"2024-05-12T11:09:23.922370+0000","last_clean":"2024-05-12T11:09:23.922370+0000","last_became_active":"2024-05-12T11:06:05.175385+0000","last_became_peered":"2024-05-12T11:06:05.175385+0000","last_unstale":"2024-05-12T11:09:23.922370+0000","last_undegraded":"2024-05-12T11:09:23.922370+0000","last_fullsized":"2024-05-12T11:09:23.922370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:11:10.627583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772185+0000","last_change":"2024-05-12T11:06:02.246427+0000","last_active":"2024-05-12T11:09:23.772185+0000","last_peered":"2024-05-12T11:09:23.772185+0000","last_clean":"2024-05-12T11:09:23.772185+0000","last_became_active":"2024-05-12T11:06:02.246068+0000","last_became_peered":"2024-05-12T11:06:02.246068+0000","last_unstale":"2024-05-12T11:09:23.772185+0000","last_undegraded":"2024-05-12T11:09:23.772185+0000","last_fullsized":"2024-05-12T11:09:23.772185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:40:25.533391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921096+0000","last_change":"2024-05-12T11:06:45.310358+0000","last_active":"2024-05-12T11:09:23.921096+0000","last_peered":"2024-05-12T11:09:23.921096+0000","last_clean":"2024-05-12T11:09:23.921096+0000","last_became_active":"2024-05-12T11:06:45.309960+0000","last_became_peered":"2024-05-12T11:06:45.309960+0000","last_unstale":"2024-05-12T11:09:23.921096+0000","last_undegraded":"2024-05-12T11:09:23.921096+0000","last_fullsized":"2024-05-12T11:09:23.921096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:29:28.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'41","reported_seq":457,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:29.493585+0000","last_change":"2024-05-12T11:06:02.151099+0000","last_active":"2024-05-12T11:09:29.493585+0000","last_peered":"2024-05-12T11:09:29.493585+0000","last_clean":"2024-05-12T11:09:29.493585+0000","last_became_active":"2024-05-12T11:06:02.150702+0000","last_became_peered":"2024-05-12T11:06:02.150702+0000","last_unstale":"2024-05-12T11:09:29.493585+0000","last_undegraded":"2024-05-12T11:09:29.493585+0000","last_fullsized":"2024-05-12T11:09:29.493585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:14:00.609262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70390,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":387,"num_read_kb":259,"num_write":43,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765773+0000","last_change":"2024-05-12T11:06:05.171016+0000","last_active":"2024-05-12T11:09:23.765773+0000","last_peered":"2024-05-12T11:09:23.765773+0000","last_clean":"2024-05-12T11:09:23.765773+0000","last_became_active":"2024-05-12T11:06:05.170659+0000","last_became_peered":"2024-05-12T11:06:05.170659+0000","last_unstale":"2024-05-12T11:09:23.765773+0000","last_undegraded":"2024-05-12T11:09:23.765773+0000","last_fullsized":"2024-05-12T11:09:23.765773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:13:00.756621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671532+0000","last_change":"2024-05-12T11:06:02.153854+0000","last_active":"2024-05-12T11:09:23.671532+0000","last_peered":"2024-05-12T11:09:23.671532+0000","last_clean":"2024-05-12T11:09:23.671532+0000","last_became_active":"2024-05-12T11:06:02.153501+0000","last_became_peered":"2024-05-12T11:06:02.153501+0000","last_unstale":"2024-05-12T11:09:23.671532+0000","last_undegraded":"2024-05-12T11:09:23.671532+0000","last_fullsized":"2024-05-12T11:09:23.671532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:42:37.608641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919448+0000","last_change":"2024-05-12T11:06:05.169348+0000","last_active":"2024-05-12T11:09:23.919448+0000","last_peered":"2024-05-12T11:09:23.919448+0000","last_clean":"2024-05-12T11:09:23.919448+0000","last_became_active":"2024-05-12T11:06:05.169031+0000","last_became_peered":"2024-05-12T11:06:05.169031+0000","last_unstale":"2024-05-12T11:09:23.919448+0000","last_undegraded":"2024-05-12T11:09:23.919448+0000","last_fullsized":"2024-05-12T11:09:23.919448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:07:13.104465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771913+0000","last_change":"2024-05-12T11:06:02.152482+0000","last_active":"2024-05-12T11:09:23.771913+0000","last_peered":"2024-05-12T11:09:23.771913+0000","last_clean":"2024-05-12T11:09:23.771913+0000","last_became_active":"2024-05-12T11:06:02.152077+0000","last_became_peered":"2024-05-12T11:06:02.152077+0000","last_unstale":"2024-05-12T11:09:23.771913+0000","last_undegraded":"2024-05-12T11:09:23.771913+0000","last_fullsized":"2024-05-12T11:09:23.771913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:11:42.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920242+0000","last_change":"2024-05-12T11:06:05.175228+0000","last_active":"2024-05-12T11:09:23.920242+0000","last_peered":"2024-05-12T11:09:23.920242+0000","last_clean":"2024-05-12T11:09:23.920242+0000","last_became_active":"2024-05-12T11:06:05.174892+0000","last_became_peered":"2024-05-12T11:06:05.174892+0000","last_unstale":"2024-05-12T11:09:23.920242+0000","last_undegraded":"2024-05-12T11:09:23.920242+0000","last_fullsized":"2024-05-12T11:09:23.920242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:34.581296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":225,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.492638+0000","last_change":"2024-05-12T11:06:02.149923+0000","last_active":"2024-05-12T11:09:28.492638+0000","last_peered":"2024-05-12T11:09:28.492638+0000","last_clean":"2024-05-12T11:09:28.492638+0000","last_became_active":"2024-05-12T11:06:02.149571+0000","last_became_peered":"2024-05-12T11:06:02.149571+0000","last_unstale":"2024-05-12T11:09:28.492638+0000","last_undegraded":"2024-05-12T11:09:28.492638+0000","last_fullsized":"2024-05-12T11:09:28.492638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:23:36.118502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919660+0000","last_change":"2024-05-12T11:06:05.178843+0000","last_active":"2024-05-12T11:09:23.919660+0000","last_peered":"2024-05-12T11:09:23.919660+0000","last_clean":"2024-05-12T11:09:23.919660+0000","last_became_active":"2024-05-12T11:06:05.178526+0000","last_became_peered":"2024-05-12T11:06:05.178526+0000","last_unstale":"2024-05-12T11:09:23.919660+0000","last_undegraded":"2024-05-12T11:09:23.919660+0000","last_fullsized":"2024-05-12T11:09:23.919660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:22:57.760329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765564+0000","last_change":"2024-05-12T11:06:45.512231+0000","last_active":"2024-05-12T11:09:23.765564+0000","last_peered":"2024-05-12T11:09:23.765564+0000","last_clean":"2024-05-12T11:09:23.765564+0000","last_became_active":"2024-05-12T11:06:45.499482+0000","last_became_peered":"2024-05-12T11:06:45.499482+0000","last_unstale":"2024-05-12T11:09:23.765564+0000","last_undegraded":"2024-05-12T11:09:23.765564+0000","last_fullsized":"2024-05-12T11:09:23.765564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:34:43.986131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771846+0000","last_change":"2024-05-12T11:06:05.168307+0000","last_active":"2024-05-12T11:09:23.771846+0000","last_peered":"2024-05-12T11:09:23.771846+0000","last_clean":"2024-05-12T11:09:23.771846+0000","last_became_active":"2024-05-12T11:06:05.167606+0000","last_became_peered":"2024-05-12T11:06:05.167606+0000","last_unstale":"2024-05-12T11:09:23.771846+0000","last_undegraded":"2024-05-12T11:09:23.771846+0000","last_fullsized":"2024-05-12T11:09:23.771846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:25:09.384425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765924+0000","last_change":"2024-05-12T11:06:02.156201+0000","last_active":"2024-05-12T11:09:23.765924+0000","last_peered":"2024-05-12T11:09:23.765924+0000","last_clean":"2024-05-12T11:09:23.765924+0000","last_became_active":"2024-05-12T11:06:02.155398+0000","last_became_peered":"2024-05-12T11:06:02.155398+0000","last_unstale":"2024-05-12T11:09:23.765924+0000","last_undegraded":"2024-05-12T11:09:23.765924+0000","last_fullsized":"2024-05-12T11:09:23.765924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T18:23:01.157554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976796+0000","last_change":"2024-05-12T11:06:05.176837+0000","last_active":"2024-05-12T11:09:23.976796+0000","last_peered":"2024-05-12T11:09:23.976796+0000","last_clean":"2024-05-12T11:09:23.976796+0000","last_became_active":"2024-05-12T11:06:05.176450+0000","last_became_peered":"2024-05-12T11:06:05.176450+0000","last_unstale":"2024-05-12T11:09:23.976796+0000","last_undegraded":"2024-05-12T11:09:23.976796+0000","last_fullsized":"2024-05-12T11:09:23.976796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:36:17.654259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.668198+0000","last_change":"2024-05-12T11:06:02.246999+0000","last_active":"2024-05-12T11:09:23.668198+0000","last_peered":"2024-05-12T11:09:23.668198+0000","last_clean":"2024-05-12T11:09:23.668198+0000","last_became_active":"2024-05-12T11:06:02.246063+0000","last_became_peered":"2024-05-12T11:06:02.246063+0000","last_unstale":"2024-05-12T11:09:23.668198+0000","last_undegraded":"2024-05-12T11:09:23.668198+0000","last_fullsized":"2024-05-12T11:09:23.668198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:46:39.303069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.775094+0000","last_change":"2024-05-12T11:06:05.175333+0000","last_active":"2024-05-12T11:09:23.775094+0000","last_peered":"2024-05-12T11:09:23.775094+0000","last_clean":"2024-05-12T11:09:23.775094+0000","last_became_active":"2024-05-12T11:06:05.175011+0000","last_became_peered":"2024-05-12T11:06:05.175011+0000","last_unstale":"2024-05-12T11:09:23.775094+0000","last_undegraded":"2024-05-12T11:09:23.775094+0000","last_fullsized":"2024-05-12T11:09:23.775094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:51:57.025941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'7","reported_seq":226,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.493098+0000","last_change":"2024-05-12T11:06:02.151044+0000","last_active":"2024-05-12T11:09:28.493098+0000","last_peered":"2024-05-12T11:09:28.493098+0000","last_clean":"2024-05-12T11:09:28.493098+0000","last_became_active":"2024-05-12T11:06:02.150011+0000","last_became_peered":"2024-05-12T11:06:02.150011+0000","last_unstale":"2024-05-12T11:09:28.493098+0000","last_undegraded":"2024-05-12T11:09:28.493098+0000","last_fullsized":"2024-05-12T11:09:28.493098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:16:14.058893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.774954+0000","last_change":"2024-05-12T11:06:05.179210+0000","last_active":"2024-05-12T11:09:23.774954+0000","last_peered":"2024-05-12T11:09:23.774954+0000","last_clean":"2024-05-12T11:09:23.774954+0000","last_became_active":"2024-05-12T11:06:05.178853+0000","last_became_peered":"2024-05-12T11:06:05.178853+0000","last_unstale":"2024-05-12T11:09:23.774954+0000","last_undegraded":"2024-05-12T11:09:23.774954+0000","last_fullsized":"2024-05-12T11:09:23.774954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:50:05.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.772157+0000","last_change":"2024-05-12T11:06:05.170860+0000","last_active":"2024-05-12T11:09:23.772157+0000","last_peered":"2024-05-12T11:09:23.772157+0000","last_clean":"2024-05-12T11:09:23.772157+0000","last_became_active":"2024-05-12T11:06:05.170502+0000","last_became_peered":"2024-05-12T11:06:05.170502+0000","last_unstale":"2024-05-12T11:09:23.772157+0000","last_undegraded":"2024-05-12T11:09:23.772157+0000","last_fullsized":"2024-05-12T11:09:23.772157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:26:46.495176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'6","reported_seq":223,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.492212+0000","last_change":"2024-05-12T11:06:02.245996+0000","last_active":"2024-05-12T11:09:28.492212+0000","last_peered":"2024-05-12T11:09:28.492212+0000","last_clean":"2024-05-12T11:09:28.492212+0000","last_became_active":"2024-05-12T11:06:02.245629+0000","last_became_peered":"2024-05-12T11:06:02.245629+0000","last_unstale":"2024-05-12T11:09:28.492212+0000","last_undegraded":"2024-05-12T11:09:28.492212+0000","last_fullsized":"2024-05-12T11:09:28.492212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:02:54.794852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":188,"num_read_kb":188,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765708+0000","last_change":"2024-05-12T11:06:05.174731+0000","last_active":"2024-05-12T11:09:23.765708+0000","last_peered":"2024-05-12T11:09:23.765708+0000","last_clean":"2024-05-12T11:09:23.765708+0000","last_became_active":"2024-05-12T11:06:05.174396+0000","last_became_peered":"2024-05-12T11:06:05.174396+0000","last_unstale":"2024-05-12T11:09:23.765708+0000","last_undegraded":"2024-05-12T11:09:23.765708+0000","last_fullsized":"2024-05-12T11:09:23.765708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:30:48.352011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.670989+0000","last_change":"2024-05-12T11:06:02.153635+0000","last_active":"2024-05-12T11:09:23.670989+0000","last_peered":"2024-05-12T11:09:23.670989+0000","last_clean":"2024-05-12T11:09:23.670989+0000","last_became_active":"2024-05-12T11:06:02.153268+0000","last_became_peered":"2024-05-12T11:06:02.153268+0000","last_unstale":"2024-05-12T11:09:23.670989+0000","last_undegraded":"2024-05-12T11:09:23.670989+0000","last_fullsized":"2024-05-12T11:09:23.670989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:18:55.245138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"83'99","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:25.789660+0000","last_change":"2024-05-12T11:04:37.106045+0000","last_active":"2024-05-12T11:09:25.789660+0000","last_peered":"2024-05-12T11:09:25.789660+0000","last_clean":"2024-05-12T11:09:25.789660+0000","last_became_active":"2024-05-12T11:04:37.101364+0000","last_became_peered":"2024-05-12T11:04:37.101364+0000","last_unstale":"2024-05-12T11:09:25.789660+0000","last_undegraded":"2024-05-12T11:09:25.789660+0000","last_fullsized":"2024-05-12T11:09:25.789660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:01:12.632157+0000","last_clean_scrub_stamp":"2024-05-12T11:01:12.632157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:53:22.531168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919347+0000","last_change":"2024-05-12T11:06:05.163927+0000","last_active":"2024-05-12T11:09:23.919347+0000","last_peered":"2024-05-12T11:09:23.919347+0000","last_clean":"2024-05-12T11:09:23.919347+0000","last_became_active":"2024-05-12T11:06:05.163610+0000","last_became_peered":"2024-05-12T11:06:05.163610+0000","last_unstale":"2024-05-12T11:09:23.919347+0000","last_undegraded":"2024-05-12T11:09:23.919347+0000","last_fullsized":"2024-05-12T11:09:23.919347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:58:31.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919949+0000","last_change":"2024-05-12T11:06:02.152658+0000","last_active":"2024-05-12T11:09:23.919949+0000","last_peered":"2024-05-12T11:09:23.919949+0000","last_clean":"2024-05-12T11:09:23.919949+0000","last_became_active":"2024-05-12T11:06:02.151770+0000","last_became_peered":"2024-05-12T11:06:02.151770+0000","last_unstale":"2024-05-12T11:09:23.919949+0000","last_undegraded":"2024-05-12T11:09:23.919949+0000","last_fullsized":"2024-05-12T11:09:23.919949+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T20:37:18.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765861+0000","last_change":"2024-05-12T11:06:02.246421+0000","last_active":"2024-05-12T11:09:23.765861+0000","last_peered":"2024-05-12T11:09:23.765861+0000","last_clean":"2024-05-12T11:09:23.765861+0000","last_became_active":"2024-05-12T11:06:02.246065+0000","last_became_peered":"2024-05-12T11:06:02.246065+0000","last_unstale":"2024-05-12T11:09:23.765861+0000","last_undegraded":"2024-05-12T11:09:23.765861+0000","last_fullsized":"2024-05-12T11:09:23.765861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:34:28.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919819+0000","last_change":"2024-05-12T11:06:05.166916+0000","last_active":"2024-05-12T11:09:23.919819+0000","last_peered":"2024-05-12T11:09:23.919819+0000","last_clean":"2024-05-12T11:09:23.919819+0000","last_became_active":"2024-05-12T11:06:05.165877+0000","last_became_peered":"2024-05-12T11:06:05.165877+0000","last_unstale":"2024-05-12T11:09:23.919819+0000","last_undegraded":"2024-05-12T11:09:23.919819+0000","last_fullsized":"2024-05-12T11:09:23.919819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:46:47.935159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'106","reported_seq":227,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:27.358500+0000","last_change":"2024-05-12T11:06:02.151339+0000","last_active":"2024-05-12T11:09:27.358500+0000","last_peered":"2024-05-12T11:09:27.358500+0000","last_clean":"2024-05-12T11:09:27.358500+0000","last_became_active":"2024-05-12T11:06:02.150968+0000","last_became_peered":"2024-05-12T11:06:02.150968+0000","last_unstale":"2024-05-12T11:09:27.358500+0000","last_undegraded":"2024-05-12T11:09:27.358500+0000","last_fullsized":"2024-05-12T11:09:27.358500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:22:39.625972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":194,"num_write_kb":1288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.766041+0000","last_change":"2024-05-12T11:06:05.165277+0000","last_active":"2024-05-12T11:09:23.766041+0000","last_peered":"2024-05-12T11:09:23.766041+0000","last_clean":"2024-05-12T11:09:23.766041+0000","last_became_active":"2024-05-12T11:06:05.164992+0000","last_became_peered":"2024-05-12T11:06:05.164992+0000","last_unstale":"2024-05-12T11:09:23.766041+0000","last_undegraded":"2024-05-12T11:09:23.766041+0000","last_fullsized":"2024-05-12T11:09:23.766041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T14:35:18.193170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671252+0000","last_change":"2024-05-12T11:06:02.151167+0000","last_active":"2024-05-12T11:09:23.671252+0000","last_peered":"2024-05-12T11:09:23.671252+0000","last_clean":"2024-05-12T11:09:23.671252+0000","last_became_active":"2024-05-12T11:06:02.150815+0000","last_became_peered":"2024-05-12T11:06:02.150815+0000","last_unstale":"2024-05-12T11:09:23.671252+0000","last_undegraded":"2024-05-12T11:09:23.671252+0000","last_fullsized":"2024-05-12T11:09:23.671252+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:16:50.811297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922434+0000","last_change":"2024-05-12T11:06:45.352790+0000","last_active":"2024-05-12T11:09:23.922434+0000","last_peered":"2024-05-12T11:09:23.922434+0000","last_clean":"2024-05-12T11:09:23.922434+0000","last_became_active":"2024-05-12T11:06:45.352409+0000","last_became_peered":"2024-05-12T11:06:45.352409+0000","last_unstale":"2024-05-12T11:09:23.922434+0000","last_undegraded":"2024-05-12T11:09:23.922434+0000","last_fullsized":"2024-05-12T11:09:23.922434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:07:16.535709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920508+0000","last_change":"2024-05-12T11:06:02.246676+0000","last_active":"2024-05-12T11:09:23.920508+0000","last_peered":"2024-05-12T11:09:23.920508+0000","last_clean":"2024-05-12T11:09:23.920508+0000","last_became_active":"2024-05-12T11:06:02.246344+0000","last_became_peered":"2024-05-12T11:06:02.246344+0000","last_unstale":"2024-05-12T11:09:23.920508+0000","last_undegraded":"2024-05-12T11:09:23.920508+0000","last_fullsized":"2024-05-12T11:09:23.920508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:57:17.805058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765550+0000","last_change":"2024-05-12T11:06:05.175597+0000","last_active":"2024-05-12T11:09:23.765550+0000","last_peered":"2024-05-12T11:09:23.765550+0000","last_clean":"2024-05-12T11:09:23.765550+0000","last_became_active":"2024-05-12T11:06:05.175237+0000","last_became_peered":"2024-05-12T11:06:05.175237+0000","last_unstale":"2024-05-12T11:09:23.765550+0000","last_undegraded":"2024-05-12T11:09:23.765550+0000","last_fullsized":"2024-05-12T11:09:23.765550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:50:12.872570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765526+0000","last_change":"2024-05-12T11:06:02.148706+0000","last_active":"2024-05-12T11:09:23.765526+0000","last_peered":"2024-05-12T11:09:23.765526+0000","last_clean":"2024-05-12T11:09:23.765526+0000","last_became_active":"2024-05-12T11:06:02.148437+0000","last_became_peered":"2024-05-12T11:06:02.148437+0000","last_unstale":"2024-05-12T11:09:23.765526+0000","last_undegraded":"2024-05-12T11:09:23.765526+0000","last_fullsized":"2024-05-12T11:09:23.765526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:54:39.969677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976534+0000","last_change":"2024-05-12T11:06:05.174248+0000","last_active":"2024-05-12T11:09:23.976534+0000","last_peered":"2024-05-12T11:09:23.976534+0000","last_clean":"2024-05-12T11:09:23.976534+0000","last_became_active":"2024-05-12T11:06:05.173934+0000","last_became_peered":"2024-05-12T11:06:05.173934+0000","last_unstale":"2024-05-12T11:09:23.976534+0000","last_undegraded":"2024-05-12T11:09:23.976534+0000","last_fullsized":"2024-05-12T11:09:23.976534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:04:58.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976644+0000","last_change":"2024-05-12T11:06:45.316406+0000","last_active":"2024-05-12T11:09:23.976644+0000","last_peered":"2024-05-12T11:09:23.976644+0000","last_clean":"2024-05-12T11:09:23.976644+0000","last_became_active":"2024-05-12T11:06:45.310351+0000","last_became_peered":"2024-05-12T11:06:45.310351+0000","last_unstale":"2024-05-12T11:09:23.976644+0000","last_undegraded":"2024-05-12T11:09:23.976644+0000","last_fullsized":"2024-05-12T11:09:23.976644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T21:30:11.687974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765821+0000","last_change":"2024-05-12T11:06:05.177548+0000","last_active":"2024-05-12T11:09:23.765821+0000","last_peered":"2024-05-12T11:09:23.765821+0000","last_clean":"2024-05-12T11:09:23.765821+0000","last_became_active":"2024-05-12T11:06:05.176871+0000","last_became_peered":"2024-05-12T11:06:05.176871+0000","last_unstale":"2024-05-12T11:09:23.765821+0000","last_undegraded":"2024-05-12T11:09:23.765821+0000","last_fullsized":"2024-05-12T11:09:23.765821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:38:08.347801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765672+0000","last_change":"2024-05-12T11:06:02.155096+0000","last_active":"2024-05-12T11:09:23.765672+0000","last_peered":"2024-05-12T11:09:23.765672+0000","last_clean":"2024-05-12T11:09:23.765672+0000","last_became_active":"2024-05-12T11:06:02.154721+0000","last_became_peered":"2024-05-12T11:06:02.154721+0000","last_unstale":"2024-05-12T11:09:23.765672+0000","last_undegraded":"2024-05-12T11:09:23.765672+0000","last_fullsized":"2024-05-12T11:09:23.765672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:49:01.407453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920661+0000","last_change":"2024-05-12T11:06:05.170305+0000","last_active":"2024-05-12T11:09:23.920661+0000","last_peered":"2024-05-12T11:09:23.920661+0000","last_clean":"2024-05-12T11:09:23.920661+0000","last_became_active":"2024-05-12T11:06:05.169970+0000","last_became_peered":"2024-05-12T11:06:05.169970+0000","last_unstale":"2024-05-12T11:09:23.920661+0000","last_undegraded":"2024-05-12T11:09:23.920661+0000","last_fullsized":"2024-05-12T11:09:23.920661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:48:11.680873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":225,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:28.493376+0000","last_change":"2024-05-12T11:06:02.246541+0000","last_active":"2024-05-12T11:09:28.493376+0000","last_peered":"2024-05-12T11:09:28.493376+0000","last_clean":"2024-05-12T11:09:28.493376+0000","last_became_active":"2024-05-12T11:06:02.246071+0000","last_became_peered":"2024-05-12T11:06:02.246071+0000","last_unstale":"2024-05-12T11:09:28.493376+0000","last_undegraded":"2024-05-12T11:09:28.493376+0000","last_fullsized":"2024-05-12T11:09:28.493376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:27:16.649146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1478,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920824+0000","last_change":"2024-05-12T11:06:05.170566+0000","last_active":"2024-05-12T11:09:23.920824+0000","last_peered":"2024-05-12T11:09:23.920824+0000","last_clean":"2024-05-12T11:09:23.920824+0000","last_became_active":"2024-05-12T11:06:05.170225+0000","last_became_peered":"2024-05-12T11:06:05.170225+0000","last_unstale":"2024-05-12T11:09:23.920824+0000","last_undegraded":"2024-05-12T11:09:23.920824+0000","last_fullsized":"2024-05-12T11:09:23.920824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:42.085004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'67","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:27.012789+0000","last_change":"2024-05-12T11:06:02.151920+0000","last_active":"2024-05-12T11:09:27.012789+0000","last_peered":"2024-05-12T11:09:27.012789+0000","last_clean":"2024-05-12T11:09:27.012789+0000","last_became_active":"2024-05-12T11:06:02.151551+0000","last_became_peered":"2024-05-12T11:06:02.151551+0000","last_unstale":"2024-05-12T11:09:27.012789+0000","last_undegraded":"2024-05-12T11:09:27.012789+0000","last_fullsized":"2024-05-12T11:09:27.012789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:11:10.230956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919985+0000","last_change":"2024-05-12T11:06:05.174964+0000","last_active":"2024-05-12T11:09:23.919985+0000","last_peered":"2024-05-12T11:09:23.919985+0000","last_clean":"2024-05-12T11:09:23.919985+0000","last_became_active":"2024-05-12T11:06:05.174562+0000","last_became_peered":"2024-05-12T11:06:05.174562+0000","last_unstale":"2024-05-12T11:09:23.919985+0000","last_undegraded":"2024-05-12T11:09:23.919985+0000","last_fullsized":"2024-05-12T11:09:23.919985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T16:37:22.252200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919578+0000","last_change":"2024-05-12T11:06:45.319312+0000","last_active":"2024-05-12T11:09:23.919578+0000","last_peered":"2024-05-12T11:09:23.919578+0000","last_clean":"2024-05-12T11:09:23.919578+0000","last_became_active":"2024-05-12T11:06:45.310683+0000","last_became_peered":"2024-05-12T11:06:45.310683+0000","last_unstale":"2024-05-12T11:09:23.919578+0000","last_undegraded":"2024-05-12T11:09:23.919578+0000","last_fullsized":"2024-05-12T11:09:23.919578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:01.124061+0000","last_clean_scrub_stamp":"2024-05-12T11:06:01.124061+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:24:21.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.921060+0000","last_change":"2024-05-12T11:06:05.176798+0000","last_active":"2024-05-12T11:09:23.921060+0000","last_peered":"2024-05-12T11:09:23.921060+0000","last_clean":"2024-05-12T11:09:23.921060+0000","last_became_active":"2024-05-12T11:06:05.176476+0000","last_became_peered":"2024-05-12T11:06:05.176476+0000","last_unstale":"2024-05-12T11:09:23.921060+0000","last_undegraded":"2024-05-12T11:09:23.921060+0000","last_fullsized":"2024-05-12T11:09:23.921060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:28:16.111038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976635+0000","last_change":"2024-05-12T11:06:05.180278+0000","last_active":"2024-05-12T11:09:23.976635+0000","last_peered":"2024-05-12T11:09:23.976635+0000","last_clean":"2024-05-12T11:09:23.976635+0000","last_became_active":"2024-05-12T11:06:05.179863+0000","last_became_peered":"2024-05-12T11:06:05.179863+0000","last_unstale":"2024-05-12T11:09:23.976635+0000","last_undegraded":"2024-05-12T11:09:23.976635+0000","last_fullsized":"2024-05-12T11:09:23.976635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:13:32.588753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671258+0000","last_change":"2024-05-12T11:06:45.499552+0000","last_active":"2024-05-12T11:09:23.671258+0000","last_peered":"2024-05-12T11:09:23.671258+0000","last_clean":"2024-05-12T11:09:23.671258+0000","last_became_active":"2024-05-12T11:06:45.499078+0000","last_became_peered":"2024-05-12T11:06:45.499078+0000","last_unstale":"2024-05-12T11:09:23.671258+0000","last_undegraded":"2024-05-12T11:09:23.671258+0000","last_fullsized":"2024-05-12T11:09:23.671258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:41:37.019535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671159+0000","last_change":"2024-05-12T11:06:05.172282+0000","last_active":"2024-05-12T11:09:23.671159+0000","last_peered":"2024-05-12T11:09:23.671159+0000","last_clean":"2024-05-12T11:09:23.671159+0000","last_became_active":"2024-05-12T11:06:05.171930+0000","last_became_peered":"2024-05-12T11:06:05.171930+0000","last_unstale":"2024-05-12T11:09:23.671159+0000","last_undegraded":"2024-05-12T11:09:23.671159+0000","last_fullsized":"2024-05-12T11:09:23.671159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T19:20:56.314181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.922703+0000","last_change":"2024-05-12T11:06:05.173726+0000","last_active":"2024-05-12T11:09:23.922703+0000","last_peered":"2024-05-12T11:09:23.922703+0000","last_clean":"2024-05-12T11:09:23.922703+0000","last_became_active":"2024-05-12T11:06:05.173195+0000","last_became_peered":"2024-05-12T11:06:05.173195+0000","last_unstale":"2024-05-12T11:09:23.922703+0000","last_undegraded":"2024-05-12T11:09:23.922703+0000","last_fullsized":"2024-05-12T11:09:23.922703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:40:19.397213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919890+0000","last_change":"2024-05-12T11:06:05.167841+0000","last_active":"2024-05-12T11:09:23.919890+0000","last_peered":"2024-05-12T11:09:23.919890+0000","last_clean":"2024-05-12T11:09:23.919890+0000","last_became_active":"2024-05-12T11:06:05.166577+0000","last_became_peered":"2024-05-12T11:06:05.166577+0000","last_unstale":"2024-05-12T11:09:23.919890+0000","last_undegraded":"2024-05-12T11:09:23.919890+0000","last_fullsized":"2024-05-12T11:09:23.919890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:57:01.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976819+0000","last_change":"2024-05-12T11:06:05.170753+0000","last_active":"2024-05-12T11:09:23.976819+0000","last_peered":"2024-05-12T11:09:23.976819+0000","last_clean":"2024-05-12T11:09:23.976819+0000","last_became_active":"2024-05-12T11:06:05.169410+0000","last_became_peered":"2024-05-12T11:06:05.169410+0000","last_unstale":"2024-05-12T11:09:23.976819+0000","last_undegraded":"2024-05-12T11:09:23.976819+0000","last_fullsized":"2024-05-12T11:09:23.976819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T11:42:30.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.671774+0000","last_change":"2024-05-12T11:06:05.170692+0000","last_active":"2024-05-12T11:09:23.671774+0000","last_peered":"2024-05-12T11:09:23.671774+0000","last_clean":"2024-05-12T11:09:23.671774+0000","last_became_active":"2024-05-12T11:06:05.170349+0000","last_became_peered":"2024-05-12T11:06:05.170349+0000","last_unstale":"2024-05-12T11:09:23.671774+0000","last_undegraded":"2024-05-12T11:09:23.671774+0000","last_fullsized":"2024-05-12T11:09:23.671774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T17:13:19.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765923+0000","last_change":"2024-05-12T11:06:05.173600+0000","last_active":"2024-05-12T11:09:23.765923+0000","last_peered":"2024-05-12T11:09:23.765923+0000","last_clean":"2024-05-12T11:09:23.765923+0000","last_became_active":"2024-05-12T11:06:05.173288+0000","last_became_peered":"2024-05-12T11:06:05.173288+0000","last_unstale":"2024-05-12T11:09:23.765923+0000","last_undegraded":"2024-05-12T11:09:23.765923+0000","last_fullsized":"2024-05-12T11:09:23.765923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:06:45.082031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.771886+0000","last_change":"2024-05-12T11:06:05.169864+0000","last_active":"2024-05-12T11:09:23.771886+0000","last_peered":"2024-05-12T11:09:23.771886+0000","last_clean":"2024-05-12T11:09:23.771886+0000","last_became_active":"2024-05-12T11:06:05.169521+0000","last_became_peered":"2024-05-12T11:06:05.169521+0000","last_unstale":"2024-05-12T11:09:23.771886+0000","last_undegraded":"2024-05-12T11:09:23.771886+0000","last_fullsized":"2024-05-12T11:09:23.771886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T12:46:11.825436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.765482+0000","last_change":"2024-05-12T11:06:05.176370+0000","last_active":"2024-05-12T11:09:23.765482+0000","last_peered":"2024-05-12T11:09:23.765482+0000","last_clean":"2024-05-12T11:09:23.765482+0000","last_became_active":"2024-05-12T11:06:05.176031+0000","last_became_peered":"2024-05-12T11:06:05.176031+0000","last_unstale":"2024-05-12T11:09:23.765482+0000","last_undegraded":"2024-05-12T11:09:23.765482+0000","last_fullsized":"2024-05-12T11:09:23.765482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T13:32:52.893909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.920674+0000","last_change":"2024-05-12T11:06:05.170708+0000","last_active":"2024-05-12T11:09:23.920674+0000","last_peered":"2024-05-12T11:09:23.920674+0000","last_clean":"2024-05-12T11:09:23.920674+0000","last_became_active":"2024-05-12T11:06:05.169591+0000","last_became_peered":"2024-05-12T11:06:05.169591+0000","last_unstale":"2024-05-12T11:09:23.920674+0000","last_undegraded":"2024-05-12T11:09:23.920674+0000","last_fullsized":"2024-05-12T11:09:23.920674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:18:08.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.919879+0000","last_change":"2024-05-12T11:06:05.172614+0000","last_active":"2024-05-12T11:09:23.919879+0000","last_peered":"2024-05-12T11:09:23.919879+0000","last_clean":"2024-05-12T11:09:23.919879+0000","last_became_active":"2024-05-12T11:06:05.172290+0000","last_became_peered":"2024-05-12T11:06:05.172290+0000","last_unstale":"2024-05-12T11:09:23.919879+0000","last_undegraded":"2024-05-12T11:09:23.919879+0000","last_fullsized":"2024-05-12T11:09:23.919879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T15:59:32.169139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-12T11:09:23.976714+0000","last_change":"2024-05-12T11:06:05.171333+0000","last_active":"2024-05-12T11:09:23.976714+0000","last_peered":"2024-05-12T11:09:23.976714+0000","last_clean":"2024-05-12T11:09:23.976714+0000","last_became_active":"2024-05-12T11:06:05.170035+0000","last_became_peered":"2024-05-12T11:06:05.170035+0000","last_unstale":"2024-05-12T11:09:23.976714+0000","last_undegraded":"2024-05-12T11:09:23.976714+0000","last_fullsized":"2024-05-12T11:09:23.976714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T11:06:04.142630+0000","last_clean_scrub_stamp":"2024-05-12T11:06:04.142630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:43:18.852851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107193,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":800664,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2264,"num_read_kb":1352,"num_write":511,"num_write_kb":2387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":811008,"data_stored":2401992,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645368,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":443342,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841597,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1429974,"data_compressed":59550,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005123,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":835598,"data_compressed":27906,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201352,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":835394,"data_compressed":27906,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397581,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":1036983,"data_compressed":44348,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561106,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":913408,"data_stored":442881,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":983040,"data_stored":511664,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738480,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":443746,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":512221,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149792,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":1163372,"data_compressed":43108,"data_compressed_allocated":57344,"data_compressed_original":724992,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953564,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":921600,"data_stored":442463,"data_compressed":8617,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757335,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":1363720,"data_compressed":59550,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35731,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":721878,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":331975,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":394134,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":400749,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T11:09:36.041 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:09:36.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:35 smithi172 ceph-mon[34517]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:36.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:35 smithi176 ceph-mon[34357]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:36.283 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:36.406 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:35 smithi086 ceph-mon[30110]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-12T11:09:37.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:36 smithi172 ceph-mon[34517]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-05-12T11:09:37.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:36 smithi176 ceph-mon[34357]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-05-12T11:09:37.426 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:36 smithi086 ceph-mon[30110]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-05-12T11:09:37.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 -- 172.21.15.86:0/1853948286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974101da0 msgr2=0x7fa974102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:37.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 --2- 172.21.15.86:0/1853948286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974101da0 0x7fa974102180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa9680099c0 tx=0x7fa968009cd0 comp rx=0 tx=0).stop 2024-05-12T11:09:37.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 -- 172.21.15.86:0/1853948286 shutdown_connections 2024-05-12T11:09:37.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 --2- 172.21.15.86:0/1853948286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa974106e80 0x7fa97410ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:37.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 --2- 172.21.15.86:0/1853948286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974101da0 0x7fa974102180 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:37.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 --2- 172.21.15.86:0/1853948286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa974102750 0x7fa9741067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:37.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 -- 172.21.15.86:0/1853948286 >> 172.21.15.86:0/1853948286 conn(0x7fa9740789a0 msgr2=0x7fa9740ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:37.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 -- 172.21.15.86:0/1853948286 shutdown_connections 2024-05-12T11:09:37.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.975+0000 7fa978f51700 1 -- 172.21.15.86:0/1853948286 wait complete. 2024-05-12T11:09:37.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.976+0000 7fa978f51700 1 Processor -- start 2024-05-12T11:09:37.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.976+0000 7fa978f51700 1 -- start start 2024-05-12T11:09:37.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa978f51700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa974101da0 0x7fa97419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:37.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa978f51700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa974102750 0x7fa97419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:37.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa978f51700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974106e80 0x7fa974199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:37.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa978f51700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa974111d20 con 0x7fa974106e80 2024-05-12T11:09:37.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa978f51700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa974111ba0 con 0x7fa974102750 2024-05-12T11:09:37.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa978f51700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa974111ea0 con 0x7fa974101da0 2024-05-12T11:09:37.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa972d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974106e80 0x7fa974199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:37.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa97259c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa974101da0 0x7fa97419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:37.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa971d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa974102750 0x7fa97419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa97259c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa974101da0 0x7fa97419f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.86:33752/0 (socket says 172.21.15.86:33752) 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa971d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa974102750 0x7fa97419fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.86:38096/0 (socket says 172.21.15.86:38096) 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa97259c700 1 -- 172.21.15.86:0/376908541 learned_addr learned my addr 172.21.15.86:0/376908541 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa972d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974106e80 0x7fa974199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35822/0 (socket says 172.21.15.86:35822) 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa972d9d700 1 -- 172.21.15.86:0/376908541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa974101da0 msgr2=0x7fa97419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa972d9d700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa974101da0 0x7fa97419f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa972d9d700 1 -- 172.21.15.86:0/376908541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa974102750 msgr2=0x7fa97419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa972d9d700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa974102750 0x7fa97419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.977+0000 7fa972d9d700 1 -- 172.21.15.86:0/376908541 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97419a090 con 0x7fa974106e80 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.978+0000 7fa972d9d700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974106e80 0x7fa974199930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00cba0 tx=0x7fa96c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.978+0000 7fa9637fe700 1 -- 172.21.15.86:0/376908541 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c016020 con 0x7fa974106e80 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.978+0000 7fa9637fe700 1 -- 172.21.15.86:0/376908541 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa96c012420 con 0x7fa974106e80 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.978+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97419a380 con 0x7fa974106e80 2024-05-12T11:09:37.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.978+0000 7fa9637fe700 1 -- 172.21.15.86:0/376908541 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0115c0 con 0x7fa974106e80 2024-05-12T11:09:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.978+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9741a6640 con 0x7fa974106e80 2024-05-12T11:09:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.979+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97406a190 con 0x7fa974106e80 2024-05-12T11:09:37.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.980+0000 7fa9637fe700 1 -- 172.21.15.86:0/376908541 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fa96c019020 con 0x7fa974106e80 2024-05-12T11:09:37.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.981+0000 7fa9637fe700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa95c0b2b10 0x7fa95c0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:37.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.981+0000 7fa97259c700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa95c0b2b10 0x7fa95c0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:37.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.981+0000 7fa9637fe700 1 -- 172.21.15.86:0/376908541 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa96c0e28f0 con 0x7fa974106e80 2024-05-12T11:09:37.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.982+0000 7fa97259c700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa95c0b2b10 0x7fa95c0b4fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa968003800 tx=0x7fa968005fb0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:37.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:37.985+0000 7fa9637fe700 1 -- 172.21.15.86:0/376908541 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa96c020020 con 0x7fa974106e80 2024-05-12T11:09:38.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.236+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9741a68d0 con 0x7fa974106e80 2024-05-12T11:09:38.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.237+0000 7fa9637fe700 1 -- 172.21.15.86:0/376908541 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7fa96c0a5030 con 0x7fa974106e80 2024-05-12T11:09:38.227 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:09:38.228 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:09:38.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa95c0b2b10 msgr2=0x7fa95c0b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:38.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa95c0b2b10 0x7fa95c0b4fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa968003800 tx=0x7fa968005fb0 comp rx=0 tx=0).stop 2024-05-12T11:09:38.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974106e80 msgr2=0x7fa974199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:38.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974106e80 0x7fa974199930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00cba0 tx=0x7fa96c00ceb0 comp rx=0 tx=0).stop 2024-05-12T11:09:38.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 shutdown_connections 2024-05-12T11:09:38.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa95c0b2b10 0x7fa95c0b4fd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:38.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa974106e80 0x7fa974199930 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:38.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa974101da0 0x7fa97419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:38.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 --2- 172.21.15.86:0/376908541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa974102750 0x7fa97419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:38.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 >> 172.21.15.86:0/376908541 conn(0x7fa9740789a0 msgr2=0x7fa9740fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:38.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 shutdown_connections 2024-05-12T11:09:38.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:38.239+0000 7fa978f51700 1 -- 172.21.15.86:0/376908541 wait complete. 2024-05-12T11:09:38.231 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:09:38.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:09:39.129 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:39.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:38 smithi086 ceph-mon[30110]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-05-12T11:09:39.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:38 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/376908541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:39.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:38 smithi172 ceph-mon[34517]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-05-12T11:09:39.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:38 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/376908541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:39.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:38 smithi176 ceph-mon[34357]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-05-12T11:09:39.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:38 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/376908541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 -- 172.21.15.86:0/2802851050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941022a0 msgr2=0x7fe99410e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 --2- 172.21.15.86:0/2802851050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941022a0 0x7fe99410e760 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009cd0 tx=0x7fe98c02a8e0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 -- 172.21.15.86:0/2802851050 shutdown_connections 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 --2- 172.21.15.86:0/2802851050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941022a0 0x7fe99410e760 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 --2- 172.21.15.86:0/2802851050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9941018e0 0x7fe994101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 --2- 172.21.15.86:0/2802851050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9941078a0 0x7fe994107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 -- 172.21.15.86:0/2802851050 >> 172.21.15.86:0/2802851050 conn(0x7fe994078a30 msgr2=0x7fe994078e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 -- 172.21.15.86:0/2802851050 shutdown_connections 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 -- 172.21.15.86:0/2802851050 wait complete. 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 Processor -- start 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 -- start start 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9941018e0 0x7fe994197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9941022a0 0x7fe9941984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941078a0 0x7fe99419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe994111b60 con 0x7fe9941078a0 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.577+0000 7fe99adf0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941119e0 con 0x7fe9941022a0 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99adf0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe994111ce0 con 0x7fe9941018e0 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941078a0 0x7fe99419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941078a0 0x7fe99419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35844/0 (socket says 172.21.15.86:35844) 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 -- 172.21.15.86:0/3077604390 learned_addr learned my addr 172.21.15.86:0/3077604390 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe993fff640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9941022a0 0x7fe9941984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe998b8c640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9941018e0 0x7fe994197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 -- 172.21.15.86:0/3077604390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9941018e0 msgr2=0x7fe994197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9941018e0 0x7fe994197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 -- 172.21.15.86:0/3077604390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9941022a0 msgr2=0x7fe9941984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9941022a0 0x7fe9941984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 -- 172.21.15.86:0/3077604390 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99419cf50 con 0x7fe9941078a0 2024-05-12T11:09:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe998b8c640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9941018e0 0x7fe994197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe993fff640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9941022a0 0x7fe9941984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99938d640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941078a0 0x7fe99419c820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe98c005cc0 tx=0x7fe98c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe991ffb640 1 -- 172.21.15.86:0/3077604390 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c004450 con 0x7fe9941078a0 2024-05-12T11:09:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe991ffb640 1 -- 172.21.15.86:0/3077604390 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98c031c90 con 0x7fe9941078a0 2024-05-12T11:09:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe99adf0640 1 -- 172.21.15.86:0/3077604390 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99419d1e0 con 0x7fe9941078a0 2024-05-12T11:09:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.578+0000 7fe991ffb640 1 -- 172.21.15.86:0/3077604390 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c03b400 con 0x7fe9941078a0 2024-05-12T11:09:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.579+0000 7fe99adf0640 1 -- 172.21.15.86:0/3077604390 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9941a4ad0 con 0x7fe9941078a0 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.581+0000 7fe991ffb640 1 -- 172.21.15.86:0/3077604390 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fe98c004680 con 0x7fe9941078a0 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.581+0000 7fe99dbe6740 1 Processor -- start 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.581+0000 7fe99dbe6740 1 -- start start 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64ed120 0x55e4a64ed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a64f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e4a64505d0 con 0x55e4a64f8300 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e4a6409890 con 0x55e4a64ed120 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e4a644c590 con 0x55e4a64eda40 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe998b8c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a64f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe998b8c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a64f7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.86:33772/0 (socket says 172.21.15.86:33772) 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe998b8c640 1 -- 172.21.15.86:0/3852974541 learned_addr learned my addr 172.21.15.86:0/3852974541 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe993fff640 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe993fff640 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64ed120 0x55e4a64ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe991ffb640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe9840b2bb0 0x7fe9840b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe998b8c640 1 -- 172.21.15.86:0/3852974541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64ed120 msgr2=0x55e4a64ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe998b8c640 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64ed120 0x55e4a64ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe998b8c640 1 -- 172.21.15.86:0/3852974541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 msgr2=0x55e4a64fa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe998b8c640 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64fa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.582+0000 7fe998b8c640 1 -- 172.21.15.86:0/3852974541 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4a6162210 con 0x55e4a64eda40 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.583+0000 7fe99938d640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe9840b2bb0 0x7fe9840b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.583+0000 7fe991ffb640 1 -- 172.21.15.86:0/3077604390 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe98c02e030 con 0x7fe9941078a0 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.583+0000 7fe998b8c640 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a64f7dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe988009bc0 tx=0x7fe98800e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdefe0a4c74e80c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.583+0000 7fe97effd640 1 -- 172.21.15.86:0/3852974541 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988016070 con 0x55e4a64eda40 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.583+0000 7fe97effd640 1 -- 172.21.15.86:0/3852974541 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9880054d0 con 0x55e4a64eda40 2024-05-12T11:09:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.583+0000 7fe97effd640 1 -- 172.21.15.86:0/3852974541 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988011470 con 0x55e4a64eda40 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 -- 172.21.15.86:0/3852974541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 msgr2=0x55e4a64f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99938d640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe9840b2bb0 0x7fe9840b5070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe98c1010c0 tx=0x7fe98c0045f0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a64f7dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe988009bc0 tx=0x7fe98800e6c0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 -- 172.21.15.86:0/3852974541 shutdown_connections 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a64f7dc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/3852974541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64ed120 0x55e4a64ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 -- 172.21.15.86:0/3852974541 >> 172.21.15.86:0/3852974541 conn(0x55e4a64e9630 msgr2=0x55e4a64e9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 -- 172.21.15.86:0/3852974541 shutdown_connections 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 -- 172.21.15.86:0/3852974541 wait complete. 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 -- start start 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.584+0000 7fe99dbe6740 1 Processor -- start 2024-05-12T11:09:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 0x55e4a64f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64f8300 0x55e4a6506080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e4a64e7110 con 0x55e4a64ed120 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e4a640d370 con 0x55e4a64eda40 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e4a64e7290 con 0x55e4a64f8300 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe99dbe6740 10 client.0 _ll_register_callbacks cb 0x55e4a6161a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35862/0 (socket says 172.21.15.86:35862) 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 -- 172.21.15.86:0/273772873 learned_addr learned my addr 172.21.15.86:0/273772873 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe998b8c640 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 0x55e4a64f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64f8300 0x55e4a6506080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 -- 172.21.15.86:0/273772873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64f8300 msgr2=0x55e4a6506080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64f8300 0x55e4a6506080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 -- 172.21.15.86:0/273772873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 msgr2=0x55e4a64f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 0x55e4a64f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 -- 172.21.15.86:0/273772873 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4a622e620 con 0x55e4a64ed120 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe993fff640 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f38e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe980013e10 tx=0x7fe980004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1672ce673cf5f3b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe973fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe973fff640 1 -- 172.21.15.86:0/273772873 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980013110 con 0x55e4a64ed120 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe973fff640 1 -- 172.21.15.86:0/273772873 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe9800132b0 con 0x55e4a64ed120 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe99dbe6740 1 -- 172.21.15.86:0/273772873 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9880054d0 con 0x55e4a64ed120 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.585+0000 7fe973fff640 1 -- 172.21.15.86:0/273772873 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe980027050 con 0x55e4a64ed120 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe99dbe6740 10 client.15351 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe99dbe6740 1 -- 172.21.15.86:0/273772873 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e4a6509060 con 0x55e4a64ed120 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe973fff640 1 -- 172.21.15.86:0/273772873 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9880054d0 con 0x55e4a64ed120 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe973fff640 1 -- 172.21.15.86:0/273772873 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe98000e500 con 0x55e4a64ed120 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe99dbe6740 10 client.15351 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe99dbe6740 10 client.15351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe99dbe6740 20 client.15351 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e4a650a520 0x55e4a650c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe99dbe6740 4 client.15351 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe99dbe6740 1 -- 172.21.15.86:0/273772873 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4a645e1e0 con 0x55e4a650a520 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.586+0000 7fe998b8c640 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e4a650a520 0x55e4a650c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.587+0000 7fe998b8c640 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e4a650a520 0x55e4a650c910 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83c1e1664c9f65b server_cookie=19a5e67a4ee5aadf in_seq=0 out_seq=0 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.587+0000 7fe973fff640 10 client.15351 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.587+0000 7fe973fff640 1 -- 172.21.15.86:0/273772873 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e4a645e1e0 con 0x55e4a650a520 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.587+0000 7fe973fff640 10 client.15351 handle_command_reply: tid=0 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.587+0000 7fe99dbe6740 1 client.15351 shutdown 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 -- 172.21.15.86:0/273772873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 msgr2=0x55e4a64f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f38e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe980013e10 tx=0x7fe980004730 comp rx=0 tx=0).stop 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 -- 172.21.15.86:0/273772873 shutdown_connections 2024-05-12T11:09:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e4a650a520 0x55e4a650c910 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64f8300 0x55e4a6506080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe973fff640 0 client.15351 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 0x55e4a64f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/273772873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f38e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 -- 172.21.15.86:0/273772873 >> 172.21.15.86:0/273772873 conn(0x55e4a64e9630 msgr2=0x55e4a64e6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 -- 172.21.15.86:0/273772873 shutdown_connections 2024-05-12T11:09:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 1 -- 172.21.15.86:0/273772873 wait complete. 2024-05-12T11:09:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.588+0000 7fe99dbe6740 20 client.15351 trim_cache size 0 max 16384 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe99dbe6740 1 Processor -- start 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe99dbe6740 1 -- start start 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a6512200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64f8300 0x55e4a6512740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ac300 con 0x55e4a64ed120 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ade40 con 0x55e4a64f8300 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ac9d0 con 0x55e4a64eda40 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe993fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.604+0000 7fe993fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35870/0 (socket says 172.21.15.86:35870) 2024-05-12T11:09:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe993fff640 1 -- 172.21.15.86:0/2482103672 learned_addr learned my addr 172.21.15.86:0/2482103672 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe998b8c640 1 --2- 172.21.15.86:0/2482103672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a6512200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe993fff640 1 -- 172.21.15.86:0/2482103672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 msgr2=0x55e4a6512200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe993fff640 1 --2- 172.21.15.86:0/2482103672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a6512200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe993fff640 1 -- 172.21.15.86:0/2482103672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64f8300 msgr2=0x55e4a6512740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe993fff640 1 --2- 172.21.15.86:0/2482103672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64f8300 0x55e4a6512740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe993fff640 1 -- 172.21.15.86:0/2482103672 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4a64ee180 con 0x55e4a64ed120 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe993fff640 1 --2- 172.21.15.86:0/2482103672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f3dc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe98000cff0 tx=0x7fe980004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dad9155a58cce05 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe97e7fc640 1 -- 172.21.15.86:0/2482103672 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98002f070 con 0x55e4a64ed120 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe97e7fc640 1 -- 172.21.15.86:0/2482103672 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98000c3d0 con 0x55e4a64ed120 2024-05-12T11:09:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.605+0000 7fe97e7fc640 1 -- 172.21.15.86:0/2482103672 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98000ede0 con 0x55e4a64ed120 2024-05-12T11:09:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2482103672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 msgr2=0x55e4a64f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2482103672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f3dc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe98000cff0 tx=0x7fe980004680 comp rx=0 tx=0).stop 2024-05-12T11:09:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2482103672 shutdown_connections 2024-05-12T11:09:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2482103672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64f8300 0x55e4a6512740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2482103672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64eda40 0x55e4a6512200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2482103672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64ed120 0x55e4a64f3dc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2482103672 >> 172.21.15.86:0/2482103672 conn(0x55e4a64e9630 msgr2=0x55e4a64f36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2482103672 shutdown_connections 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2482103672 wait complete. 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 -- start start 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.606+0000 7fe99dbe6740 1 Processor -- start 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64ed120 0x55e4a64e8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 0x55e4a64e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe99dbe6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ad770 con 0x55e4a64f8300 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ad0a0 con 0x55e4a64eda40 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe99dbe6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941aa2e0 con 0x55e4a64ed120 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe99dbe6740 10 client.0 _ll_register_callbacks cb 0x7fe98000c8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64e7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35886/0 (socket says 172.21.15.86:35886) 2024-05-12T11:09:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 -- 172.21.15.86:0/2655377548 learned_addr learned my addr 172.21.15.86:0/2655377548 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe998b8c640 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 0x55e4a64e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 -- 172.21.15.86:0/2655377548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64ed120 msgr2=0x55e4a64e8b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64ed120 0x55e4a64e8b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 -- 172.21.15.86:0/2655377548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 msgr2=0x55e4a64e74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 0x55e4a64e74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 -- 172.21.15.86:0/2655377548 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4a64e7f50 con 0x55e4a64f8300 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe993fff640 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64e7a10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe980000c00 tx=0x7fe980013a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ce524b8fc11146 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe973fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe973fff640 1 -- 172.21.15.86:0/2655377548 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98002f040 con 0x55e4a64f8300 2024-05-12T11:09:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe973fff640 1 -- 172.21.15.86:0/2655377548 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe98000ed60 con 0x55e4a64f8300 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.607+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2655377548 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe98000c3d0 con 0x55e4a64f8300 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe973fff640 1 -- 172.21.15.86:0/2655377548 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe98000e3e0 con 0x55e4a64f8300 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe99dbe6740 10 client.15357 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2655377548 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e4a6505cc0 con 0x55e4a64f8300 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe973fff640 1 -- 172.21.15.86:0/2655377548 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98000c3d0 con 0x55e4a64f8300 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe973fff640 1 -- 172.21.15.86:0/2655377548 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe9800047c0 con 0x55e4a64f8300 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe99dbe6740 10 client.15357 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe99dbe6740 10 client.15357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe99dbe6740 20 client.15357 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e4a6575150 0x55e4a6577570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe99dbe6740 4 client.15357 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2655377548 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e4a6458050 con 0x55e4a6575150 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.608+0000 7fe998b8c640 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e4a6575150 0x55e4a6577570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.609+0000 7fe998b8c640 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e4a6575150 0x55e4a6577570 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34aeabde9c714327 server_cookie=69c93cee0e5b1b8d in_seq=0 out_seq=0 2024-05-12T11:09:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.609+0000 7fe973fff640 10 client.15357 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe973fff640 1 -- 172.21.15.86:0/2655377548 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e4a6458050 con 0x55e4a6575150 2024-05-12T11:09:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe973fff640 10 client.15357 handle_command_reply: tid=0 2024-05-12T11:09:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 client.15357 shutdown 2024-05-12T11:09:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2655377548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 msgr2=0x55e4a64e7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64e7a10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe980000c00 tx=0x7fe980013a00 comp rx=0 tx=0).stop 2024-05-12T11:09:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2655377548 shutdown_connections 2024-05-12T11:09:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e4a6575150 0x55e4a6577570 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a64f8300 0x55e4a64e7a10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4a64eda40 0x55e4a64e74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe973fff640 0 client.15357 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 --2- 172.21.15.86:0/2655377548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e4a64ed120 0x55e4a64e8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.627+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2655377548 >> 172.21.15.86:0/2655377548 conn(0x55e4a64e9630 msgr2=0x55e4a64eead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.643+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2655377548 shutdown_connections 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.643+0000 7fe99dbe6740 1 -- 172.21.15.86:0/2655377548 wait complete. 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.643+0000 7fe99dbe6740 20 client.15357 trim_cache size 0 max 16384 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:09:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:09:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 -- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe9840b2bb0 msgr2=0x7fe9840b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe9840b2bb0 0x7fe9840b5070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe98c1010c0 tx=0x7fe98c0045f0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 -- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941078a0 msgr2=0x7fe99419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941078a0 0x7fe99419c820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe98c005cc0 tx=0x7fe98c003c20 comp rx=0 tx=0).stop 2024-05-12T11:09:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 -- 172.21.15.86:0/3077604390 shutdown_connections 2024-05-12T11:09:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe9840b2bb0 0x7fe9840b5070 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9941078a0 0x7fe99419c820 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9941022a0 0x7fe9941984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 --2- 172.21.15.86:0/3077604390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9941018e0 0x7fe994197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 -- 172.21.15.86:0/3077604390 >> 172.21.15.86:0/3077604390 conn(0x7fe994078a30 msgr2=0x7fe994103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 -- 172.21.15.86:0/3077604390 shutdown_connections 2024-05-12T11:09:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:40.644+0000 7fe99adf0640 1 -- 172.21.15.86:0/3077604390 wait complete. 2024-05-12T11:09:40.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 -- 172.21.15.86:0/3843427410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 msgr2=0x7f80c01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 --2- 172.21.15.86:0/3843427410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 0x7f80c01087e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f80b000b0a0 tx=0x7f80b000b3b0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 -- 172.21.15.86:0/3843427410 shutdown_connections 2024-05-12T11:09:40.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 --2- 172.21.15.86:0/3843427410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80c0102d50 0x7f80c010f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 --2- 172.21.15.86:0/3843427410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 0x7f80c01087e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 --2- 172.21.15.86:0/3843427410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c0102390 0x7f80c0102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 -- 172.21.15.86:0/3843427410 >> 172.21.15.86:0/3843427410 conn(0x7f80c0079310 msgr2=0x7f80c0079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:40.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 -- 172.21.15.86:0/3843427410 shutdown_connections 2024-05-12T11:09:40.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.937+0000 7f80c7778700 1 -- 172.21.15.86:0/3843427410 wait complete. 2024-05-12T11:09:40.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c7778700 1 Processor -- start 2024-05-12T11:09:40.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c7778700 1 -- start start 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c7778700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c0102390 0x7f80c019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c7778700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80c0102d50 0x7f80c019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c7778700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 0x7f80c01999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c7778700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f80c01125a0 con 0x7f80c0108400 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c7778700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0112420 con 0x7f80c0102d50 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c7778700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0112720 con 0x7f80c0102390 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5d15700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 0x7f80c01999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5d15700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 0x7f80c01999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35902/0 (socket says 172.21.15.86:35902) 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5d15700 1 -- 172.21.15.86:0/428328724 learned_addr learned my addr 172.21.15.86:0/428328724 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c4d13700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80c0102d50 0x7f80c019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5514700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c0102390 0x7f80c019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5d15700 1 -- 172.21.15.86:0/428328724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c0102390 msgr2=0x7f80c019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5d15700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c0102390 0x7f80c019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5d15700 1 -- 172.21.15.86:0/428328724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80c0102d50 msgr2=0x7f80c019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5d15700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80c0102d50 0x7f80c019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5d15700 1 -- 172.21.15.86:0/428328724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c019a140 con 0x7f80c0108400 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.938+0000 7f80c5514700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c0102390 0x7f80c019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.939+0000 7f80c5d15700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 0x7f80c01999e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f80b800c970 tx=0x7f80b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.939+0000 7f80be7fc700 1 -- 172.21.15.86:0/428328724 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b800ce60 con 0x7f80c0108400 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.939+0000 7f80be7fc700 1 -- 172.21.15.86:0/428328724 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80b8004830 con 0x7f80c0108400 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.939+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c019a430 con 0x7f80c0108400 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.939+0000 7f80be7fc700 1 -- 172.21.15.86:0/428328724 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b80054c0 con 0x7f80c0108400 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.939+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c0103fa0 con 0x7f80c0108400 2024-05-12T11:09:40.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.940+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c006a190 con 0x7f80c0108400 2024-05-12T11:09:40.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.941+0000 7f80be7fc700 1 -- 172.21.15.86:0/428328724 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f80b80049e0 con 0x7f80c0108400 2024-05-12T11:09:40.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.942+0000 7f80be7fc700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f80a80b2b10 0x7f80a80b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:40.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.942+0000 7f80c5514700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f80a80b2b10 0x7f80a80b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:40.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.942+0000 7f80be7fc700 1 -- 172.21.15.86:0/428328724 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f80b80e2850 con 0x7f80c0108400 2024-05-12T11:09:40.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.942+0000 7f80c5514700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f80a80b2b10 0x7f80a80b4fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80b00062a0 tx=0x7f80b0006230 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:40.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:40.946+0000 7f80be7fc700 1 -- 172.21.15.86:0/428328724 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f80b8014030 con 0x7f80c0108400 2024-05-12T11:09:41.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.196+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80c0104260 con 0x7f80c0108400 2024-05-12T11:09:41.187 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:40 smithi086 ceph-mon[30110]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-12T11:09:41.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.197+0000 7f80be7fc700 1 -- 172.21.15.86:0/428328724 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7f80b80a9fe0 con 0x7f80c0108400 2024-05-12T11:09:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:09:41.188 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:09:41.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f80a80b2b10 msgr2=0x7f80a80b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:41.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f80a80b2b10 0x7f80a80b4fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80b00062a0 tx=0x7f80b0006230 comp rx=0 tx=0).stop 2024-05-12T11:09:41.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 msgr2=0x7f80c01999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:41.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 0x7f80c01999e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f80b800c970 tx=0x7f80b800cc80 comp rx=0 tx=0).stop 2024-05-12T11:09:41.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 shutdown_connections 2024-05-12T11:09:41.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f80a80b2b10 0x7f80a80b4fd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:41.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80c0108400 0x7f80c01999e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:41.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c0102390 0x7f80c019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:41.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 --2- 172.21.15.86:0/428328724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80c0102d50 0x7f80c019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:41.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 >> 172.21.15.86:0/428328724 conn(0x7f80c0079310 msgr2=0x7f80c006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:41.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 shutdown_connections 2024-05-12T11:09:41.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:41.199+0000 7f80c7778700 1 -- 172.21.15.86:0/428328724 wait complete. 2024-05-12T11:09:41.191 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:09:41.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:40 smithi172 ceph-mon[34517]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-12T11:09:41.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:40 smithi176 ceph-mon[34357]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-12T11:09:41.884 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:09:42.127 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:42.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:41 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/428328724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:42.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:41 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/428328724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:42.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:41 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/428328724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:43.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:42 smithi086 ceph-mon[30110]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 KiB/s wr, 23 op/s 2024-05-12T11:09:43.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:42 smithi176 ceph-mon[34357]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 KiB/s wr, 23 op/s 2024-05-12T11:09:43.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:42 smithi172 ceph-mon[34517]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 KiB/s wr, 23 op/s 2024-05-12T11:09:43.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.811+0000 7f4e72cd0700 1 -- 172.21.15.86:0/2205211394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c103040 msgr2=0x7f4e6c107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:43.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.811+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/2205211394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c103040 0x7f4e6c107000 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4e580099c0 tx=0x7f4e58009cd0 comp rx=0 tx=0).stop 2024-05-12T11:09:43.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.811+0000 7f4e72cd0700 1 -- 172.21.15.86:0/2205211394 shutdown_connections 2024-05-12T11:09:43.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.811+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/2205211394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c1076e0 0x7f4e6c10f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:43.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.811+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/2205211394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e6c102690 0x7f4e6c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.811+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/2205211394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c103040 0x7f4e6c107000 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.811+0000 7f4e72cd0700 1 -- 172.21.15.86:0/2205211394 >> 172.21.15.86:0/2205211394 conn(0x7f4e6c0783f0 msgr2=0x7f4e6c078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 -- 172.21.15.86:0/2205211394 shutdown_connections 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 -- 172.21.15.86:0/2205211394 wait complete. 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 Processor -- start 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 -- start start 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e6c102690 0x7f4e6c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c103040 0x7f4e6c19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c1076e0 0x7f4e6c1a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c1125d0 con 0x7f4e6c1076e0 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c112450 con 0x7f4e6c103040 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e72cd0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c112750 con 0x7f4e6c102690 2024-05-12T11:09:43.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.812+0000 7f4e7126d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c1076e0 0x7f4e6c1a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e7126d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c1076e0 0x7f4e6c1a5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59752/0 (socket says 172.21.15.86:59752) 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e70a6c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e6c102690 0x7f4e6c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e7126d700 1 -- 172.21.15.86:0/677477719 learned_addr learned my addr 172.21.15.86:0/677477719 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e6bfff700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c103040 0x7f4e6c19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e7126d700 1 -- 172.21.15.86:0/677477719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e6c102690 msgr2=0x7f4e6c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e7126d700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e6c102690 0x7f4e6c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e7126d700 1 -- 172.21.15.86:0/677477719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c103040 msgr2=0x7f4e6c19b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e7126d700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c103040 0x7f4e6c19b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e7126d700 1 -- 172.21.15.86:0/677477719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c1a60b0 con 0x7f4e6c1076e0 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e7126d700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c1076e0 0x7f4e6c1a5b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400b970 tx=0x7f4e6400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e69ffb700 1 -- 172.21.15.86:0/677477719 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400d860 con 0x7f4e6c1076e0 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e69ffb700 1 -- 172.21.15.86:0/677477719 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e6400e430 con 0x7f4e6c1076e0 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c1a62e0 con 0x7f4e6c1076e0 2024-05-12T11:09:43.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e69ffb700 1 -- 172.21.15.86:0/677477719 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64017660 con 0x7f4e6c1076e0 2024-05-12T11:09:43.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.813+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c1a67a0 con 0x7f4e6c1076e0 2024-05-12T11:09:43.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.814+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6c06a190 con 0x7f4e6c1076e0 2024-05-12T11:09:43.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.816+0000 7f4e69ffb700 1 -- 172.21.15.86:0/677477719 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f4e6400da00 con 0x7f4e6c1076e0 2024-05-12T11:09:43.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.816+0000 7f4e69ffb700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4e5c0b2b10 0x7f4e5c0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:43.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.817+0000 7f4e70a6c700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4e5c0b2b10 0x7f4e5c0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:43.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.817+0000 7f4e69ffb700 1 -- 172.21.15.86:0/677477719 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4e640e2690 con 0x7f4e6c1076e0 2024-05-12T11:09:43.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.817+0000 7f4e70a6c700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4e5c0b2b10 0x7f4e5c0b4fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005950 tx=0x7f4e6000a300 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:43.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:43.820+0000 7f4e69ffb700 1 -- 172.21.15.86:0/677477719 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4e64053df0 con 0x7f4e6c1076e0 2024-05-12T11:09:44.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.027+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e6c02e510 con 0x7f4e6c1076e0 2024-05-12T11:09:44.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.028+0000 7f4e69ffb700 1 -- 172.21.15.86:0/677477719 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23122 (secure 0 0 0) 0x7f4e64013030 con 0x7f4e6c1076e0 2024-05-12T11:09:44.019 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:09:44.020 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":83,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:09:23.662865+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/155657181":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/2138389102":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/2852030835":"2024-05-13T11:09:23.662823+0000","172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3505671883":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/155657181":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/4229502845":"2024-05-13T11:09:23.662823+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4e5c0b2b10 msgr2=0x7f4e5c0b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4e5c0b2b10 0x7f4e5c0b4fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005950 tx=0x7f4e6000a300 comp rx=0 tx=0).stop 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c1076e0 msgr2=0x7f4e6c1a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c1076e0 0x7f4e6c1a5b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400b970 tx=0x7f4e6400bc80 comp rx=0 tx=0).stop 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 shutdown_connections 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4e5c0b2b10 0x7f4e5c0b4fd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6c1076e0 0x7f4e6c1a5b70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e6c102690 0x7f4e6c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 --2- 172.21.15.86:0/677477719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c103040 0x7f4e6c19b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 >> 172.21.15.86:0/677477719 conn(0x7f4e6c0783f0 msgr2=0x7f4e6c100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 shutdown_connections 2024-05-12T11:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:44.031+0000 7f4e72cd0700 1 -- 172.21.15.86:0/677477719 wait complete. 2024-05-12T11:09:44.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-05-12T11:09:44.951 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:45.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:44 smithi176 ceph-mon[34357]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-12T11:09:45.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:44 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/677477719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:09:45.316 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:44 smithi086 ceph-mon[30110]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-12T11:09:45.316 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:44 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/677477719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:09:45.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:44 smithi172 ceph-mon[34517]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-12T11:09:45.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:44 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/677477719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:09:47.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:46 smithi176 ceph-mon[34357]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-05-12T11:09:47.279 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:46 smithi086 ceph-mon[30110]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-05-12T11:09:47.308 INFO:teuthology.orchestra.run.smithi086.stdout:{"run_dir":"/var/run/ceph"} 2024-05-12T11:09:47.308 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-12T11:09:47.308 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7749 2024-05-12T11:09:47.309 DEBUG:tasks.quiescer:Yielding 2024-05-12T11:09:47.309 INFO:teuthology.run_tasks:Running task workunit... 2024-05-12T11:09:47.323 INFO:tasks.workunit:Pulling workunits from ref f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T11:09:47.324 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-12T11:09:47.324 INFO:tasks.workunit:timeout=3h 2024-05-12T11:09:47.324 INFO:tasks.workunit:cleanup=True 2024-05-12T11:09:47.324 DEBUG:teuthology.orchestra.run.smithi086:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-12T11:09:47.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 72h/114d Inode: 1099511628283 Links: 2 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-05-12 11:06:38.351072676 +0000 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-05-12 11:06:38.351072676 +0000 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-05-12 11:09:20.667595466 +0000 2024-05-12T11:09:47.342 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-05-12 11:06:38.351072676 +0000 2024-05-12T11:09:47.343 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-12T11:09:47.343 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-12T11:09:47.418 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f1ec882358465db8f363a3865fa83f099183688a 2024-05-12T11:09:47.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:46 smithi172 ceph-mon[34517]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-05-12T11:09:47.474 INFO:tasks.workunit.client.0.smithi086.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-12T11:09:47.576 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.213+0000 7fa708e45700 1 -- 172.21.15.86:0/4180477728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103f20 msgr2=0x7fa704110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.213+0000 7fa708e45700 1 --2- 172.21.15.86:0/4180477728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103f20 0x7fa704110310 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0099c0 tx=0x7fa6fc009cd0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.213+0000 7fa708e45700 1 -- 172.21.15.86:0/4180477728 shutdown_connections 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.213+0000 7fa708e45700 1 --2- 172.21.15.86:0/4180477728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103f20 0x7fa704110310 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.213+0000 7fa708e45700 1 --2- 172.21.15.86:0/4180477728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa704109540 0x7fa704109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.213+0000 7fa708e45700 1 --2- 172.21.15.86:0/4180477728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa704103560 0x7fa7041039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.213+0000 7fa708e45700 1 -- 172.21.15.86:0/4180477728 >> 172.21.15.86:0/4180477728 conn(0x7fa70407a660 msgr2=0x7fa70407aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.214+0000 7fa708e45700 1 -- 172.21.15.86:0/4180477728 shutdown_connections 2024-05-12T11:09:49.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.214+0000 7fa708e45700 1 -- 172.21.15.86:0/4180477728 wait complete. 2024-05-12T11:09:49.207 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:49 smithi086 ceph-mon[30110]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-12T11:09:49.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.214+0000 7fa708e45700 1 Processor -- start 2024-05-12T11:09:49.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.214+0000 7fa708e45700 1 -- start start 2024-05-12T11:09:49.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa708e45700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103560 0x7fa7040757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:49.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa708e45700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa704103f20 0x7fa704075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:49.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa708e45700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa704109540 0x7fa704076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:49.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa708e45700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa7041136c0 con 0x7fa704103560 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa708e45700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa704113540 con 0x7fa704109540 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa708e45700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa704113840 con 0x7fa704103f20 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103560 0x7fa7040757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103560 0x7fa7040757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59766/0 (socket says 172.21.15.86:59766) 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 -- 172.21.15.86:0/655762531 learned_addr learned my addr 172.21.15.86:0/655762531 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa701d9b700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa704103f20 0x7fa704075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa702d9d700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa704109540 0x7fa704076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 -- 172.21.15.86:0/655762531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa704103f20 msgr2=0x7fa704075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa704103f20 0x7fa704075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 -- 172.21.15.86:0/655762531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa704109540 msgr2=0x7fa704076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa704109540 0x7fa704076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 -- 172.21.15.86:0/655762531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7041a80c0 con 0x7fa704103560 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa70259c700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103560 0x7fa7040757a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4007f10 tx=0x7fa6f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa6fb7fe700 1 -- 172.21.15.86:0/655762531 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4004bb0 con 0x7fa704103560 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7041a83b0 con 0x7fa704103560 2024-05-12T11:09:49.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa6fb7fe700 1 -- 172.21.15.86:0/655762531 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6f4004d50 con 0x7fa704103560 2024-05-12T11:09:49.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.215+0000 7fa6fb7fe700 1 -- 172.21.15.86:0/655762531 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40059b0 con 0x7fa704103560 2024-05-12T11:09:49.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.216+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7041a88f0 con 0x7fa704103560 2024-05-12T11:09:49.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.217+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa70410b9d0 con 0x7fa704103560 2024-05-12T11:09:49.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.218+0000 7fa6fb7fe700 1 -- 172.21.15.86:0/655762531 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fa6f401a020 con 0x7fa704103560 2024-05-12T11:09:49.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.219+0000 7fa6fb7fe700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6f00b2b10 0x7fa6f00b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:49.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.219+0000 7fa701d9b700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6f00b2b10 0x7fa6f00b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:49.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.219+0000 7fa6fb7fe700 1 -- 172.21.15.86:0/655762531 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa6f40e2670 con 0x7fa704103560 2024-05-12T11:09:49.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.219+0000 7fa701d9b700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6f00b2b10 0x7fa6f00b4fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa70407ad20 tx=0x7fa6ec009190 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:49.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.222+0000 7fa6fb7fe700 1 -- 172.21.15.86:0/655762531 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa6f4010070 con 0x7fa704103560 2024-05-12T11:09:49.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:49 smithi176 ceph-mon[34357]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-12T11:09:49.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.472+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa704104bb0 con 0x7fa704103560 2024-05-12T11:09:49.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.473+0000 7fa6fb7fe700 1 -- 172.21.15.86:0/655762531 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7fa6f40a3e20 con 0x7fa704103560 2024-05-12T11:09:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:09:49.465 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:09:49.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6f00b2b10 msgr2=0x7fa6f00b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:49.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6f00b2b10 0x7fa6f00b4fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa70407ad20 tx=0x7fa6ec009190 comp rx=0 tx=0).stop 2024-05-12T11:09:49.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103560 msgr2=0x7fa7040757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:49.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103560 0x7fa7040757a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4007f10 tx=0x7fa6f400d3b0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 shutdown_connections 2024-05-12T11:09:49.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa704109540 0x7fa704076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6f00b2b10 0x7fa6f00b4fd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa704103560 0x7fa7040757a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 --2- 172.21.15.86:0/655762531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa704103f20 0x7fa704075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:49.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 >> 172.21.15.86:0/655762531 conn(0x7fa70407a660 msgr2=0x7fa704102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:49.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 shutdown_connections 2024-05-12T11:09:49.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:49.475+0000 7fa708e45700 1 -- 172.21.15.86:0/655762531 wait complete. 2024-05-12T11:09:49.468 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:09:49.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:49 smithi172 ceph-mon[34517]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-12T11:09:50.081 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:50 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/655762531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:50.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-12T11:06:07.078153+0000', 'modified': '2024-05-12T11:09:21.361894+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24466, 'mds_1': 24443, 'mds_2': 24442, 'mds_3': 24436, 'mds_4': 24422}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6839/2477289859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6838', 'nonce': 2477289859}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 2477289859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6841/637755871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6840', 'nonce': 637755871}, {'type': 'v1', 'addr': '172.21.15.86:6841', 'nonce': 637755871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24383': {'gid': 24383, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/3992302401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3992302401}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 3992302401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.176:6833/868497491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 868497491}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 868497491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24398': {'gid': 24398, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/3404000495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3404000495}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3404000495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.172:6837/2564045723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2564045723}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2564045723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.176:6835/197047059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 197047059}, {'type': 'v1', 'addr': '172.21.15.176:6835', 'nonce': 197047059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.176:6837/2905239515', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 2905239515}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 2905239515}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.172:6839/2644756211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 2644756211}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 2644756211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.176:6839/410261641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6838', 'nonce': 410261641}, {'type': 'v1', 'addr': '172.21.15.176:6839', 'nonce': 410261641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24466, 'qdb_cluster': [24466, 24442, 24443, 24422, 24436]} 2024-05-12T11:09:50.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-12T11:09:50.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-12T11:09:50.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:50 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/655762531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:50.392 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:50.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:50 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/655762531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:09:51.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:51 smithi086 ceph-mon[30110]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-12T11:09:51.266 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:51 smithi176 ceph-mon[34357]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-12T11:09:51.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:51 smithi172 ceph-mon[34517]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-12T11:09:52.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.038+0000 7f50cf34f700 1 -- 172.21.15.86:0/3864585228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 msgr2=0x7f50c8102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.038+0000 7f50cf34f700 1 --2- 172.21.15.86:0/3864585228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 0x7f50c8102a70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f50c40099c0 tx=0x7f50c4009cd0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.038+0000 7f50cf34f700 1 -- 172.21.15.86:0/3864585228 shutdown_connections 2024-05-12T11:09:52.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.038+0000 7f50cf34f700 1 --2- 172.21.15.86:0/3864585228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50c81076e0 0x7f50c810f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.038+0000 7f50cf34f700 1 --2- 172.21.15.86:0/3864585228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 0x7f50c8102a70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.038+0000 7f50cf34f700 1 --2- 172.21.15.86:0/3864585228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c8103040 0x7f50c8107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.038+0000 7f50cf34f700 1 -- 172.21.15.86:0/3864585228 >> 172.21.15.86:0/3864585228 conn(0x7f50c80783f0 msgr2=0x7f50c8078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:52.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.039+0000 7f50cf34f700 1 -- 172.21.15.86:0/3864585228 shutdown_connections 2024-05-12T11:09:52.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.039+0000 7f50cf34f700 1 -- 172.21.15.86:0/3864585228 wait complete. 2024-05-12T11:09:52.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.039+0000 7f50cf34f700 1 Processor -- start 2024-05-12T11:09:52.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.039+0000 7f50cf34f700 1 -- start start 2024-05-12T11:09:52.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cf34f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 0x7f50c819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cf34f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c8103040 0x7f50c819b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cf34f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50c81076e0 0x7f50c81a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cf34f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8112610 con 0x7f50c8102690 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cf34f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8112490 con 0x7f50c81076e0 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cf34f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8112790 con 0x7f50c8103040 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 0x7f50c819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 0x7f50c819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50308/0 (socket says 172.21.15.86:50308) 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 -- 172.21.15.86:0/2857623546 learned_addr learned my addr 172.21.15.86:0/2857623546 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c8103040 0x7f50c819b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50c81076e0 0x7f50c81a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 -- 172.21.15.86:0/2857623546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c8103040 msgr2=0x7f50c819b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c8103040 0x7f50c819b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 -- 172.21.15.86:0/2857623546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50c81076e0 msgr2=0x7f50c81a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50c81076e0 0x7f50c81a5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 -- 172.21.15.86:0/2857623546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c81a60d0 con 0x7f50c8102690 2024-05-12T11:09:52.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c8103040 0x7f50c819b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:52.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 0x7f50c819ab10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f50c400b580 tx=0x7f50c40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:52.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.040+0000 7f50be7fc700 1 -- 172.21.15.86:0/2857623546 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4027070 con 0x7f50c8102690 2024-05-12T11:09:52.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.041+0000 7f50cf34f700 1 -- 172.21.15.86:0/2857623546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c81a62a0 con 0x7f50c8102690 2024-05-12T11:09:52.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.041+0000 7f50be7fc700 1 -- 172.21.15.86:0/2857623546 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c4004020 con 0x7f50c8102690 2024-05-12T11:09:52.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.041+0000 7f50be7fc700 1 -- 172.21.15.86:0/2857623546 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4022e30 con 0x7f50c8102690 2024-05-12T11:09:52.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.041+0000 7f50cf34f700 1 -- 172.21.15.86:0/2857623546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c81a6750 con 0x7f50c8102690 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.043+0000 7f50be7fc700 1 -- 172.21.15.86:0/2857623546 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f50c4022590 con 0x7f50c8102690 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.043+0000 7f50be7fc700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f50b40b2b90 0x7f50b40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f50b40b2b90 0x7f50b40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50be7fc700 1 -- 172.21.15.86:0/2857623546 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f50c40e3550 con 0x7f50c8102690 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f50b40b2b90 0x7f50b40b5050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50b8005fd0 tx=0x7f50b8005ee0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50d9be2b80 1 Processor -- start 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50d9be2b80 1 -- start start 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fe160 0x5622af9fe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 0x5622af9f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.044+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5622af94a8f0 con 0x5622af9fe160 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5622af8afd50 con 0x5622af9f8d00 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5622af9468b0 con 0x5622af9fea80 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fe160 0x5622af9fe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fe160 0x5622af9fe540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50310/0 (socket says 172.21.15.86:50310) 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 -- 172.21.15.86:0/715286512 learned_addr learned my addr 172.21.15.86:0/715286512 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 0x5622af9f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 -- 172.21.15.86:0/715286512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 msgr2=0x5622af9f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 0x5622af9f87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 -- 172.21.15.86:0/715286512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 msgr2=0x5622af9f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 -- 172.21.15.86:0/715286512 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622af897880 con 0x5622af9fe160 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fe160 0x5622af9fe540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f50c40a78e0 tx=0x7f50c4009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3330807e1dc6563a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50b37fe700 1 -- 172.21.15.86:0/715286512 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c40aa670 con 0x5622af9fe160 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50b37fe700 1 -- 172.21.15.86:0/715286512 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c40aea20 con 0x5622af9fe160 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.045+0000 7f50b37fe700 1 -- 172.21.15.86:0/715286512 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c40afbb0 con 0x5622af9fe160 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 -- 172.21.15.86:0/715286512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fe160 msgr2=0x5622af9fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fe160 0x5622af9fe540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f50c40a78e0 tx=0x7f50c4009640 comp rx=0 tx=0).stop 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 -- 172.21.15.86:0/715286512 shutdown_connections 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fe160 0x5622af9fe540 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/715286512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 0x5622af9f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 -- 172.21.15.86:0/715286512 >> 172.21.15.86:0/715286512 conn(0x5622af924b20 msgr2=0x5622af9f3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 -- 172.21.15.86:0/715286512 shutdown_connections 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 -- 172.21.15.86:0/715286512 wait complete. 2024-05-12T11:09:52.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 -- start start 2024-05-12T11:09:52.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.046+0000 7f50d9be2b80 1 Processor -- start 2024-05-12T11:09:52.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622afa04680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa01a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa01f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5622af94a8f0 con 0x5622af9fea80 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5622af903e80 con 0x5622af9f8d00 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5622afa095d0 con 0x5622af9fe160 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50d9be2b80 10 client.0 _ll_register_callbacks cb 0x5622af8de560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa01f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa01f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50324/0 (socket says 172.21.15.86:50324) 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 -- 172.21.15.86:0/2254563538 learned_addr learned my addr 172.21.15.86:0/2254563538 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622afa04680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa01a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 -- 172.21.15.86:0/2254563538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 msgr2=0x5622afa01a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa01a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 -- 172.21.15.86:0/2254563538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 msgr2=0x5622afa04680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622afa04680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 -- 172.21.15.86:0/2254563538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622af901710 con 0x5622af9fea80 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.047+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa01f60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f50c000d8a0 tx=0x7f50c000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29d5edd090c3d78 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2254563538 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0011810 con 0x5622af9fea80 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2254563538 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f50c00119b0 con 0x5622af9fea80 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2254563538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50c40aea20 con 0x5622af9fea80 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2254563538 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f50c0011bb0 con 0x5622af9fea80 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 10 client.15387 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2254563538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5622afa13c60 con 0x5622af9fea80 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2254563538 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c40aea20 con 0x5622af9fea80 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2254563538 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f50c00213b0 con 0x5622af9fea80 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 10 client.15387 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 10 client.15387 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-12T11:09:52.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 20 client.15387 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x5622afa16270 0x5622afa176e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 4 client.15387 mds_command: new command op to 24422 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.048+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2254563538 --> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622af9582d0 con 0x5622afa16270 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.049+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x5622afa16270 0x5622afa176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.049+0000 7f50b0ff9700 10 client.15387 ms_handle_connect on v2:172.21.15.172:6836/2564045723 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.049+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x5622afa16270 0x5622afa176e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bd7fe312b82d2c10 server_cookie=538974027c1a2c82 in_seq=0 out_seq=0 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2254563538 <== mds.4 v2:172.21.15.172:6836/2564045723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5622af9582d0 con 0x5622afa16270 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50b0ff9700 10 client.15387 handle_command_reply: tid=0 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 client.15387 shutdown 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2254563538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 msgr2=0x5622afa01f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa01f60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f50c000d8a0 tx=0x7f50c000dbb0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2254563538 shutdown_connections 2024-05-12T11:09:52.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x5622afa16270 0x5622afa176e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa01f60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622afa04680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50b0ff9700 0 client.15387 ms_handle_reset on v2:172.21.15.172:6836/2564045723 2024-05-12T11:09:52.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2254563538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa01a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2254563538 >> 172.21.15.86:0/2254563538 conn(0x5622af924b20 msgr2=0x5622af9edae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:52.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2254563538 shutdown_connections 2024-05-12T11:09:52.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2254563538 wait complete. 2024-05-12T11:09:52.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.050+0000 7f50d9be2b80 20 client.15387 trim_cache size 0 max 16384 2024-05-12T11:09:52.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.071+0000 7f50d9be2b80 1 Processor -- start 2024-05-12T11:09:52.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.071+0000 7f50d9be2b80 1 -- start start 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa00350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa00890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5622afa15a20 con 0x5622af9fea80 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5622afa160f0 con 0x5622af9f8d00 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5622afa167c0 con 0x5622af9fe160 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa00890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa00890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50338/0 (socket says 172.21.15.86:50338) 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 -- 172.21.15.86:0/2106886643 learned_addr learned my addr 172.21.15.86:0/2106886643 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa00350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 -- 172.21.15.86:0/2106886643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 msgr2=0x5622afa00350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:52.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa00350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 -- 172.21.15.86:0/2106886643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 msgr2=0x5622af9edbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:52.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9edbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 -- 172.21.15.86:0/2106886643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622af9efc30 con 0x5622af9fea80 2024-05-12T11:09:52.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa00350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:52.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.072+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa00890 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f50c0021940 tx=0x7f50c0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beac9166ec4c8d8c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50b2ffd700 1 -- 172.21.15.86:0/2106886643 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0030020 con 0x5622af9fea80 2024-05-12T11:09:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50b2ffd700 1 -- 172.21.15.86:0/2106886643 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c000c040 con 0x5622af9fea80 2024-05-12T11:09:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50b2ffd700 1 -- 172.21.15.86:0/2106886643 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0026040 con 0x5622af9fea80 2024-05-12T11:09:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2106886643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 msgr2=0x5622afa00890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa00890 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f50c0021940 tx=0x7f50c0007f30 comp rx=0 tx=0).stop 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2106886643 shutdown_connections 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9fea80 0x5622afa00890 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9f8d00 0x5622af9edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2106886643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fe160 0x5622afa00350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2106886643 >> 172.21.15.86:0/2106886643 conn(0x5622af924b20 msgr2=0x5622afa019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2106886643 shutdown_connections 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.073+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2106886643 wait complete. 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 1 -- start start 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 1 Processor -- start 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9f8d00 0x5622afa20b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9fe160 0x5622afa210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 0x5622afa1bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5622afa17560 con 0x5622af9f8d00 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5622afa16e90 con 0x5622af9fe160 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5622afa17c30 con 0x5622af9fea80 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50d9be2b80 10 client.0 _ll_register_callbacks cb 0x5622af8de560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50cd0eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9f8d00 0x5622afa20b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.074+0000 7f50cd0eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9f8d00 0x5622afa20b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50354/0 (socket says 172.21.15.86:50354) 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cd0eb700 1 -- 172.21.15.86:0/2435144316 learned_addr learned my addr 172.21.15.86:0/2435144316 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9fe160 0x5622afa210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cd8ec700 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 0x5622afa1bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cd0eb700 1 -- 172.21.15.86:0/2435144316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 msgr2=0x5622afa1bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 0x5622afa1bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cd0eb700 1 -- 172.21.15.86:0/2435144316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9fe160 msgr2=0x5622afa210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9fe160 0x5622afa210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cd0eb700 1 -- 172.21.15.86:0/2435144316 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622af9f4cb0 con 0x5622af9f8d00 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50cd0eb700 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9f8d00 0x5622afa20b60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f50c4000c00 tx=0x7f50c4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621721fab114aec5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2435144316 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c40c3070 con 0x5622af9f8d00 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2435144316 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f50c40b31c0 con 0x5622af9f8d00 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2435144316 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50c000c040 con 0x5622af9f8d00 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2435144316 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f50c40aea20 con 0x5622af9f8d00 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50d9be2b80 10 client.15393 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.075+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2435144316 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5622afa81ed0 con 0x5622af9f8d00 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2435144316 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c000c040 con 0x5622af9f8d00 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2435144316 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f50c40afbb0 con 0x5622af9f8d00 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50d9be2b80 10 client.15393 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50d9be2b80 10 client.15393 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50d9be2b80 20 client.15393 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x5622afa86950 0x5622afa85660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50d9be2b80 4 client.15393 mds_command: new command op to 24422 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2435144316 --> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] -- command(tid 0: {"prefix": "status"}) -- 0x5622af952370 con 0x5622afa86950 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.076+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x5622afa86950 0x5622afa85660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50b0ff9700 10 client.15393 ms_handle_connect on v2:172.21.15.172:6836/2564045723 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50cc8ea700 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x5622afa86950 0x5622afa85660 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=347f84efede3f686 server_cookie=47ccd42411c50ea7 in_seq=0 out_seq=0 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50b0ff9700 1 -- 172.21.15.86:0/2435144316 <== mds.4 v2:172.21.15.172:6836/2564045723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5622af952370 con 0x5622afa86950 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50b0ff9700 10 client.15393 handle_command_reply: tid=0 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 client.15393 shutdown 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2435144316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9f8d00 msgr2=0x5622afa20b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9f8d00 0x5622afa20b60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f50c4000c00 tx=0x7f50c4009cd0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2435144316 shutdown_connections 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5622af9fea80 0x5622afa1bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.172:6836/2564045723,v1:172.21.15.172:6837/2564045723] conn(0x5622afa86950 0x5622afa85660 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622af9f8d00 0x5622afa20b60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 --2- 172.21.15.86:0/2435144316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622af9fe160 0x5622afa210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50b0ff9700 0 client.15393 ms_handle_reset on v2:172.21.15.172:6836/2564045723 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.077+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2435144316 >> 172.21.15.86:0/2435144316 conn(0x5622af924b20 msgr2=0x5622afa019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2435144316 shutdown_connections 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50d9be2b80 1 -- 172.21.15.86:0/2435144316 wait complete. 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50d9be2b80 20 client.15393 trim_cache size 0 max 16384 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 4, 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24422, 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:52.075 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:52.076 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:52.076 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 209.83795208999999, 2024-05-12T11:09:52.076 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 29, 2024-05-12T11:09:52.076 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 83, 2024-05-12T11:09:52.076 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 82, 2024-05-12T11:09:52.076 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 255.318797741 2024-05-12T11:09:52.076 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 -- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f50b40b2b90 msgr2=0x7f50b40b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f50b40b2b90 0x7f50b40b5050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50b8005fd0 tx=0x7f50b8005ee0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 -- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 msgr2=0x7f50c819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 0x7f50c819ab10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f50c400b580 tx=0x7f50c40047b0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 -- 172.21.15.86:0/2857623546 shutdown_connections 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50c81076e0 0x7f50c81a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f50b40b2b90 0x7f50b40b5050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c8102690 0x7f50c819ab10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 --2- 172.21.15.86:0/2857623546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c8103040 0x7f50c819b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 -- 172.21.15.86:0/2857623546 >> 172.21.15.86:0/2857623546 conn(0x7f50c80783f0 msgr2=0x7f50c8101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 -- 172.21.15.86:0/2857623546 shutdown_connections 2024-05-12T11:09:52.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:52.078+0000 7f50cf34f700 1 -- 172.21.15.86:0/2857623546 wait complete. 2024-05-12T11:09:52.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.f status 2024-05-12T11:09:53.018 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:53.332 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:53 smithi086 ceph-mon[30110]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-05-12T11:09:53.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:53 smithi172 ceph-mon[34517]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-05-12T11:09:53.519 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:53 smithi176 ceph-mon[34357]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-05-12T11:09:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 -- 172.21.15.86:0/2807068209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4104560 msgr2=0x7f72a410ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/2807068209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4104560 0x7f72a410ca40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7298009900 tx=0x7f729802a510 comp rx=0 tx=0).stop 2024-05-12T11:09:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 -- 172.21.15.86:0/2807068209 shutdown_connections 2024-05-12T11:09:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/2807068209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a410cf80 0x7f72a410f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/2807068209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4104560 0x7f72a410ca40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/2807068209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a4103c40 0x7f72a4104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 -- 172.21.15.86:0/2807068209 >> 172.21.15.86:0/2807068209 conn(0x7f72a4078a30 msgr2=0x7f72a4078e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:53.726 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 -- 172.21.15.86:0/2807068209 shutdown_connections 2024-05-12T11:09:53.726 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 -- 172.21.15.86:0/2807068209 wait complete. 2024-05-12T11:09:53.726 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.733+0000 7f72a9d5f640 1 Processor -- start 2024-05-12T11:09:53.726 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a9d5f640 1 -- start start 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a9d5f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4103c40 0x7f72a4199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a9d5f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a4104560 0x7f72a4199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a9d5f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a410cf80 0x7f72a419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a9d5f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4112c30 con 0x7f72a4103c40 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a9d5f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4112ab0 con 0x7f72a4104560 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a9d5f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4112db0 con 0x7f72a410cf80 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4103c40 0x7f72a4199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4103c40 0x7f72a4199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50378/0 (socket says 172.21.15.86:50378) 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 -- 172.21.15.86:0/944972903 learned_addr learned my addr 172.21.15.86:0/944972903 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 -- 172.21.15.86:0/944972903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a410cf80 msgr2=0x7f72a419d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a410cf80 0x7f72a419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 -- 172.21.15.86:0/944972903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a4104560 msgr2=0x7f72a4199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a4104560 0x7f72a4199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 -- 172.21.15.86:0/944972903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a419e120 con 0x7f72a4103c40 2024-05-12T11:09:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.734+0000 7f72a37fe640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4103c40 0x7f72a4199130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f729400c890 tx=0x7f729400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.735+0000 7f72a0ff9640 1 -- 172.21.15.86:0/944972903 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294004220 con 0x7f72a4103c40 2024-05-12T11:09:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.735+0000 7f72a0ff9640 1 -- 172.21.15.86:0/944972903 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72940043c0 con 0x7f72a4103c40 2024-05-12T11:09:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.735+0000 7f72a9d5f640 1 -- 172.21.15.86:0/944972903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a419e410 con 0x7f72a4103c40 2024-05-12T11:09:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.735+0000 7f72a0ff9640 1 -- 172.21.15.86:0/944972903 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294004a00 con 0x7f72a4103c40 2024-05-12T11:09:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.735+0000 7f72a9d5f640 1 -- 172.21.15.86:0/944972903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a41a5ca0 con 0x7f72a4103c40 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72aca76740 1 Processor -- start 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72aca76740 1 -- start start 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72a0ff9640 1 -- 172.21.15.86:0/944972903 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f72940079b0 con 0x7f72a4103c40 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72aca76740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72aca76740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 0x561ce38e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72aca76740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38e1500 0x561ce38e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72aca76740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561ce38375d0 con 0x561ce38d1e10 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72aca76740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561ce37f0890 con 0x561ce38d2730 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.737+0000 7f72aca76740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561ce3833590 con 0x561ce38e1500 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38d21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50388/0 (socket says 172.21.15.86:50388) 2024-05-12T11:09:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 -- 172.21.15.86:0/2536724120 learned_addr learned my addr 172.21.15.86:0/2536724120 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a37fe640 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 0x561ce38e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a2ffd640 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38e1500 0x561ce38e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 -- 172.21.15.86:0/2536724120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38e1500 msgr2=0x561ce38e38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38e1500 0x561ce38e38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 -- 172.21.15.86:0/2536724120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 msgr2=0x561ce38e0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 0x561ce38e0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 -- 172.21.15.86:0/2536724120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce3549210 con 0x561ce38d1e10 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a3fff640 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38d21f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f729c009d10 tx=0x7f729c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38a0a168913335b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a0ff9640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f728c0b2b30 0x7f728c0b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f7289ffb640 1 -- 172.21.15.86:0/2536724120 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c016070 con 0x561ce38d1e10 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a37fe640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f728c0b2b30 0x7f728c0b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f7289ffb640 1 -- 172.21.15.86:0/2536724120 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f729c005020 con 0x561ce38d1e10 2024-05-12T11:09:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f7289ffb640 1 -- 172.21.15.86:0/2536724120 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c0116d0 con 0x561ce38d1e10 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.738+0000 7f72a0ff9640 1 -- 172.21.15.86:0/944972903 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f72940e2720 con 0x7f72a4103c40 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 -- 172.21.15.86:0/2536724120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 msgr2=0x561ce38d21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72a37fe640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f728c0b2b30 0x7f728c0b4ff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72940dfd50 tx=0x7f7294000bc0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38d21f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f729c009d10 tx=0x7f729c00e6c0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 -- 172.21.15.86:0/2536724120 shutdown_connections 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38e1500 0x561ce38e38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 0x561ce38e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 --2- 172.21.15.86:0/2536724120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38d21f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 -- 172.21.15.86:0/2536724120 >> 172.21.15.86:0/2536724120 conn(0x561ce38ce420 msgr2=0x561ce38ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 -- 172.21.15.86:0/2536724120 shutdown_connections 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 -- 172.21.15.86:0/2536724120 wait complete. 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.739+0000 7f72aca76740 1 -- start start 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72aca76740 1 Processor -- start 2024-05-12T11:09:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72aca76740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d1e10 0x561ce38de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72aca76740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 0x561ce38de920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72aca76740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38e1500 0x561ce38dee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72aca76740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561ce38e4130 con 0x561ce38e1500 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72aca76740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561ce37f4370 con 0x561ce38d2730 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72aca76740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561ce38e42b0 con 0x561ce38d1e10 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72aca76740 10 client.0 _ll_register_callbacks cb 0x561ce3548a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38e1500 0x561ce38dee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38e1500 0x561ce38dee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50394/0 (socket says 172.21.15.86:50394) 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 -- 172.21.15.86:0/3216302332 learned_addr learned my addr 172.21.15.86:0/3216302332 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a2ffd640 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 0x561ce38de920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d1e10 0x561ce38de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 -- 172.21.15.86:0/3216302332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d1e10 msgr2=0x561ce38de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d1e10 0x561ce38de3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 -- 172.21.15.86:0/3216302332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 msgr2=0x561ce38de920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 0x561ce38de920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 -- 172.21.15.86:0/3216302332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce3615620 con 0x561ce38e1500 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f72a3fff640 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38e1500 0x561ce38dee60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f729c009a00 tx=0x7f729c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e776887a93dcf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.740+0000 7f7282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f7282ffd640 1 -- 172.21.15.86:0/3216302332 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c01e070 con 0x561ce38e1500 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f7282ffd640 1 -- 172.21.15.86:0/3216302332 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f729c003970 con 0x561ce38e1500 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 1 -- 172.21.15.86:0/3216302332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f729c005020 con 0x561ce38e1500 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f7282ffd640 1 -- 172.21.15.86:0/3216302332 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f729c030050 con 0x561ce38e1500 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 10 client.15405 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 1 -- 172.21.15.86:0/3216302332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ce38effa0 con 0x561ce38e1500 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f7282ffd640 1 -- 172.21.15.86:0/3216302332 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f729c005020 con 0x561ce38e1500 2024-05-12T11:09:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f7282ffd640 1 -- 172.21.15.86:0/3216302332 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f729c00f040 con 0x561ce38e1500 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 10 client.15405 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 20 client.15405 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561ce38f1350 0x561ce38f3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 4 client.15405 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72aca76740 1 -- 172.21.15.86:0/3216302332 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ce38451e0 con 0x561ce38f1350 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.741+0000 7f72a2ffd640 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561ce38f1350 0x561ce38f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.742+0000 7f72a2ffd640 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561ce38f1350 0x561ce38f3740 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abf8852f62008bd2 server_cookie=57255cb0cf3cbe27 in_seq=0 out_seq=0 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.742+0000 7f7282ffd640 10 client.15405 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f7282ffd640 1 -- 172.21.15.86:0/3216302332 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561ce38451e0 con 0x561ce38f1350 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f7282ffd640 10 client.15405 handle_command_reply: tid=0 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 client.15405 shutdown 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 -- 172.21.15.86:0/3216302332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38e1500 msgr2=0x561ce38dee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38e1500 0x561ce38dee60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f729c009a00 tx=0x7f729c009240 comp rx=0 tx=0).stop 2024-05-12T11:09:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 -- 172.21.15.86:0/3216302332 shutdown_connections 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561ce38f1350 0x561ce38f3740 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38e1500 0x561ce38dee60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38d2730 0x561ce38de920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f7282ffd640 0 client.15405 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 --2- 172.21.15.86:0/3216302332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d1e10 0x561ce38de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 -- 172.21.15.86:0/3216302332 >> 172.21.15.86:0/3216302332 conn(0x561ce38ce420 msgr2=0x561ce38d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 -- 172.21.15.86:0/3216302332 shutdown_connections 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 1 -- 172.21.15.86:0/3216302332 wait complete. 2024-05-12T11:09:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.743+0000 7f72aca76740 20 client.15405 trim_cache size 0 max 16384 2024-05-12T11:09:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72aca76740 1 Processor -- start 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72aca76740 1 -- start start 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72aca76740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72aca76740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 0x561ce38ddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72aca76740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38e1500 0x561ce38f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72aca76740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f72a41ac550 con 0x561ce38d1e10 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72aca76740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72a41ae090 con 0x561ce38e1500 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72aca76740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72a41acc20 con 0x561ce38d2730 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50396/0 (socket says 172.21.15.86:50396) 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72a3fff640 1 -- 172.21.15.86:0/674019526 learned_addr learned my addr 172.21.15.86:0/674019526 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72a2ffd640 1 --2- 172.21.15.86:0/674019526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 0x561ce38ddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.758+0000 7f72a3fff640 1 -- 172.21.15.86:0/674019526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 msgr2=0x561ce38ddcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72a3fff640 1 --2- 172.21.15.86:0/674019526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 0x561ce38ddcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72a3fff640 1 -- 172.21.15.86:0/674019526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38e1500 msgr2=0x561ce38f8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72a3fff640 1 --2- 172.21.15.86:0/674019526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38e1500 0x561ce38f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72a3fff640 1 -- 172.21.15.86:0/674019526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce38d2c70 con 0x561ce38d1e10 2024-05-12T11:09:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72a3fff640 1 --2- 172.21.15.86:0/674019526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38cd7c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f729c009660 tx=0x7f729c009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e4981555e90e0e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72897fa640 1 -- 172.21.15.86:0/674019526 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c01e040 con 0x561ce38d1e10 2024-05-12T11:09:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72897fa640 1 -- 172.21.15.86:0/674019526 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f729c003e20 con 0x561ce38d1e10 2024-05-12T11:09:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72897fa640 1 -- 172.21.15.86:0/674019526 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c016030 con 0x561ce38d1e10 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 -- 172.21.15.86:0/674019526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 msgr2=0x561ce38cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 --2- 172.21.15.86:0/674019526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38cd7c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f729c009660 tx=0x7f729c009910 comp rx=0 tx=0).stop 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 -- 172.21.15.86:0/674019526 shutdown_connections 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 --2- 172.21.15.86:0/674019526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38e1500 0x561ce38f8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 --2- 172.21.15.86:0/674019526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 0x561ce38ddcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 --2- 172.21.15.86:0/674019526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38cd7c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 -- 172.21.15.86:0/674019526 >> 172.21.15.86:0/674019526 conn(0x561ce38ce420 msgr2=0x561ce38e04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 -- 172.21.15.86:0/674019526 shutdown_connections 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.759+0000 7f72aca76740 1 -- 172.21.15.86:0/674019526 wait complete. 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 1 -- start start 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 1 Processor -- start 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38e98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 0x561ce38dadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38e1500 0x561ce38db330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f72a41ad9c0 con 0x561ce38d1e10 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72a41ad2f0 con 0x561ce38e1500 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72a41aa530 con 0x561ce38d2730 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72aca76740 10 client.0 _ll_register_callbacks cb 0x7f729c009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38e98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38e98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50412/0 (socket says 172.21.15.86:50412) 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72a3fff640 1 -- 172.21.15.86:0/4086458840 learned_addr learned my addr 172.21.15.86:0/4086458840 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.760+0000 7f72a2ffd640 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 0x561ce38dadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72a3fff640 1 -- 172.21.15.86:0/4086458840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 msgr2=0x561ce38dadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72a3fff640 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 0x561ce38dadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72a3fff640 1 -- 172.21.15.86:0/4086458840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38e1500 msgr2=0x561ce38db330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72a3fff640 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38e1500 0x561ce38db330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72a3fff640 1 -- 172.21.15.86:0/4086458840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce38dba20 con 0x561ce38d1e10 2024-05-12T11:09:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72a3fff640 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38e98f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f729c00a010 tx=0x7f729c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e013cf6ae9effa server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f7282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f7282ffd640 1 -- 172.21.15.86:0/4086458840 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c038020 con 0x561ce38d1e10 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f7282ffd640 1 -- 172.21.15.86:0/4086458840 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f729c003b70 con 0x561ce38d1e10 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 1 -- 172.21.15.86:0/4086458840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f729c003e20 con 0x561ce38d1e10 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f7282ffd640 1 -- 172.21.15.86:0/4086458840 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f729c01e040 con 0x561ce38d1e10 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 10 client.15411 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 1 -- 172.21.15.86:0/4086458840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ce395b8e0 con 0x561ce38d1e10 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f7282ffd640 1 -- 172.21.15.86:0/4086458840 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f729c003e20 con 0x561ce38d1e10 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f7282ffd640 1 -- 172.21.15.86:0/4086458840 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f729c01abe0 con 0x561ce38d1e10 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 10 client.15411 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 10 client.15411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 20 client.15411 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561ce395bf90 0x561ce395e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 4 client.15411 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:09:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.761+0000 7f72aca76740 1 -- 172.21.15.86:0/4086458840 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ce383f050 con 0x561ce395bf90 2024-05-12T11:09:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.762+0000 7f72a2ffd640 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561ce395bf90 0x561ce395e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.762+0000 7f72a2ffd640 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561ce395bf90 0x561ce395e380 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22727df48b8d2ccf server_cookie=6eedba5fb7187822 in_seq=0 out_seq=0 2024-05-12T11:09:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.762+0000 7f7282ffd640 10 client.15411 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f7282ffd640 1 -- 172.21.15.86:0/4086458840 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ce383f050 con 0x561ce395bf90 2024-05-12T11:09:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f7282ffd640 10 client.15411 handle_command_reply: tid=0 2024-05-12T11:09:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 client.15411 shutdown 2024-05-12T11:09:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 -- 172.21.15.86:0/4086458840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 msgr2=0x561ce38e98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38e98f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f729c00a010 tx=0x7f729c009520 comp rx=0 tx=0).stop 2024-05-12T11:09:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 -- 172.21.15.86:0/4086458840 shutdown_connections 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561ce395bf90 0x561ce395e380 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ce38e1500 0x561ce38db330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ce38d2730 0x561ce38dadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 --2- 172.21.15.86:0/4086458840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ce38d1e10 0x561ce38e98f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f7282ffd640 0 client.15411 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 -- 172.21.15.86:0/4086458840 >> 172.21.15.86:0/4086458840 conn(0x561ce38ce420 msgr2=0x561ce38de3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 -- 172.21.15.86:0/4086458840 shutdown_connections 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 1 -- 172.21.15.86:0/4086458840 wait complete. 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.770+0000 7f72aca76740 20 client.15411 trim_cache size 0 max 16384 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:09:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:09:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:09:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 -- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f728c0b2b30 msgr2=0x7f728c0b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f728c0b2b30 0x7f728c0b4ff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72940dfd50 tx=0x7f7294000bc0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 -- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4103c40 msgr2=0x7f72a4199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4103c40 0x7f72a4199130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f729400c890 tx=0x7f729400cd50 comp rx=0 tx=0).stop 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 -- 172.21.15.86:0/944972903 shutdown_connections 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f728c0b2b30 0x7f728c0b4ff0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a410cf80 0x7f72a419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a4104560 0x7f72a4199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 --2- 172.21.15.86:0/944972903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72a4103c40 0x7f72a4199130 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 -- 172.21.15.86:0/944972903 >> 172.21.15.86:0/944972903 conn(0x7f72a4078a30 msgr2=0x7f72a40fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 -- 172.21.15.86:0/944972903 shutdown_connections 2024-05-12T11:09:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:09:53.771+0000 7f72a9d5f640 1 -- 172.21.15.86:0/944972903 wait complete. 2024-05-12T11:09:54.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/3708631106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 msgr2=0x7fa6dc10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/3708631106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 0x7fa6dc10f290 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400b0d0 tx=0x7fa6d400b3e0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/3708631106 shutdown_connections 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/3708631106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 0x7fa6dc10f290 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/3708631106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc102630 0x7fa6dc102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/3708631106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6dc102fe0 0x7fa6dc106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/3708631106 >> 172.21.15.86:0/3708631106 conn(0x7fa6dc079370 msgr2=0x7fa6dc079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/3708631106 shutdown_connections 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/3708631106 wait complete. 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 Processor -- start 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.494+0000 7fa6e3d4e700 1 -- start start 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e3d4e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc102630 0x7fa6dc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e3d4e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6dc102fe0 0x7fa6dc19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e3d4e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 0x7fa6dc1a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e3d4e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1125d0 con 0x7fa6dc1076c0 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e3d4e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc112450 con 0x7fa6dc102630 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e3d4e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc112750 con 0x7fa6dc102fe0 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 0x7fa6dc1a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e1aea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc102630 0x7fa6dc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e12e9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6dc102fe0 0x7fa6dc19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 0x7fa6dc1a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50438/0 (socket says 172.21.15.86:50438) 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 -- 172.21.15.86:0/944879670 learned_addr learned my addr 172.21.15.86:0/944879670 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 -- 172.21.15.86:0/944879670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6dc102fe0 msgr2=0x7fa6dc19aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6dc102fe0 0x7fa6dc19aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 -- 172.21.15.86:0/944879670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc102630 msgr2=0x7fa6dc19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc102630 0x7fa6dc19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 -- 172.21.15.86:0/944879670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc1a5f30 con 0x7fa6dc1076c0 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.495+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 0x7fa6dc1a59f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009fd0 tx=0x7fa6d4007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:54.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.496+0000 7fa6d2ffd700 1 -- 172.21.15.86:0/944879670 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d401f070 con 0x7fa6dc1076c0 2024-05-12T11:09:54.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.496+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/944879670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc1a6100 con 0x7fa6dc1076c0 2024-05-12T11:09:54.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.496+0000 7fa6d2ffd700 1 -- 172.21.15.86:0/944879670 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d4007e50 con 0x7fa6dc1076c0 2024-05-12T11:09:54.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.496+0000 7fa6d2ffd700 1 -- 172.21.15.86:0/944879670 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d401b6a0 con 0x7fa6dc1076c0 2024-05-12T11:09:54.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.496+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/944879670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc1a6560 con 0x7fa6dc1076c0 2024-05-12T11:09:54.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.498+0000 7fa6d2ffd700 1 -- 172.21.15.86:0/944879670 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fa6d4022070 con 0x7fa6dc1076c0 2024-05-12T11:09:54.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.499+0000 7fa6d2ffd700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6c80b2b10 0x7fa6c80b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.499+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6c80b2b10 0x7fa6c80b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.499+0000 7fa6d2ffd700 1 -- 172.21.15.86:0/944879670 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa6d400f020 con 0x7fa6dc1076c0 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6c80b2b10 0x7fa6c80b4fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800ac50 tx=0x7fa6d800a380 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6ee5e1b80 1 Processor -- start 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6ee5e1b80 1 -- start start 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 0x5561eae9f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eae99bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eae9a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5561eade78f0 con 0x5561eae9a160 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5561ead4cd50 con 0x5561eae9f540 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5561eade38b0 con 0x5561eae9fe60 2024-05-12T11:09:54.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6e22eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eae9a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6e22eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eae9a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50444/0 (socket says 172.21.15.86:50444) 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.500+0000 7fa6e22eb700 1 -- 172.21.15.86:0/1356610519 learned_addr learned my addr 172.21.15.86:0/1356610519 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eae99bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 0x5561eae9f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6e22eb700 1 -- 172.21.15.86:0/1356610519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 msgr2=0x5561eae99bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eae99bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6e22eb700 1 -- 172.21.15.86:0/1356610519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 msgr2=0x5561eae9f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 0x5561eae9f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6e22eb700 1 -- 172.21.15.86:0/1356610519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ead34880 con 0x5561eae9a160 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eae9a5c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40aa8f0 tx=0x7fa6d4005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1366f89e4cfd4edf server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6c7fff700 1 -- 172.21.15.86:0/1356610519 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40ab2f0 con 0x5561eae9a160 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6c7fff700 1 -- 172.21.15.86:0/1356610519 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d4009cb0 con 0x5561eae9a160 2024-05-12T11:09:54.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.501+0000 7fa6c7fff700 1 -- 172.21.15.86:0/1356610519 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40aae50 con 0x5561eae9a160 2024-05-12T11:09:54.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/1356610519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 msgr2=0x5561eae9a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eae9a5c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40aa8f0 tx=0x7fa6d4005700 comp rx=0 tx=0).stop 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/1356610519 shutdown_connections 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eae9a5c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 0x5561eae9f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/1356610519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eae99bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/1356610519 >> 172.21.15.86:0/1356610519 conn(0x5561eadc1b20 msgr2=0x5561eae90250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/1356610519 shutdown_connections 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/1356610519 wait complete. 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 -- start start 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.502+0000 7fa6ee5e1b80 1 Processor -- start 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaea5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9f540 0x5561eaea2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9fe60 0x5561eaea3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5561eaea6650 con 0x5561eae9a160 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5561eada0e80 con 0x5561eae9fe60 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5561eaea67d0 con 0x5561eae9f540 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6ee5e1b80 10 client.0 _ll_register_callbacks cb 0x5561ead7b560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaea5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaea5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50450/0 (socket says 172.21.15.86:50450) 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 -- 172.21.15.86:0/3321214306 learned_addr learned my addr 172.21.15.86:0/3321214306 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9f540 0x5561eaea2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9fe60 0x5561eaea3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 -- 172.21.15.86:0/3321214306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9f540 msgr2=0x5561eaea2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9f540 0x5561eaea2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 -- 172.21.15.86:0/3321214306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9fe60 msgr2=0x5561eaea3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9fe60 0x5561eaea3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 -- 172.21.15.86:0/3321214306 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ead9e710 con 0x5561eae9a160 2024-05-12T11:09:54.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaea5af0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80046a0 tx=0x7fa6d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7a6b57aa54831c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.503+0000 7fa6c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6c57fa700 1 -- 172.21.15.86:0/3321214306 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8016070 con 0x5561eae9a160 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/3321214306 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6d4009cb0 con 0x5561eae9a160 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6c57fa700 1 -- 172.21.15.86:0/3321214306 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa6d8010840 con 0x5561eae9a160 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6c57fa700 1 -- 172.21.15.86:0/3321214306 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa6d8010a40 con 0x5561eae9a160 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 10 client.15423 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/3321214306 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561eaeb0f40 con 0x5561eae9a160 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6c57fa700 1 -- 172.21.15.86:0/3321214306 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d4009cb0 con 0x5561eae9a160 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6c57fa700 1 -- 172.21.15.86:0/3321214306 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa6d8019070 con 0x5561eae9a160 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 10 client.15423 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 10 client.15423 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 20 client.15423 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x5561eaeb3500 0x5561eaeb4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 4 client.15423 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.504+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/3321214306 --> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561eadf52d0 con 0x5561eaeb3500 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.505+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x5561eaeb3500 0x5561eaeb4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.505+0000 7fa6c57fa700 10 client.15423 ms_handle_connect on v2:172.21.15.176:6834/197047059 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.505+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x5561eaeb3500 0x5561eaeb4970 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3de00cbb896b03 server_cookie=416925b336b0c86f in_seq=0 out_seq=0 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6c57fa700 1 -- 172.21.15.86:0/3321214306 <== mds.3 v2:172.21.15.176:6834/197047059 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5561eadf52d0 con 0x5561eaeb3500 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6c57fa700 10 client.15423 handle_command_reply: tid=0 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 client.15423 shutdown 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/3321214306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 msgr2=0x5561eaea5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaea5af0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80046a0 tx=0x7fa6d80047c0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/3321214306 shutdown_connections 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x5561eaeb3500 0x5561eaeb4970 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9fe60 0x5561eaea3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaea5af0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/3321214306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9f540 0x5561eaea2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6c57fa700 0 client.15423 ms_handle_reset on v2:172.21.15.176:6834/197047059 2024-05-12T11:09:54.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/3321214306 >> 172.21.15.86:0/3321214306 conn(0x5561eadc1b20 msgr2=0x5561eae8aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:54.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/3321214306 shutdown_connections 2024-05-12T11:09:54.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/3321214306 wait complete. 2024-05-12T11:09:54.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.506+0000 7fa6ee5e1b80 20 client.15423 trim_cache size 0 max 16384 2024-05-12T11:09:54.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6ee5e1b80 1 Processor -- start 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6ee5e1b80 1 -- start start 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9a160 0x5561eae8abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9f540 0x5561eaebddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaebe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5561eaeb2cb0 con 0x5561eae9f540 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5561eaeb3380 con 0x5561eae9a160 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5561eaeb3a50 con 0x5561eae9fe60 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e12e9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9f540 0x5561eaebddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e12e9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9f540 0x5561eaebddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50458/0 (socket says 172.21.15.86:50458) 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e12e9700 1 -- 172.21.15.86:0/398163164 learned_addr learned my addr 172.21.15.86:0/398163164 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaebe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9a160 0x5561eae8abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e12e9700 1 -- 172.21.15.86:0/398163164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 msgr2=0x5561eaebe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaebe310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e12e9700 1 -- 172.21.15.86:0/398163164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9a160 msgr2=0x5561eae8abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:54.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9a160 0x5561eae8abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e12e9700 1 -- 172.21.15.86:0/398163164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561eae8cc30 con 0x5561eae9f540 2024-05-12T11:09:54.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.528+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9a160 0x5561eae8abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:54.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.529+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9f540 0x5561eaebddd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc06c760 tx=0x7fa6cc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7da874b389b272 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:54.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.529+0000 7fa6c77fe700 1 -- 172.21.15.86:0/398163164 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc0157e0 con 0x5561eae9f540 2024-05-12T11:09:54.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.529+0000 7fa6c77fe700 1 -- 172.21.15.86:0/398163164 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6cc015e30 con 0x5561eae9f540 2024-05-12T11:09:54.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.529+0000 7fa6c77fe700 1 -- 172.21.15.86:0/398163164 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc01d3e0 con 0x5561eae9f540 2024-05-12T11:09:54.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/398163164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9f540 msgr2=0x5561eaebddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9f540 0x5561eaebddd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc06c760 tx=0x7fa6cc009190 comp rx=0 tx=0).stop 2024-05-12T11:09:54.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/398163164 shutdown_connections 2024-05-12T11:09:54.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaebe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9a160 0x5561eae8abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/398163164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9f540 0x5561eaebddd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/398163164 >> 172.21.15.86:0/398163164 conn(0x5561eadc1b20 msgr2=0x5561eaea17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/398163164 shutdown_connections 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/398163164 wait complete. 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 -- start start 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.530+0000 7fa6ee5e1b80 1 Processor -- start 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaebddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 0x5561eaebe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6ee5e1b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaeb8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5561eaeb47f0 con 0x5561eae9a160 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5561eaeb4120 con 0x5561eae9f540 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6ee5e1b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5561eaeb4ec0 con 0x5561eae9fe60 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6ee5e1b80 10 client.0 _ll_register_callbacks cb 0x5561ead7b560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:54.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaebddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaebddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50462/0 (socket says 172.21.15.86:50462) 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 -- 172.21.15.86:0/4289801278 learned_addr learned my addr 172.21.15.86:0/4289801278 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaeb8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 0x5561eaebe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 -- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 msgr2=0x5561eaeb8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaeb8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 -- 172.21.15.86:0/4289801278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 msgr2=0x5561eaebe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 0x5561eaebe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 -- 172.21.15.86:0/4289801278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561eaeb93e0 con 0x5561eae9a160 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e22eb700 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaeb8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6e1aea700 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaebddf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8027dd0 tx=0x7fa6d80277b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bdb66911323532 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.531+0000 7fa6c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6c57fa700 1 -- 172.21.15.86:0/4289801278 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8034070 con 0x5561eae9a160 2024-05-12T11:09:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6c57fa700 1 -- 172.21.15.86:0/4289801278 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa6d8030840 con 0x5561eae9a160 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/4289801278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6cc015e30 con 0x5561eae9a160 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6c57fa700 1 -- 172.21.15.86:0/4289801278 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa6d8003c40 con 0x5561eae9a160 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 10 client.15429 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/4289801278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561eaf1f2b0 con 0x5561eae9a160 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6c57fa700 1 -- 172.21.15.86:0/4289801278 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6cc015e30 con 0x5561eae9a160 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6c57fa700 1 -- 172.21.15.86:0/4289801278 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa6d8019040 con 0x5561eae9a160 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 10 client.15429 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 10 client.15429 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 20 client.15429 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x5561eaf23f70 0x5561eaf22c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 4 client.15429 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.532+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/4289801278 --> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] -- command(tid 0: {"prefix": "status"}) -- 0x5561eadef370 con 0x5561eaf23f70 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.533+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x5561eaf23f70 0x5561eaf22c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:54.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.533+0000 7fa6e12e9700 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x5561eaf23f70 0x5561eaf22c80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ffa7a646b0b3e31 server_cookie=1d464b5c6ee27deb in_seq=0 out_seq=0 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.533+0000 7fa6c57fa700 10 client.15429 ms_handle_connect on v2:172.21.15.176:6834/197047059 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.533+0000 7fa6c57fa700 1 -- 172.21.15.86:0/4289801278 <== mds.3 v2:172.21.15.176:6834/197047059 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5561eadef370 con 0x5561eaf23f70 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.533+0000 7fa6c57fa700 10 client.15429 handle_command_reply: tid=0 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.533+0000 7fa6ee5e1b80 1 client.15429 shutdown 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.533+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/4289801278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 msgr2=0x5561eaebddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.533+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaebddf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8027dd0 tx=0x7fa6d80277b0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/4289801278 shutdown_connections 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:6834/197047059,v1:172.21.15.176:6835/197047059] conn(0x5561eaf23f70 0x5561eaf22c80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5561eae9fe60 0x5561eaeb8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5561eae9a160 0x5561eaebddf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6c57fa700 0 client.15429 ms_handle_reset on v2:172.21.15.176:6834/197047059 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 1 --2- 172.21.15.86:0/4289801278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5561eae9f540 0x5561eaebe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/4289801278 >> 172.21.15.86:0/4289801278 conn(0x5561eadc1b20 msgr2=0x5561eaea2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:54.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/4289801278 shutdown_connections 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 1 -- 172.21.15.86:0/4289801278 wait complete. 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6ee5e1b80 20 client.15429 trim_cache size 0 max 16384 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 3, 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24436, 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 213.30566400999999, 2024-05-12T11:09:54.531 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 29, 2024-05-12T11:09:54.532 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 83, 2024-05-12T11:09:54.532 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 82, 2024-05-12T11:09:54.532 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 263.69110275499997 2024-05-12T11:09:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:54.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6c80b2b10 msgr2=0x7fa6c80b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6c80b2b10 0x7fa6c80b4fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800ac50 tx=0x7fa6d800a380 comp rx=0 tx=0).stop 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 msgr2=0x7fa6dc1a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.534+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 0x7fa6dc1a59f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009fd0 tx=0x7fa6d4007a20 comp rx=0 tx=0).stop 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.535+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/944879670 shutdown_connections 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.535+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa6c80b2b10 0x7fa6c80b4fd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.535+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6dc1076c0 0x7fa6dc1a59f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.535+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc102630 0x7fa6dc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.535+0000 7fa6e3d4e700 1 --2- 172.21.15.86:0/944879670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6dc102fe0 0x7fa6dc19aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.535+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/944879670 >> 172.21.15.86:0/944879670 conn(0x7fa6dc079370 msgr2=0x7fa6dc1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.535+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/944879670 shutdown_connections 2024-05-12T11:09:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:54.535+0000 7fa6e3d4e700 1 -- 172.21.15.86:0/944879670 wait complete. 2024-05-12T11:09:55.179 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:55 smithi086 ceph-mon[30110]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-05-12T11:09:55.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-12T11:09:55.450 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:55 smithi172 ceph-mon[34517]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-05-12T11:09:55.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:55 smithi176 ceph-mon[34357]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-05-12T11:09:57.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 -- 172.21.15.86:0/792748673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 msgr2=0x7f02e006bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 --2- 172.21.15.86:0/792748673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 0x7f02e006bb50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009990 tx=0x7f02d0009ca0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 -- 172.21.15.86:0/792748673 shutdown_connections 2024-05-12T11:09:57.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 --2- 172.21.15.86:0/792748673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e0105ee0 0x7f02e0106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 --2- 172.21.15.86:0/792748673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e01083d0 0x7f02e006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 --2- 172.21.15.86:0/792748673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 0x7f02e006bb50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 -- 172.21.15.86:0/792748673 >> 172.21.15.86:0/792748673 conn(0x7f02e0079350 msgr2=0x7f02e0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:57.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 -- 172.21.15.86:0/792748673 shutdown_connections 2024-05-12T11:09:57.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.080+0000 7f02e7a62700 1 -- 172.21.15.86:0/792748673 wait complete. 2024-05-12T11:09:57.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e7a62700 1 Processor -- start 2024-05-12T11:09:57.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e7a62700 1 -- start start 2024-05-12T11:09:57.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e7a62700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 0x7f02e01a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e7a62700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e0105ee0 0x7f02e01a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e7a62700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e01083d0 0x7f02e01a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e7a62700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0119c30 con 0x7f02e006b6f0 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e7a62700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0119ab0 con 0x7f02e0105ee0 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e7a62700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0119db0 con 0x7f02e01083d0 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e57fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 0x7f02e01a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e57fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 0x7f02e01a0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50480/0 (socket says 172.21.15.86:50480) 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e57fe700 1 -- 172.21.15.86:0/1559598662 learned_addr learned my addr 172.21.15.86:0/1559598662 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e5fff700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e01083d0 0x7f02e01a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.081+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e0105ee0 0x7f02e01a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02e57fe700 1 -- 172.21.15.86:0/1559598662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e01083d0 msgr2=0x7f02e01a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e01083d0 0x7f02e01a4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02e57fe700 1 -- 172.21.15.86:0/1559598662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e0105ee0 msgr2=0x7f02e01a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e0105ee0 0x7f02e01a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02e57fe700 1 -- 172.21.15.86:0/1559598662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e01a5190 con 0x7f02e006b6f0 2024-05-12T11:09:57.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 0x7f02e01a0180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d950 tx=0x7f02dc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:57.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02d67fc700 1 -- 172.21.15.86:0/1559598662 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc016070 con 0x7f02e006b6f0 2024-05-12T11:09:57.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02e7a62700 1 -- 172.21.15.86:0/1559598662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e01a5480 con 0x7f02e006b6f0 2024-05-12T11:09:57.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02d67fc700 1 -- 172.21.15.86:0/1559598662 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02dc009df0 con 0x7f02e006b6f0 2024-05-12T11:09:57.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02d67fc700 1 -- 172.21.15.86:0/1559598662 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00f3c0 con 0x7f02e006b6f0 2024-05-12T11:09:57.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.082+0000 7f02e7a62700 1 -- 172.21.15.86:0/1559598662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e01acd00 con 0x7f02e006b6f0 2024-05-12T11:09:57.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.085+0000 7f02d67fc700 1 -- 172.21.15.86:0/1559598662 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7f02dc019070 con 0x7f02e006b6f0 2024-05-12T11:09:57.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.086+0000 7f02d67fc700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f02cc0b2b10 0x7f02cc0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.086+0000 7f02f22f5b80 1 Processor -- start 2024-05-12T11:09:57.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.086+0000 7f02f22f5b80 1 -- start start 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.086+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f02cc0b2b10 0x7f02cc0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.086+0000 7f02d67fc700 1 -- 172.21.15.86:0/1559598662 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f02dc0e2470 con 0x7f02e006b6f0 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50480 0x559bf4b50860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559bf4aa2810 con 0x559bf4b50da0 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559bf4a41770 con 0x559bf4b50480 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559bf4a9e7d0 con 0x559bf4b54c30 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e57fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50480 0x559bf4b50860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50484/0 (socket says 172.21.15.86:50484) 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 -- 172.21.15.86:0/3169735608 learned_addr learned my addr 172.21.15.86:0/3169735608 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:57.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e57fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50480 0x559bf4b50860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.86:54880/0 (socket says 172.21.15.86:54880) 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e5fff700 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f02cc0b2b10 0x7f02cc0b4fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02d0006010 tx=0x7f02d001a040 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 -- 172.21.15.86:0/3169735608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 msgr2=0x559bf4b550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 -- 172.21.15.86:0/3169735608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50480 msgr2=0x559bf4b50860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50480 0x559bf4b50860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 -- 172.21.15.86:0/3169735608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf49ef880 con 0x559bf4b50da0 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e5fff700 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.087+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b546a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f02d0015000 tx=0x7f02d001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0c5adcee13434 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02cb7fe700 1 -- 172.21.15.86:0/3169735608 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0032070 con 0x559bf4b50da0 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02cb7fe700 1 -- 172.21.15.86:0/3169735608 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02d000fc10 con 0x559bf4b50da0 2024-05-12T11:09:57.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02cb7fe700 1 -- 172.21.15.86:0/3169735608 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d002dcc0 con 0x559bf4b50da0 2024-05-12T11:09:57.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02f22f5b80 1 -- 172.21.15.86:0/3169735608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 msgr2=0x559bf4b546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b546a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f02d0015000 tx=0x7f02d001e000 comp rx=0 tx=0).stop 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02f22f5b80 1 -- 172.21.15.86:0/3169735608 shutdown_connections 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50480 0x559bf4b50860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.088+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/3169735608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b546a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 -- 172.21.15.86:0/3169735608 >> 172.21.15.86:0/3169735608 conn(0x559bf4a7c0b0 msgr2=0x559bf4b4ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 -- 172.21.15.86:0/3169735608 shutdown_connections 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 -- 172.21.15.86:0/3169735608 wait complete. 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 -- start start 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 Processor -- start 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 0x559bf4b5bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b59310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b54c30 0x559bf4b59850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559bf4b5cde0 con 0x559bf4b54c30 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559bf4a08be0 con 0x559bf4b50da0 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559bf4b5cf60 con 0x559bf4b50480 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.089+0000 7f02f22f5b80 10 client.0 _ll_register_callbacks cb 0x559bf4a3a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b54c30 0x559bf4b59850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b54c30 0x559bf4b59850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50488/0 (socket says 172.21.15.86:50488) 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 -- 172.21.15.86:0/1717678371 learned_addr learned my addr 172.21.15.86:0/1717678371 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b59310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 0x559bf4b5bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 -- 172.21.15.86:0/1717678371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 msgr2=0x559bf4b5bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 0x559bf4b5bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 -- 172.21.15.86:0/1717678371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 msgr2=0x559bf4b59310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:57.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b59310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 -- 172.21.15.86:0/1717678371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf4a3e640 con 0x559bf4b54c30 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02e5fff700 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b54c30 0x559bf4b59850 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f02d8004140 tx=0x7f02d8004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d400193355d27d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1717678371 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d801a020 con 0x559bf4b54c30 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1717678371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02d000fc10 con 0x559bf4b54c30 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1717678371 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f02d8007910 con 0x559bf4b54c30 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1717678371 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f02d8025050 con 0x559bf4b54c30 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02f22f5b80 10 client.15441 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.090+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1717678371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559bf4b675a0 con 0x559bf4b54c30 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1717678371 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02d000fc10 con 0x559bf4b54c30 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1717678371 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f02d8016ce0 con 0x559bf4b54c30 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02f22f5b80 10 client.15441 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02f22f5b80 10 client.15441 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-12T11:09:57.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02f22f5b80 20 client.15441 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x559bf4b69c40 0x559bf4b6b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02f22f5b80 4 client.15441 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1717678371 --> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bf4b1c600 con 0x559bf4b69c40 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.091+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x559bf4b69c40 0x559bf4b6b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.092+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x559bf4b69c40 0x559bf4b6b0b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e71a10a5a4113f87 server_cookie=72cb7c474f6c412a in_seq=0 out_seq=0 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.092+0000 7f02c8ff9700 10 client.15441 ms_handle_connect on v2:172.21.15.176:6836/2905239515 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.092+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1717678371 <== mds.2 v2:172.21.15.176:6836/2905239515 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559bf4b1c600 con 0x559bf4b69c40 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.092+0000 7f02c8ff9700 10 client.15441 handle_command_reply: tid=0 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.092+0000 7f02f22f5b80 1 client.15441 shutdown 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.092+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1717678371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b54c30 msgr2=0x559bf4b59850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.092+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b54c30 0x559bf4b59850 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f02d8004140 tx=0x7f02d8004450 comp rx=0 tx=0).stop 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1717678371 shutdown_connections 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b54c30 0x559bf4b59850 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x559bf4b69c40 0x559bf4b6b0b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 0x559bf4b5bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1717678371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b59310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1717678371 >> 172.21.15.86:0/1717678371 conn(0x559bf4a7c0b0 msgr2=0x559bf4b456d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:57.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02c8ff9700 0 client.15441 ms_handle_reset on v2:172.21.15.176:6836/2905239515 2024-05-12T11:09:57.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1717678371 shutdown_connections 2024-05-12T11:09:57.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1717678371 wait complete. 2024-05-12T11:09:57.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.093+0000 7f02f22f5b80 20 client.15441 trim_cache size 0 max 16384 2024-05-12T11:09:57.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02f22f5b80 1 Processor -- start 2024-05-12T11:09:57.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02f22f5b80 1 -- start start 2024-05-12T11:09:57.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50480 0x559bf4b58c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b52ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559bf4b693f0 con 0x559bf4b50480 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559bf4b69ac0 con 0x559bf4b50da0 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559bf4b6a190 con 0x559bf4b54c30 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e57fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50480 0x559bf4b58c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e57fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50480 0x559bf4b58c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50504/0 (socket says 172.21.15.86:50504) 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e57fe700 1 -- 172.21.15.86:0/2756728322 learned_addr learned my addr 172.21.15.86:0/2756728322 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e5fff700 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b52ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e57fe700 1 -- 172.21.15.86:0/2756728322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 msgr2=0x559bf4b52ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:57.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e57fe700 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b52ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e57fe700 1 -- 172.21.15.86:0/2756728322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 msgr2=0x559bf4b525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e57fe700 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e57fe700 1 -- 172.21.15.86:0/2756728322 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf4b57880 con 0x559bf4b50480 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e5fff700 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b52ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.114+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02e57fe700 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50480 0x559bf4b58c10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009520 tx=0x7f02dc091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4c9687132c5168 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02caffd700 1 -- 172.21.15.86:0/2756728322 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0c2070 con 0x559bf4b50480 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02caffd700 1 -- 172.21.15.86:0/2756728322 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02dc0ad8b0 con 0x559bf4b50480 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02caffd700 1 -- 172.21.15.86:0/2756728322 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc020040 con 0x559bf4b50480 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 -- 172.21.15.86:0/2756728322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50480 msgr2=0x559bf4b58c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50480 0x559bf4b58c10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009520 tx=0x7f02dc091040 comp rx=0 tx=0).stop 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 -- 172.21.15.86:0/2756728322 shutdown_connections 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b54c30 0x559bf4b52ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50480 0x559bf4b58c10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/2756728322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b50da0 0x559bf4b525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 -- 172.21.15.86:0/2756728322 >> 172.21.15.86:0/2756728322 conn(0x559bf4a7c0b0 msgr2=0x559bf4b592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:57.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 -- 172.21.15.86:0/2756728322 shutdown_connections 2024-05-12T11:09:57.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.115+0000 7f02f22f5b80 1 -- 172.21.15.86:0/2756728322 wait complete. 2024-05-12T11:09:57.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 1 -- start start 2024-05-12T11:09:57.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 1 Processor -- start 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 0x559bf4b51f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b52440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b54c30 0x559bf4b72b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559bf4b6af30 con 0x559bf4b50da0 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559bf4b6a860 con 0x559bf4b54c30 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559bf4b6b600 con 0x559bf4b50480 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02f22f5b80 10 client.0 _ll_register_callbacks cb 0x559bf4a3a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02e4ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b52440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02e4ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b52440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50518/0 (socket says 172.21.15.86:50518) 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02e4ffd700 1 -- 172.21.15.86:0/1989776784 learned_addr learned my addr 172.21.15.86:0/1989776784 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:57.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 0x559bf4b51f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.116+0000 7f02e5fff700 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b54c30 0x559bf4b72b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02e4ffd700 1 -- 172.21.15.86:0/1989776784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 msgr2=0x559bf4b51f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 0x559bf4b51f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02e4ffd700 1 -- 172.21.15.86:0/1989776784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b54c30 msgr2=0x559bf4b72b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b54c30 0x559bf4b72b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02e4ffd700 1 -- 172.21.15.86:0/1989776784 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf4b52ce0 con 0x559bf4b50da0 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02e5fff700 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b54c30 0x559bf4b72b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02e4ffd700 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b52440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f02d000bf70 tx=0x7f02d002dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ef0d452ce676cb server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1989776784 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0032040 con 0x559bf4b50da0 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1989776784 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02dc0ad8b0 con 0x559bf4b50da0 2024-05-12T11:09:57.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1989776784 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f02d000f660 con 0x559bf4b50da0 2024-05-12T11:09:57.113 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:57 smithi086 ceph-mon[30110]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-12T11:09:57.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1989776784 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f02d000f860 con 0x559bf4b50da0 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02f22f5b80 10 client.15447 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1989776784 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559bf4bd5620 con 0x559bf4b50da0 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.117+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1989776784 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02dc0ad8b0 con 0x559bf4b50da0 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1989776784 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f02d002dce0 con 0x559bf4b50da0 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02f22f5b80 10 client.15447 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02f22f5b80 10 client.15447 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02f22f5b80 20 client.15447 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x559bf4bd9ba0 0x559bf4bd88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02f22f5b80 4 client.15447 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1989776784 --> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] -- command(tid 0: {"prefix": "status"}) -- 0x559bf4ab01f0 con 0x559bf4bd9ba0 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x559bf4bd9ba0 0x559bf4bd88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02c8ff9700 10 client.15447 ms_handle_connect on v2:172.21.15.176:6836/2905239515 2024-05-12T11:09:57.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.118+0000 7f02e57fe700 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x559bf4bd9ba0 0x559bf4bd88b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d665b75c064e674 server_cookie=35a169e099d736b4 in_seq=0 out_seq=0 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02c8ff9700 1 -- 172.21.15.86:0/1989776784 <== mds.2 v2:172.21.15.176:6836/2905239515 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559bf4ab01f0 con 0x559bf4bd9ba0 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02c8ff9700 10 client.15447 handle_command_reply: tid=0 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 client.15447 shutdown 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1989776784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 msgr2=0x559bf4b52440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b52440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f02d000bf70 tx=0x7f02d002dac0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1989776784 shutdown_connections 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf4b54c30 0x559bf4b72b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.176:6836/2905239515,v1:172.21.15.176:6837/2905239515] conn(0x559bf4bd9ba0 0x559bf4bd88b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559bf4b50480 0x559bf4b51f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 --2- 172.21.15.86:0/1989776784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bf4b50da0 0x559bf4b52440 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02c8ff9700 0 client.15447 ms_handle_reset on v2:172.21.15.176:6836/2905239515 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1989776784 >> 172.21.15.86:0/1989776784 conn(0x559bf4a7c0b0 msgr2=0x559bf4b44e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:57.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1989776784 shutdown_connections 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 1 -- 172.21.15.86:0/1989776784 wait complete. 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.119+0000 7f02f22f5b80 20 client.15447 trim_cache size 0 max 16384 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 2, 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24442, 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 216.89174508299999, 2024-05-12T11:09:57.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 29, 2024-05-12T11:09:57.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 83, 2024-05-12T11:09:57.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 82, 2024-05-12T11:09:57.118 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 263.49504818899999 2024-05-12T11:09:57.118 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:57.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 -- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f02cc0b2b10 msgr2=0x7f02cc0b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f02cc0b2b10 0x7f02cc0b4fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02d0006010 tx=0x7f02d001a040 comp rx=0 tx=0).stop 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 -- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 msgr2=0x7f02e01a0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 0x7f02e01a0180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d950 tx=0x7f02dc00dc60 comp rx=0 tx=0).stop 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 -- 172.21.15.86:0/1559598662 shutdown_connections 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e01083d0 0x7f02e01a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f02cc0b2b10 0x7f02cc0b4fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02e006b6f0 0x7f02e01a0180 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 --2- 172.21.15.86:0/1559598662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e0105ee0 0x7f02e01a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 -- 172.21.15.86:0/1559598662 >> 172.21.15.86:0/1559598662 conn(0x7f02e0079350 msgr2=0x7f02e0104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 -- 172.21.15.86:0/1559598662 shutdown_connections 2024-05-12T11:09:57.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:57.120+0000 7f02e7a62700 1 -- 172.21.15.86:0/1559598662 wait complete. 2024-05-12T11:09:57.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:57 smithi172 ceph-mon[34517]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-12T11:09:57.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:57 smithi176 ceph-mon[34357]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-12T11:09:57.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-12T11:09:58.105 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:09:59.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:09:59 smithi172 ceph-mon[34517]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-12T11:09:59.305 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:09:59 smithi086 ceph-mon[30110]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-12T11:09:59.318 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:09:59 smithi176 ceph-mon[34357]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.864+0000 7fc9de351700 1 -- 172.21.15.86:0/3151401583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 msgr2=0x7fc9d81103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.864+0000 7fc9de351700 1 --2- 172.21.15.86:0/3151401583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 0x7fc9d81103a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000b0a0 tx=0x7fc9d000b3b0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.864+0000 7fc9de351700 1 -- 172.21.15.86:0/3151401583 shutdown_connections 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.864+0000 7fc9de351700 1 --2- 172.21.15.86:0/3151401583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 0x7fc9d81103a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.864+0000 7fc9de351700 1 --2- 172.21.15.86:0/3151401583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9d81084e0 0x7fc9d81088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.864+0000 7fc9de351700 1 --2- 172.21.15.86:0/3151401583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d806bbf0 0x7fc9d806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.864+0000 7fc9de351700 1 -- 172.21.15.86:0/3151401583 >> 172.21.15.86:0/3151401583 conn(0x7fc9d8079260 msgr2=0x7fc9d8079670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.864+0000 7fc9de351700 1 -- 172.21.15.86:0/3151401583 shutdown_connections 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 -- 172.21.15.86:0/3151401583 wait complete. 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 Processor -- start 2024-05-12T11:09:59.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 -- start start 2024-05-12T11:09:59.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9d806bbf0 0x7fc9d819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 0x7fc9d819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d81084e0 0x7fc9d8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d8113670 con 0x7fc9d806c5b0 2024-05-12T11:09:59.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81134f0 con 0x7fc9d806bbf0 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.865+0000 7fc9de351700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81137f0 con 0x7fc9d81084e0 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 0x7fc9d819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 0x7fc9d819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50530/0 (socket says 172.21.15.86:50530) 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 -- 172.21.15.86:0/4064124804 learned_addr learned my addr 172.21.15.86:0/4064124804 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9d806bbf0 0x7fc9d819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9dc8ee700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d81084e0 0x7fc9d8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 -- 172.21.15.86:0/4064124804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d81084e0 msgr2=0x7fc9d8199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d81084e0 0x7fc9d8199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 -- 172.21.15.86:0/4064124804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9d806bbf0 msgr2=0x7fc9d819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9d806bbf0 0x7fc9d819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 -- 172.21.15.86:0/4064124804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d819a030 con 0x7fc9d806c5b0 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9d806bbf0 0x7fc9d819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 0x7fc9d819fbc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c9b0 tx=0x7fc9c000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d57fa700 1 -- 172.21.15.86:0/4064124804 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0007b00 con 0x7fc9d806c5b0 2024-05-12T11:09:59.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9de351700 1 -- 172.21.15.86:0/4064124804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d819a320 con 0x7fc9d806c5b0 2024-05-12T11:09:59.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d57fa700 1 -- 172.21.15.86:0/4064124804 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c0007ca0 con 0x7fc9d806c5b0 2024-05-12T11:09:59.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9d57fa700 1 -- 172.21.15.86:0/4064124804 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0018660 con 0x7fc9d806c5b0 2024-05-12T11:09:59.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.866+0000 7fc9de351700 1 -- 172.21.15.86:0/4064124804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d81a64e0 con 0x7fc9d806c5b0 2024-05-12T11:09:59.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.869+0000 7fc9d57fa700 1 -- 172.21.15.86:0/4064124804 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 24) ==== 149879+0+0 (secure 0 0 0) 0x7fc9c000f450 con 0x7fc9d806c5b0 2024-05-12T11:09:59.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.869+0000 7fc9d57fa700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc9c40b2b10 0x7fc9c40b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.869+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc9c40b2b10 0x7fc9c40b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9d57fa700 1 -- 172.21.15.86:0/4064124804 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fc9c00e28b0 con 0x7fc9d806c5b0 2024-05-12T11:09:59.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc9c40b2b10 0x7fc9c40b4fd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9d806b810 tx=0x7fc9c800b410 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:59.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9e8be4b80 1 Processor -- start 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9e8be4b80 1 -- start start 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75150d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f7515077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f751508140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f7514598f0 con 0x55f751507d00 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f7513bed50 con 0x55f75150da80 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f7514558b0 con 0x55f75150d160 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9dc8ee700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f751508140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f7515077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.870+0000 7fc9dc8ee700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f751508140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50546/0 (socket says 172.21.15.86:50546) 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9dc8ee700 1 -- 172.21.15.86:0/3690273810 learned_addr learned my addr 172.21.15.86:0/3690273810 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75150d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9d77fe700 1 -- 172.21.15.86:0/3690273810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 msgr2=0x55f75150d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:59.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75150d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9d77fe700 1 -- 172.21.15.86:0/3690273810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 msgr2=0x55f751508140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:59.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f751508140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9d77fe700 1 -- 172.21.15.86:0/3690273810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7513a6880 con 0x55f75150da80 2024-05-12T11:09:59.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9dc8ee700 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f751508140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:09:59.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f7515077c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00dfe80 tx=0x7fc9c00a90b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f340979e5e4ef65 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:59.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9ce7fc700 1 -- 172.21.15.86:0/3690273810 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c008fe60 con 0x55f75150da80 2024-05-12T11:09:59.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9ce7fc700 1 -- 172.21.15.86:0/3690273810 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c00b20f0 con 0x55f75150da80 2024-05-12T11:09:59.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.871+0000 7fc9ce7fc700 1 -- 172.21.15.86:0/3690273810 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00b27a0 con 0x55f75150da80 2024-05-12T11:09:59.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/3690273810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 msgr2=0x55f7515077c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f7515077c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00dfe80 tx=0x7fc9c00a90b0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/3690273810 shutdown_connections 2024-05-12T11:09:59.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f751508140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75150d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/3690273810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f7515077c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/3690273810 >> 172.21.15.86:0/3690273810 conn(0x55f751433b20 msgr2=0x55f751502250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/3690273810 shutdown_connections 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/3690273810 wait complete. 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.872+0000 7fc9e8be4b80 1 -- start start 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9e8be4b80 1 Processor -- start 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 0x55f751513780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f751510b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f7515110b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f751514400 con 0x55f75150d160 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f751412e80 con 0x55f751507d00 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f751514580 con 0x55f75150da80 2024-05-12T11:09:59.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9e8be4b80 10 client.0 _ll_register_callbacks cb 0x55f7513ed560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f751510b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f751510b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50550/0 (socket says 172.21.15.86:50550) 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 -- 172.21.15.86:0/318042881 learned_addr learned my addr 172.21.15.86:0/318042881 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 0x55f751513780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9dc8ee700 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f7515110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 -- 172.21.15.86:0/318042881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 msgr2=0x55f7515110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f7515110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 -- 172.21.15.86:0/318042881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 msgr2=0x55f751513780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 0x55f751513780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 -- 172.21.15.86:0/318042881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f751410710 con 0x55f75150d160 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9dc8ee700 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f7515110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f751510b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00a98d0 tx=0x7fc9c00cc240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb72ea9b5d492719 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:59.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.873+0000 7fc9b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9b77fe700 1 -- 172.21.15.86:0/318042881 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c008fe60 con 0x55f75150d160 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9b77fe700 1 -- 172.21.15.86:0/318042881 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fc9c00b2520 con 0x55f75150d160 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/318042881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c00b20f0 con 0x55f75150d160 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9b77fe700 1 -- 172.21.15.86:0/318042881 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9c00b27a0 con 0x55f75150d160 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 10 client.15459 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/318042881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f75151ed50 con 0x55f75150d160 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9b77fe700 1 -- 172.21.15.86:0/318042881 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c00b20f0 con 0x55f75150d160 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9b77fe700 1 -- 172.21.15.86:0/318042881 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc9c00e0280 con 0x55f75150d160 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 10 client.15459 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 10 client.15459 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 20 client.15459 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x55f7515200a0 0x55f751522160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 4 client.15459 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:09:59.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/318042881 --> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7514672d0 con 0x55f7515200a0 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.874+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x55f7515200a0 0x55f751522160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.875+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x55f7515200a0 0x55f751522160 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6c6a88a95abbf4f3 server_cookie=7bb11a8ae1c8944d in_seq=0 out_seq=0 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.875+0000 7fc9b77fe700 10 client.15459 ms_handle_connect on v2:172.21.15.172:6838/2644756211 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.875+0000 7fc9b77fe700 1 -- 172.21.15.86:0/318042881 <== mds.1 v2:172.21.15.172:6838/2644756211 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f7514672d0 con 0x55f7515200a0 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.875+0000 7fc9b77fe700 10 client.15459 handle_command_reply: tid=0 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.875+0000 7fc9e8be4b80 1 client.15459 shutdown 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/318042881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 msgr2=0x55f751510b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f751510b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00a98d0 tx=0x7fc9c00cc240 comp rx=0 tx=0).stop 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/318042881 shutdown_connections 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x55f7515200a0 0x55f751522160 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9b77fe700 0 client.15459 ms_handle_reset on v2:172.21.15.172:6838/2644756211 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f7515110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 0x55f751513780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/318042881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f751510b70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/318042881 >> 172.21.15.86:0/318042881 conn(0x55f751433b20 msgr2=0x55f7514fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:59.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/318042881 shutdown_connections 2024-05-12T11:09:59.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/318042881 wait complete. 2024-05-12T11:09:59.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.876+0000 7fc9e8be4b80 20 client.15459 trim_cache size 0 max 16384 2024-05-12T11:09:59.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.896+0000 7fc9e8be4b80 1 Processor -- start 2024-05-12T11:09:59.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.896+0000 7fc9e8be4b80 1 -- start start 2024-05-12T11:09:59.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 0x55f7515077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f7514fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f75150e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f7515204a0 con 0x55f75150d160 2024-05-12T11:09:59.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f751520b70 con 0x55f751507d00 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f751521240 con 0x55f75150da80 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f7514fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f7514fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50560/0 (socket says 172.21.15.86:50560) 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 -- 172.21.15.86:0/29610346 learned_addr learned my addr 172.21.15.86:0/29610346 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 0x55f7515077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9dc8ee700 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f75150e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 -- 172.21.15.86:0/29610346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 msgr2=0x55f75150e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f75150e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 -- 172.21.15.86:0/29610346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 msgr2=0x55f7515077c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 0x55f7515077c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 -- 172.21.15.86:0/29610346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f751514530 con 0x55f75150d160 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9dc8ee700 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f75150e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f7514fcbf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00dff90 tx=0x7fc9c0007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce826e92707287d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:59.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.897+0000 7fc9cdffb700 1 -- 172.21.15.86:0/29610346 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c008fe60 con 0x55f75150d160 2024-05-12T11:09:59.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9cdffb700 1 -- 172.21.15.86:0/29610346 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c00c4020 con 0x55f75150d160 2024-05-12T11:09:59.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9cdffb700 1 -- 172.21.15.86:0/29610346 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00a9450 con 0x55f75150d160 2024-05-12T11:09:59.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/29610346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 msgr2=0x55f7514fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f7514fcbf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00dff90 tx=0x7fc9c0007e50 comp rx=0 tx=0).stop 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/29610346 shutdown_connections 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150da80 0x55f75150e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f751507d00 0x55f7515077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/29610346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f75150d160 0x55f7514fcbf0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/29610346 >> 172.21.15.86:0/29610346 conn(0x55f751433b20 msgr2=0x55f75150de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/29610346 shutdown_connections 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.898+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/29610346 wait complete. 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 1 -- start start 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 1 Processor -- start 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f75152a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75152aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f75152b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f751521fe0 con 0x55f751507d00 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f751521910 con 0x55f75150da80 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f7515226b0 con 0x55f75150d160 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9e8be4b80 10 client.0 _ll_register_callbacks cb 0x55f7513ed560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9d7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f75152a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9d7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f75152a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50566/0 (socket says 172.21.15.86:50566) 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9d7fff700 1 -- 172.21.15.86:0/1231372048 learned_addr learned my addr 172.21.15.86:0/1231372048 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.899+0000 7fc9dc8ee700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f75152b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75152aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9d7fff700 1 -- 172.21.15.86:0/1231372048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 msgr2=0x55f75152aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75152aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9d7fff700 1 -- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 msgr2=0x55f75152b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f75152b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9d7fff700 1 -- 172.21.15.86:0/1231372048 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7515902c0 con 0x55f751507d00 2024-05-12T11:09:59.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75152aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9dc8ee700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f75152b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9d7fff700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f75152a9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80045c0 tx=0x7fc9c8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe2e719ebdbe96e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9b77fe700 1 -- 172.21.15.86:0/1231372048 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8028130 con 0x55f751507d00 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9b77fe700 1 -- 172.21.15.86:0/1231372048 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fc9c80282d0 con 0x55f751507d00 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/1231372048 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c00c4020 con 0x55f751507d00 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9b77fe700 1 -- 172.21.15.86:0/1231372048 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9c80284d0 con 0x55f751507d00 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9e8be4b80 10 client.15465 fetch_fsmap learned FSMap version 29 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.900+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/1231372048 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f751591510 con 0x55f751507d00 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9b77fe700 1 -- 172.21.15.86:0/1231372048 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c00c4020 con 0x55f751507d00 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9b77fe700 1 -- 172.21.15.86:0/1231372048 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc9c8028ce0 con 0x55f751507d00 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9e8be4b80 10 client.15465 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:09:59.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9e8be4b80 10 client.15465 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9e8be4b80 20 client.15465 populate_metadata read hostname 'smithi086' 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x55f7515200a0 0x55f751594eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9e8be4b80 4 client.15465 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/1231372048 --> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] -- command(tid 0: {"prefix": "status"}) -- 0x55f751461370 con 0x55f7515200a0 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x55f7515200a0 0x55f751594eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9d77fe700 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x55f7515200a0 0x55f751594eb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9cac75d60a28fe1c server_cookie=ff9366104dd9ca90 in_seq=0 out_seq=0 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.901+0000 7fc9b77fe700 10 client.15465 ms_handle_connect on v2:172.21.15.172:6838/2644756211 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9b77fe700 1 -- 172.21.15.86:0/1231372048 <== mds.1 v2:172.21.15.172:6838/2644756211 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f751461370 con 0x55f7515200a0 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9b77fe700 10 client.15465 handle_command_reply: tid=0 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 client.15465 shutdown 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/1231372048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 msgr2=0x55f75152a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f75152a9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80045c0 tx=0x7fc9c8013000 comp rx=0 tx=0).stop 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/1231372048 shutdown_connections 2024-05-12T11:09:59.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:6838/2644756211,v1:172.21.15.172:6839/2644756211] conn(0x55f7515200a0 0x55f751594eb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9b77fe700 0 client.15465 ms_handle_reset on v2:172.21.15.172:6838/2644756211 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f75150da80 0x55f75152b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f751507d00 0x55f75152a9a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 --2- 172.21.15.86:0/1231372048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f75150d160 0x55f75152aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/1231372048 >> 172.21.15.86:0/1231372048 conn(0x55f751433b20 msgr2=0x55f75150e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/1231372048 shutdown_connections 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 1 -- 172.21.15.86:0/1231372048 wait complete. 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.902+0000 7fc9e8be4b80 20 client.15465 trim_cache size 0 max 16384 2024-05-12T11:09:59.898 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 1, 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24443, 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 220.688083033, 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 29, 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 83, 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 82, 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 250.01963706399999 2024-05-12T11:09:59.899 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:09:59.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 -- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc9c40b2b10 msgr2=0x7fc9c40b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc9c40b2b10 0x7fc9c40b4fd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9d806b810 tx=0x7fc9c800b410 comp rx=0 tx=0).stop 2024-05-12T11:09:59.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 -- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 msgr2=0x7fc9d819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:09:59.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 0x7fc9d819fbc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c9b0 tx=0x7fc9c000ccc0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 -- 172.21.15.86:0/4064124804 shutdown_connections 2024-05-12T11:09:59.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d81084e0 0x7fc9d8199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9d806bbf0 0x7fc9d819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc9c40b2b10 0x7fc9c40b4fd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 --2- 172.21.15.86:0/4064124804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d806c5b0 0x7fc9d819fbc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:09:59.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 -- 172.21.15.86:0/4064124804 >> 172.21.15.86:0/4064124804 conn(0x7fc9d8079260 msgr2=0x7fc9d8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:09:59.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 -- 172.21.15.86:0/4064124804 shutdown_connections 2024-05-12T11:09:59.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:09:59.903+0000 7fc9de351700 1 -- 172.21.15.86:0/4064124804 wait complete. 2024-05-12T11:10:00.186 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:00 smithi086 ceph-mon[30110]: overall HEALTH_OK 2024-05-12T11:10:00.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:00 smithi172 ceph-mon[34517]: overall HEALTH_OK 2024-05-12T11:10:00.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:00 smithi176 ceph-mon[34357]: overall HEALTH_OK 2024-05-12T11:10:00.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-12T11:10:00.834 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:10:00.956 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:10:00 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:10:00.616+0000 7f2bcabb5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:10:00.956 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:10:00 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:10:00.616+0000 7f2bcabb5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:10:00.956 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:10:00 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:10:00.616+0000 7f2bcabb5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:10:00.956 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:10:00 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:10:00.616+0000 7f2bcabb5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:10:00.956 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:10:00 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:10:00.616+0000 7f2bcabb5700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-12T11:10:01.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:01 smithi086 ceph-mon[30110]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-05-12T11:10:01.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:01 smithi172 ceph-mon[34517]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-05-12T11:10:01.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:01 smithi176 ceph-mon[34357]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-05-12T11:10:02.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 -- 172.21.15.86:0/1289774137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc104100 msgr2=0x7f2adc108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 --2- 172.21.15.86:0/1289774137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc104100 0x7f2adc108120 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0099c0 tx=0x7f2acc009cd0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 -- 172.21.15.86:0/1289774137 shutdown_connections 2024-05-12T11:10:02.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 --2- 172.21.15.86:0/1289774137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2adc108850 0x7f2adc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 --2- 172.21.15.86:0/1289774137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc103750 0x7f2adc103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 --2- 172.21.15.86:0/1289774137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc104100 0x7f2adc108120 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 -- 172.21.15.86:0/1289774137 >> 172.21.15.86:0/1289774137 conn(0x7f2adc07a600 msgr2=0x7f2adc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:02.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 -- 172.21.15.86:0/1289774137 shutdown_connections 2024-05-12T11:10:02.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.640+0000 7f2ae43de700 1 -- 172.21.15.86:0/1289774137 wait complete. 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae43de700 1 Processor -- start 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae43de700 1 -- start start 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae43de700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc103750 0x7f2adc19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae43de700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc104100 0x7f2adc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae43de700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2adc108850 0x7f2adc199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae43de700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc113690 con 0x7f2adc103750 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae43de700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc113510 con 0x7f2adc108850 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae43de700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc113810 con 0x7f2adc104100 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae217a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc103750 0x7f2adc19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae217a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc103750 0x7f2adc19f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41868/0 (socket says 172.21.15.86:41868) 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae217a700 1 -- 172.21.15.86:0/3941696117 learned_addr learned my addr 172.21.15.86:0/3941696117 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc104100 0x7f2adc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae297b700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2adc108850 0x7f2adc199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae217a700 1 -- 172.21.15.86:0/3941696117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc104100 msgr2=0x7f2adc19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae217a700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc104100 0x7f2adc19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae217a700 1 -- 172.21.15.86:0/3941696117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2adc108850 msgr2=0x7f2adc199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae217a700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2adc108850 0x7f2adc199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.641+0000 7f2ae217a700 1 -- 172.21.15.86:0/3941696117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc19a0d0 con 0x7f2adc103750 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.642+0000 7f2ae217a700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc103750 0x7f2adc19f7b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800ada0 tx=0x7f2ad800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.642+0000 7f2ad37fe700 1 -- 172.21.15.86:0/3941696117 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8017020 con 0x7f2adc103750 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.642+0000 7f2ae43de700 1 -- 172.21.15.86:0/3941696117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2adc19a3c0 con 0x7f2adc103750 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.642+0000 7f2ad37fe700 1 -- 172.21.15.86:0/3941696117 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad800ce30 con 0x7f2adc103750 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.642+0000 7f2ad37fe700 1 -- 172.21.15.86:0/3941696117 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80055a0 con 0x7f2adc103750 2024-05-12T11:10:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.642+0000 7f2ae43de700 1 -- 172.21.15.86:0/3941696117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2adc1a6680 con 0x7f2adc103750 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.644+0000 7f2ad37fe700 1 -- 172.21.15.86:0/3941696117 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f2ad8004c40 con 0x7f2adc103750 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.645+0000 7f2ad37fe700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2ac80b2ba0 0x7f2ac80b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.645+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2ac80b2ba0 0x7f2ac80b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2ad37fe700 1 -- 172.21.15.86:0/3941696117 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f2ad80e2150 con 0x7f2adc103750 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2aeec71b80 1 Processor -- start 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2ac80b2ba0 0x7f2ac80b5060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2adc1030e0 tx=0x7f2acc01a040 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2aeec71b80 1 -- start start 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70693540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f7068d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7068dd00 0x561f7068e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561f705df8f0 con 0x561f70693160 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561f70544d50 con 0x561f7068dd00 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561f705db8b0 con 0x561f70693a80 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2ae217a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70693540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2ae217a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70693540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41870/0 (socket says 172.21.15.86:41870) 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.646+0000 7f2ae217a700 1 -- 172.21.15.86:0/1076296527 learned_addr learned my addr 172.21.15.86:0/1076296527 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae1979700 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f7068d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae297b700 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7068dd00 0x561f7068e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae217a700 1 -- 172.21.15.86:0/1076296527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 msgr2=0x561f7068d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae217a700 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f7068d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae217a700 1 -- 172.21.15.86:0/1076296527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7068dd00 msgr2=0x561f7068e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:02.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae217a700 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7068dd00 0x561f7068e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae217a700 1 -- 172.21.15.86:0/1076296527 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7052c880 con 0x561f70693160 2024-05-12T11:10:02.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae297b700 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7068dd00 0x561f7068e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:02.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae1979700 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f7068d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:02.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ae217a700 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70693540 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80060b0 tx=0x7f2ad80a8e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3c7e135e044101 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:02.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ad0d70700 1 -- 172.21.15.86:0/1076296527 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80c3070 con 0x561f70693160 2024-05-12T11:10:02.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ad0d70700 1 -- 172.21.15.86:0/1076296527 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad80ad630 con 0x561f70693160 2024-05-12T11:10:02.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.647+0000 7f2ad0d70700 1 -- 172.21.15.86:0/1076296527 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80ad370 con 0x561f70693160 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 -- 172.21.15.86:0/1076296527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 msgr2=0x561f70693540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70693540 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80060b0 tx=0x7f2ad80a8e10 comp rx=0 tx=0).stop 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 -- 172.21.15.86:0/1076296527 shutdown_connections 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7068dd00 0x561f7068e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70693540 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/1076296527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f7068d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 -- 172.21.15.86:0/1076296527 >> 172.21.15.86:0/1076296527 conn(0x561f705b9b20 msgr2=0x561f70688250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 -- 172.21.15.86:0/1076296527 shutdown_connections 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 -- 172.21.15.86:0/1076296527 wait complete. 2024-05-12T11:10:02.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 -- start start 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.648+0000 7f2aeec71b80 1 Processor -- start 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 0x561f706996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70696a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693a80 0x561f70696fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561f7069a400 con 0x561f70693160 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561f70598e80 con 0x561f70693a80 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561f7069a580 con 0x561f7068dd00 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2aeec71b80 10 client.0 _ll_register_callbacks cb 0x561f70573560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70696a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae217a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 0x561f706996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70696a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41872/0 (socket says 172.21.15.86:41872) 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 -- 172.21.15.86:0/3805326053 learned_addr learned my addr 172.21.15.86:0/3805326053 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae297b700 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693a80 0x561f70696fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 -- 172.21.15.86:0/3805326053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 msgr2=0x561f706996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 0x561f706996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 -- 172.21.15.86:0/3805326053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693a80 msgr2=0x561f70696fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693a80 0x561f70696fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 -- 172.21.15.86:0/3805326053 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f70596710 con 0x561f70693160 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae297b700 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693a80 0x561f70696fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70696a60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098e0 tx=0x7f2acc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61522402aa2d5c4b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3805326053 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc033060 con 0x561f70693160 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3805326053 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f2acc023820 con 0x561f70693160 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.649+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3805326053 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad80ad630 con 0x561f70693160 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3805326053 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2acc023a20 con 0x561f70693160 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2aeec71b80 10 client.15483 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3805326053 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561f706a4c40 con 0x561f70693160 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3805326053 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad80ad630 con 0x561f70693160 2024-05-12T11:10:02.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3805326053 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2acc02ecb0 con 0x561f70693160 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2aeec71b80 10 client.15483 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2aeec71b80 10 client.15483 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2aeec71b80 20 client.15483 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561f706a7260 0x561f706a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2aeec71b80 4 client.15483 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3805326053 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f705ed2d0 con 0x561f706a7260 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.650+0000 7f2ae217a700 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561f706a7260 0x561f706a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.651+0000 7f2ac5ffb700 10 client.15483 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.651+0000 7f2ae217a700 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561f706a7260 0x561f706a86d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba748b0f88dbed6d server_cookie=3e7c2a15196dee1c in_seq=0 out_seq=0 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.651+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3805326053 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561f705ed2d0 con 0x561f706a7260 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.651+0000 7f2ac5ffb700 10 client.15483 handle_command_reply: tid=0 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.651+0000 7f2aeec71b80 1 client.15483 shutdown 2024-05-12T11:10:02.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.651+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3805326053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 msgr2=0x561f70696a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.651+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70696a60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098e0 tx=0x7f2acc009cd0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3805326053 shutdown_connections 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561f706a7260 0x561f706a86d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2ac5ffb700 0 client.15483 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693a80 0x561f70696fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 0x561f706996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3805326053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693160 0x561f70696a60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3805326053 >> 172.21.15.86:0/3805326053 conn(0x561f705b9b20 msgr2=0x561f70682ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3805326053 shutdown_connections 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3805326053 wait complete. 2024-05-12T11:10:02.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.652+0000 7f2aeec71b80 20 client.15483 trim_cache size 0 max 16384 2024-05-12T11:10:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2aeec71b80 1 Processor -- start 2024-05-12T11:10:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2aeec71b80 1 -- start start 2024-05-12T11:10:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 0x561f70694570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f70682bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693a80 0x561f70691bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561f706a6a10 con 0x561f70693a80 2024-05-12T11:10:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561f706a70e0 con 0x561f70693160 2024-05-12T11:10:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561f706a77b0 con 0x561f7068dd00 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693a80 0x561f70691bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693a80 0x561f70691bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41888/0 (socket says 172.21.15.86:41888) 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 -- 172.21.15.86:0/2720765623 learned_addr learned my addr 172.21.15.86:0/2720765623 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae1979700 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f70682bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 -- 172.21.15.86:0/2720765623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 msgr2=0x561f70694570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 0x561f70694570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 -- 172.21.15.86:0/2720765623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 msgr2=0x561f70682bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f70682bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 -- 172.21.15.86:0/2720765623 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7068db00 con 0x561f70693a80 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae1979700 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f70682bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.673+0000 7f2ae297b700 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693a80 0x561f70691bc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400da70 tx=0x7f2ad400dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461d81c45df01d2c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2ac7fff700 1 -- 172.21.15.86:0/2720765623 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400fb40 con 0x561f70693a80 2024-05-12T11:10:02.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2ac7fff700 1 -- 172.21.15.86:0/2720765623 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad401a070 con 0x561f70693a80 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2ac7fff700 1 -- 172.21.15.86:0/2720765623 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40136c0 con 0x561f70693a80 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 -- 172.21.15.86:0/2720765623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693a80 msgr2=0x561f70691bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693a80 0x561f70691bc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400da70 tx=0x7f2ad400dd80 comp rx=0 tx=0).stop 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 -- 172.21.15.86:0/2720765623 shutdown_connections 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f70693a80 0x561f70691bc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f7068dd00 0x561f70694570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/2720765623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f70682bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 -- 172.21.15.86:0/2720765623 >> 172.21.15.86:0/2720765623 conn(0x561f705b9b20 msgr2=0x561f70693e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 -- 172.21.15.86:0/2720765623 shutdown_connections 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 -- 172.21.15.86:0/2720765623 wait complete. 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.674+0000 7f2aeec71b80 1 -- start start 2024-05-12T11:10:02.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2aeec71b80 1 Processor -- start 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f7068dd00 0x561f70682bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f706b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2aeec71b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f706b1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561f706a8550 con 0x561f7068dd00 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561f706a7e80 con 0x561f70693160 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2aeec71b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561f706a8c20 con 0x561f70693a80 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2aeec71b80 10 client.0 _ll_register_callbacks cb 0x561f70573560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f7068dd00 0x561f70682bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f7068dd00 0x561f70682bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41892/0 (socket says 172.21.15.86:41892) 2024-05-12T11:10:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 -- 172.21.15.86:0/3544321639 learned_addr learned my addr 172.21.15.86:0/3544321639 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f706b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae297b700 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f706b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 -- 172.21.15.86:0/3544321639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 msgr2=0x561f706b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f706b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 -- 172.21.15.86:0/3544321639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 msgr2=0x561f706b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f706b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 -- 172.21.15.86:0/3544321639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f706b1c40 con 0x561f7068dd00 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f706b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ae217a700 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f7068dd00 0x561f70682bd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8004bf0 tx=0x7f2ad80a5270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c3bcc97e337e00 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.675+0000 7f2ac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3544321639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80bc020 con 0x561f7068dd00 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3544321639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f2ad80b1bc0 con 0x561f7068dd00 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3544321639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad401a070 con 0x561f7068dd00 2024-05-12T11:10:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3544321639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ad80c3040 con 0x561f7068dd00 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 10 client.15489 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3544321639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561f707176e0 con 0x561f7068dd00 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3544321639 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad401a070 con 0x561f7068dd00 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3544321639 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2ad8012070 con 0x561f7068dd00 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 10 client.15489 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 10 client.15489 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 20 client.15489 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561f706a7260 0x561f7071aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 4 client.15489 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3544321639 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "status"}) -- 0x561f705e7370 con 0x561f706a7260 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.676+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561f706a7260 0x561f7071aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2ae1979700 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561f706a7260 0x561f7071aaa0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50444da2a779f167 server_cookie=58d31485b085e272 in_seq=0 out_seq=0 2024-05-12T11:10:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2ac5ffb700 10 client.15489 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2ac5ffb700 1 -- 172.21.15.86:0/3544321639 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561f705e7370 con 0x561f706a7260 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2ac5ffb700 10 client.15489 handle_command_reply: tid=0 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 client.15489 shutdown 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3544321639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f7068dd00 msgr2=0x561f70682bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f7068dd00 0x561f70682bd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8004bf0 tx=0x7f2ad80a5270 comp rx=0 tx=0).stop 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3544321639 shutdown_connections 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x561f706a7260 0x561f7071aaa0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f70693a80 0x561f706b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2ac5ffb700 0 client.15489 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f7068dd00 0x561f70682bd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 --2- 172.21.15.86:0/3544321639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f70693160 0x561f706b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3544321639 >> 172.21.15.86:0/3544321639 conn(0x561f705b9b20 msgr2=0x561f70694570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3544321639 shutdown_connections 2024-05-12T11:10:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 1 -- 172.21.15.86:0/3544321639 wait complete. 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.677+0000 7f2aeec71b80 20 client.15489 trim_cache size 0 max 16384 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "513c80a2-104e-11ef-bc98-c7b262605968", 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24466, 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 235.509077236, 2024-05-12T11:10:02.675 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 29, 2024-05-12T11:10:02.676 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 83, 2024-05-12T11:10:02.676 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 82, 2024-05-12T11:10:02.676 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 263.11422829000003 2024-05-12T11:10:02.676 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:10:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 -- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2ac80b2ba0 msgr2=0x7f2ac80b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2ac80b2ba0 0x7f2ac80b5060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2adc1030e0 tx=0x7f2acc01a040 comp rx=0 tx=0).stop 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 -- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc103750 msgr2=0x7f2adc19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc103750 0x7f2adc19f7b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800ada0 tx=0x7f2ad800c330 comp rx=0 tx=0).stop 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 -- 172.21.15.86:0/3941696117 shutdown_connections 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2adc108850 0x7f2adc199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f2ac80b2ba0 0x7f2ac80b5060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc103750 0x7f2adc19f7b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 --2- 172.21.15.86:0/3941696117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc104100 0x7f2adc19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 -- 172.21.15.86:0/3941696117 >> 172.21.15.86:0/3941696117 conn(0x7f2adc07a600 msgr2=0x7f2adc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 -- 172.21.15.86:0/3941696117 shutdown_connections 2024-05-12T11:10:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:02.678+0000 7f2ae43de700 1 -- 172.21.15.86:0/3941696117 wait complete. 2024-05-12T11:10:03.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:03 smithi086 ceph-mon[30110]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-05-12T11:10:03.212 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:03 smithi086 ceph-mon[30110]: mgrmap e25: x(active, since 38s), standbys: y, z 2024-05-12T11:10:03.402 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-12T11:10:03.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:03 smithi172 ceph-mon[34517]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-05-12T11:10:03.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:03 smithi172 ceph-mon[34517]: mgrmap e25: x(active, since 38s), standbys: y, z 2024-05-12T11:10:03.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:03 smithi176 ceph-mon[34357]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-05-12T11:10:03.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:03 smithi176 ceph-mon[34357]: mgrmap e25: x(active, since 38s), standbys: y, z 2024-05-12T11:10:05.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:05 smithi086 ceph-mon[30110]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-12T11:10:05.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:05 smithi172 ceph-mon[34517]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-12T11:10:05.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:05 smithi176 ceph-mon[34357]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-12T11:10:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 -- 172.21.15.86:0/2873860777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 msgr2=0x7fd54c107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 --2- 172.21.15.86:0/2873860777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 0x7fd54c107ca0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd548009930 tx=0x7fd54802a420 comp rx=0 tx=0).stop 2024-05-12T11:10:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 -- 172.21.15.86:0/2873860777 shutdown_connections 2024-05-12T11:10:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 --2- 172.21.15.86:0/2873860777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54c1022c0 0x7fd54c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 --2- 172.21.15.86:0/2873860777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd54c101900 0x7fd54c101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 --2- 172.21.15.86:0/2873860777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 0x7fd54c107ca0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 -- 172.21.15.86:0/2873860777 >> 172.21.15.86:0/2873860777 conn(0x7fd54c078a00 msgr2=0x7fd54c078e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 -- 172.21.15.86:0/2873860777 shutdown_connections 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.869+0000 7fd553387640 1 -- 172.21.15.86:0/2873860777 wait complete. 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd553387640 1 Processor -- start 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd553387640 1 -- start start 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd553387640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54c101900 0x7fd54c199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd553387640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd54c1022c0 0x7fd54c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd553387640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 0x7fd54c19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd553387640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c111b40 con 0x7fd54c1078c0 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd553387640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c1119c0 con 0x7fd54c101900 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd553387640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c111cc0 con 0x7fd54c1022c0 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd551924640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 0x7fd54c19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd551924640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 0x7fd54c19d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41916/0 (socket says 172.21.15.86:41916) 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd551924640 1 -- 172.21.15.86:0/175959603 learned_addr learned my addr 172.21.15.86:0/175959603 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd551123640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54c101900 0x7fd54c199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.870+0000 7fd550922640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd54c1022c0 0x7fd54c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd551924640 1 -- 172.21.15.86:0/175959603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd54c1022c0 msgr2=0x7fd54c199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd551924640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd54c1022c0 0x7fd54c199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd551924640 1 -- 172.21.15.86:0/175959603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54c101900 msgr2=0x7fd54c199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd551924640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54c101900 0x7fd54c199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd551924640 1 -- 172.21.15.86:0/175959603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c19e100 con 0x7fd54c1078c0 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd550922640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd54c1022c0 0x7fd54c199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd551924640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 0x7fd54c19d9d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd54400eb10 tx=0x7fd54400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd5427fc640 1 -- 172.21.15.86:0/175959603 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544004b20 con 0x7fd54c1078c0 2024-05-12T11:10:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd553387640 1 -- 172.21.15.86:0/175959603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c19e3f0 con 0x7fd54c1078c0 2024-05-12T11:10:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd5427fc640 1 -- 172.21.15.86:0/175959603 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd544004cc0 con 0x7fd54c1078c0 2024-05-12T11:10:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd5427fc640 1 -- 172.21.15.86:0/175959603 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544010670 con 0x7fd54c1078c0 2024-05-12T11:10:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.871+0000 7fd553387640 1 -- 172.21.15.86:0/175959603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c1a5c80 con 0x7fd54c1078c0 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd556177740 1 Processor -- start 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd5427fc640 1 -- 172.21.15.86:0/175959603 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7fd544005020 con 0x7fd54c1078c0 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd556177740 1 -- start start 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd556177740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd556177740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5febb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd556177740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b6014e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd556177740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55774b5595d0 con 0x55774b5f3f10 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd556177740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55774b512890 con 0x55774b5f4830 2024-05-12T11:10:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd556177740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55774b555590 con 0x55774b5ff0f0 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.874+0000 7fd550922640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41932/0 (socket says 172.21.15.86:41932) 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 -- 172.21.15.86:0/2505395981 learned_addr learned my addr 172.21.15.86:0/2505395981 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd551123640 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5febb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b6014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 -- 172.21.15.86:0/2505395981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 msgr2=0x55774b6014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b6014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 -- 172.21.15.86:0/2505395981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 msgr2=0x55774b5febb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5febb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 -- 172.21.15.86:0/2505395981 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55774b26b210 con 0x55774b5f3f10 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd5427fc640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd5380b2bb0 0x7fd5380b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd550922640 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5f42f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd53c005d00 tx=0x7fd53c009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f0525d0f9eb74c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd551123640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd5380b2bb0 0x7fd5380b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd5377fe640 1 -- 172.21.15.86:0/2505395981 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c017070 con 0x55774b5f3f10 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd5427fc640 1 -- 172.21.15.86:0/175959603 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fd5440e2e80 con 0x7fd54c1078c0 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd5377fe640 1 -- 172.21.15.86:0/2505395981 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd53c0035f0 con 0x55774b5f3f10 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.875+0000 7fd5377fe640 1 -- 172.21.15.86:0/2505395981 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c013620 con 0x55774b5f3f10 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 -- 172.21.15.86:0/2505395981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 msgr2=0x55774b5f42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5f42f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd53c005d00 tx=0x7fd53c009670 comp rx=0 tx=0).stop 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd551123640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd5380b2bb0 0x7fd5380b5070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd548009900 tx=0x7fd548005fd0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 -- 172.21.15.86:0/2505395981 shutdown_connections 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b6014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5febb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 --2- 172.21.15.86:0/2505395981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5f42f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 -- 172.21.15.86:0/2505395981 >> 172.21.15.86:0/2505395981 conn(0x55774b5f0420 msgr2=0x55774b5f0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 -- 172.21.15.86:0/2505395981 shutdown_connections 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 -- 172.21.15.86:0/2505395981 wait complete. 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 -- start start 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.876+0000 7fd556177740 1 Processor -- start 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd556177740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd556177740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd556177740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b5fcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd556177740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55774b601d20 con 0x55774b5f3f10 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd556177740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55774b516370 con 0x55774b5f4830 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd556177740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55774b601ea0 con 0x55774b5ff0f0 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd556177740 10 client.0 _ll_register_callbacks cb 0x55774b26aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551123640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551123640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5fc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41936/0 (socket says 172.21.15.86:41936) 2024-05-12T11:10:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551123640 1 -- 172.21.15.86:0/1870827280 learned_addr learned my addr 172.21.15.86:0/1870827280 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551924640 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b5fcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd550922640 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551123640 1 -- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 msgr2=0x55774b5fcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551123640 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b5fcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551123640 1 -- 172.21.15.86:0/1870827280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 msgr2=0x55774b5fc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551123640 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551123640 1 -- 172.21.15.86:0/1870827280 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55774b337620 con 0x55774b5f3f10 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.877+0000 7fd551924640 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b5fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd551123640 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5fc020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd548033000 tx=0x7fd54802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b5df989600035b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd534ff9640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd534ff9640 1 -- 172.21.15.86:0/1870827280 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54804c070 con 0x55774b5f3f10 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd534ff9640 1 -- 172.21.15.86:0/1870827280 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fd5480037f0 con 0x55774b5f3f10 2024-05-12T11:10:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 1 -- 172.21.15.86:0/1870827280 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd53c0035f0 con 0x55774b5f3f10 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd534ff9640 1 -- 172.21.15.86:0/1870827280 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd548058050 con 0x55774b5f3f10 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 10 client.15501 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 1 -- 172.21.15.86:0/1870827280 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55774b60db90 con 0x55774b5f3f10 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd534ff9640 1 -- 172.21.15.86:0/1870827280 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd53c0035f0 con 0x55774b5f3f10 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd534ff9640 1 -- 172.21.15.86:0/1870827280 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd548048b40 con 0x55774b5f3f10 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 10 client.15501 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 20 client.15501 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55774b60f0c0 0x55774b6114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 4 client.15501 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.878+0000 7fd556177740 1 -- 172.21.15.86:0/1870827280 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55774b5671e0 con 0x55774b60f0c0 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.879+0000 7fd550922640 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55774b60f0c0 0x55774b6114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.879+0000 7fd550922640 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55774b60f0c0 0x55774b6114b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4138e5caf83d5da server_cookie=cd0d8c61b4c3db81 in_seq=0 out_seq=0 2024-05-12T11:10:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.879+0000 7fd534ff9640 10 client.15501 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd534ff9640 1 -- 172.21.15.86:0/1870827280 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55774b5671e0 con 0x55774b60f0c0 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd534ff9640 10 client.15501 handle_command_reply: tid=0 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 client.15501 shutdown 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 -- 172.21.15.86:0/1870827280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 msgr2=0x55774b5fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5fc020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd548033000 tx=0x7fd54802a420 comp rx=0 tx=0).stop 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 -- 172.21.15.86:0/1870827280 shutdown_connections 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55774b60f0c0 0x55774b6114b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5ff0f0 0x55774b5fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd534ff9640 0 client.15501 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 --2- 172.21.15.86:0/1870827280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5f3f10 0x55774b5fc020 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 -- 172.21.15.86:0/1870827280 >> 172.21.15.86:0/1870827280 conn(0x55774b5f0420 msgr2=0x55774b5f61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 -- 172.21.15.86:0/1870827280 shutdown_connections 2024-05-12T11:10:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 1 -- 172.21.15.86:0/1870827280 wait complete. 2024-05-12T11:10:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.880+0000 7fd556177740 20 client.15501 trim_cache size 0 max 16384 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd556177740 1 Processor -- start 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd556177740 1 -- start start 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd556177740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 0x55774b5f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd556177740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd556177740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b616da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd556177740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c1ae670 con 0x55774b5ff0f0 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd556177740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c1b01b0 con 0x55774b5f4830 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd556177740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c1aed40 con 0x55774b5f3f10 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd551924640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b616da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd551924640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b616da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41948/0 (socket says 172.21.15.86:41948) 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.895+0000 7fd551924640 1 -- 172.21.15.86:0/2929165759 learned_addr learned my addr 172.21.15.86:0/2929165759 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd550922640 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd551924640 1 -- 172.21.15.86:0/2929165759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 msgr2=0x55774b5f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd551123640 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 0x55774b5f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd551924640 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 0x55774b5f68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd551924640 1 -- 172.21.15.86:0/2929165759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 msgr2=0x55774b5fc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd551924640 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd551924640 1 -- 172.21.15.86:0/2929165759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55774b5f6e10 con 0x55774b5ff0f0 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd550922640 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd551924640 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b616da0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd5440e0480 tx=0x7fd5440a9870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fc1ad6e49f26d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd536ffd640 1 -- 172.21.15.86:0/2929165759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5440c4020 con 0x55774b5ff0f0 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd536ffd640 1 -- 172.21.15.86:0/2929165759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5440aa620 con 0x55774b5ff0f0 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.896+0000 7fd536ffd640 1 -- 172.21.15.86:0/2929165759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5440aa3e0 con 0x55774b5ff0f0 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- 172.21.15.86:0/2929165759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 msgr2=0x55774b616da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b616da0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd5440e0480 tx=0x7fd5440a9870 comp rx=0 tx=0).stop 2024-05-12T11:10:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- 172.21.15.86:0/2929165759 shutdown_connections 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b616da0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b5fc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 --2- 172.21.15.86:0/2929165759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 0x55774b5f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- 172.21.15.86:0/2929165759 >> 172.21.15.86:0/2929165759 conn(0x55774b5f0420 msgr2=0x55774b5ef580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- 172.21.15.86:0/2929165759 shutdown_connections 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- 172.21.15.86:0/2929165759 wait complete. 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- start start 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 Processor -- start 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 0x55774b6075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b602950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b602e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c1afae0 con 0x55774b5ff0f0 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c1af410 con 0x55774b5f4830 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c1ac650 con 0x55774b5f3f10 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.897+0000 7fd556177740 10 client.0 _ll_register_callbacks cb 0x7fd548009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b602e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b602e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41964/0 (socket says 172.21.15.86:41964) 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 -- 172.21.15.86:0/1246922222 learned_addr learned my addr 172.21.15.86:0/1246922222 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551123640 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 0x55774b6075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd550922640 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b602950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 -- 172.21.15.86:0/1246922222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 msgr2=0x55774b6075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 0x55774b6075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 -- 172.21.15.86:0/1246922222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 msgr2=0x55774b602950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b602950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 -- 172.21.15.86:0/1246922222 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55774b603660 con 0x55774b5ff0f0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd551924640 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b602e90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd5440e04d0 tx=0x7fd5440b2b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19364ace11f9650f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd534ff9640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd534ff9640 1 -- 172.21.15.86:0/1246922222 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5440c4040 con 0x55774b5ff0f0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd534ff9640 1 -- 172.21.15.86:0/1246922222 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fd5440a6510 con 0x55774b5ff0f0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd556177740 1 -- 172.21.15.86:0/1246922222 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5440aa620 con 0x55774b5ff0f0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd534ff9640 1 -- 172.21.15.86:0/1246922222 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd5440ae2d0 con 0x55774b5ff0f0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd556177740 10 client.15507 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd556177740 1 -- 172.21.15.86:0/1246922222 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55774b679900 con 0x55774b5ff0f0 2024-05-12T11:10:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.898+0000 7fd534ff9640 1 -- 172.21.15.86:0/1246922222 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5440aa620 con 0x55774b5ff0f0 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd534ff9640 1 -- 172.21.15.86:0/1246922222 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd5440a59b0 con 0x55774b5ff0f0 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd556177740 10 client.15507 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd556177740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd556177740 20 client.15507 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd556177740 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55774b679fa0 0x55774b67c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd556177740 4 client.15507 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd556177740 1 -- 172.21.15.86:0/1246922222 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55774b561050 con 0x55774b679fa0 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd551123640 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55774b679fa0 0x55774b67c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd551123640 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55774b679fa0 0x55774b67c3c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14ab2b1310858358 server_cookie=971be948f67430a5 in_seq=0 out_seq=0 2024-05-12T11:10:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.899+0000 7fd534ff9640 10 client.15507 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd534ff9640 1 -- 172.21.15.86:0/1246922222 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55774b561050 con 0x55774b679fa0 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd534ff9640 10 client.15507 handle_command_reply: tid=0 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 client.15507 shutdown 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 -- 172.21.15.86:0/1246922222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 msgr2=0x55774b602e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b602e90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd5440e04d0 tx=0x7fd5440b2b20 comp rx=0 tx=0).stop 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 -- 172.21.15.86:0/1246922222 shutdown_connections 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55774b679fa0 0x55774b67c3c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55774b5ff0f0 0x55774b602e90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd534ff9640 0 client.15507 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55774b5f4830 0x55774b602950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 --2- 172.21.15.86:0/1246922222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55774b5f3f10 0x55774b6075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 -- 172.21.15.86:0/1246922222 >> 172.21.15.86:0/1246922222 conn(0x55774b5f0420 msgr2=0x55774b609d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 -- 172.21.15.86:0/1246922222 shutdown_connections 2024-05-12T11:10:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 1 -- 172.21.15.86:0/1246922222 wait complete. 2024-05-12T11:10:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.907+0000 7fd556177740 20 client.15507 trim_cache size 0 max 16384 2024-05-12T11:10:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:10:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:10:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:10:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:10:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 -- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd5380b2bb0 msgr2=0x7fd5380b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd5380b2bb0 0x7fd5380b5070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd548009900 tx=0x7fd548005fd0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 -- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 msgr2=0x7fd54c19d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 0x7fd54c19d9d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd54400eb10 tx=0x7fd54400c2d0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 -- 172.21.15.86:0/175959603 shutdown_connections 2024-05-12T11:10:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd5380b2bb0 0x7fd5380b5070 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c1078c0 0x7fd54c19d9d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd54c1022c0 0x7fd54c199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 --2- 172.21.15.86:0/175959603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54c101900 0x7fd54c199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 -- 172.21.15.86:0/175959603 >> 172.21.15.86:0/175959603 conn(0x7fd54c078a00 msgr2=0x7fd54c06af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 -- 172.21.15.86:0/175959603 shutdown_connections 2024-05-12T11:10:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:06.908+0000 7fd553387640 1 -- 172.21.15.86:0/175959603 wait complete. 2024-05-12T11:10:07.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:07 smithi086 ceph-mon[30110]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-05-12T11:10:07.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:07 smithi172 ceph-mon[34517]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-05-12T11:10:07.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:07 smithi176 ceph-mon[34357]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-05-12T11:10:09.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:09 smithi086 ceph-mon[30110]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-12T11:10:09.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:09 smithi172 ceph-mon[34517]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-12T11:10:09.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:09 smithi176 ceph-mon[34357]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-12T11:10:11.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:11 smithi086 ceph-mon[30110]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-12T11:10:11.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:11 smithi172 ceph-mon[34517]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-12T11:10:11.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:11 smithi176 ceph-mon[34357]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-12T11:10:13.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:13 smithi086 ceph-mon[30110]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-05-12T11:10:13.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:13 smithi172 ceph-mon[34517]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-05-12T11:10:13.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:13 smithi176 ceph-mon[34357]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-05-12T11:10:15.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:15 smithi086 ceph-mon[30110]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-05-12T11:10:15.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:15 smithi172 ceph-mon[34517]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-05-12T11:10:15.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:15 smithi176 ceph-mon[34357]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-05-12T11:10:17.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:17 smithi086 ceph-mon[30110]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-12T11:10:17.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:17 smithi172 ceph-mon[34517]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-12T11:10:17.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:17 smithi176 ceph-mon[34357]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-12T11:10:18.403 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-12T11:10:18.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:10:18.670 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:10:19.461 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:19 smithi086 ceph-mon[30110]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:19.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:19 smithi172 ceph-mon[34517]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:19.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:19 smithi176 ceph-mon[34357]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 -- 172.21.15.86:0/1145258854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 msgr2=0x7f6748108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1145258854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 0x7f6748108db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f673c009930 tx=0x7f673c02a420 comp rx=0 tx=0).stop 2024-05-12T11:10:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 -- 172.21.15.86:0/1145258854 shutdown_connections 2024-05-12T11:10:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1145258854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6748103380 0x7f674810f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1145258854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67481029c0 0x7f6748102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1145258854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 0x7f6748108db0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 -- 172.21.15.86:0/1145258854 >> 172.21.15.86:0/1145258854 conn(0x7f6748079e40 msgr2=0x7f674807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 -- 172.21.15.86:0/1145258854 shutdown_connections 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.002+0000 7f674ed0a640 1 -- 172.21.15.86:0/1145258854 wait complete. 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674ed0a640 1 Processor -- start 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674ed0a640 1 -- start start 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674ed0a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67481029c0 0x7f6748199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674ed0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6748103380 0x7f67481995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674ed0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 0x7f674819d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674ed0a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6748112c90 con 0x7f67481089d0 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674ed0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6748112b10 con 0x7f6748103380 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674ed0a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6748112e10 con 0x7f67481029c0 2024-05-12T11:10:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674d2a7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 0x7f674819d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674d2a7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 0x7f674819d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42082/0 (socket says 172.21.15.86:42082) 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674d2a7640 1 -- 172.21.15.86:0/1707056253 learned_addr learned my addr 172.21.15.86:0/1707056253 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674caa6640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67481029c0 0x7f6748199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f6747fff640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6748103380 0x7f67481995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674d2a7640 1 -- 172.21.15.86:0/1707056253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67481029c0 msgr2=0x7f6748199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674d2a7640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67481029c0 0x7f6748199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674d2a7640 1 -- 172.21.15.86:0/1707056253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6748103380 msgr2=0x7f67481995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674d2a7640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6748103380 0x7f67481995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f674d2a7640 1 -- 172.21.15.86:0/1707056253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674819e060 con 0x7f67481089d0 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.003+0000 7f6747fff640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6748103380 0x7f67481995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.004+0000 7f674d2a7640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 0x7f674819d930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f674000e960 tx=0x7f674000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.004+0000 7f6745ffb640 1 -- 172.21.15.86:0/1707056253 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740004d20 con 0x7f67481089d0 2024-05-12T11:10:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.004+0000 7f674ed0a640 1 -- 172.21.15.86:0/1707056253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674819e350 con 0x7f67481089d0 2024-05-12T11:10:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.004+0000 7f6745ffb640 1 -- 172.21.15.86:0/1707056253 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6740005020 con 0x7f67481089d0 2024-05-12T11:10:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.004+0000 7f6745ffb640 1 -- 172.21.15.86:0/1707056253 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400116d0 con 0x7f67481089d0 2024-05-12T11:10:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.004+0000 7f674ed0a640 1 -- 172.21.15.86:0/1707056253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67481a5be0 con 0x7f67481089d0 2024-05-12T11:10:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.006+0000 7f6745ffb640 1 -- 172.21.15.86:0/1707056253 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f67400054a0 con 0x7f67481089d0 2024-05-12T11:10:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.006+0000 7f6751a23740 1 Processor -- start 2024-05-12T11:10:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.006+0000 7f6751a23740 1 -- start start 2024-05-12T11:10:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6751a23740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb7370b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6751a23740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370b830 0x55bb73715bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6751a23740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb737184e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6751a23740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bb736705d0 con 0x55bb737160f0 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6751a23740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bb73629890 con 0x55bb7370b830 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6751a23740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bb7366c590 con 0x55bb7370af10 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6745ffb640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f67380b2bb0 0x7f67380b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb737184e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb737184e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42084/0 (socket says 172.21.15.86:42084) 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 -- 172.21.15.86:0/2749246909 learned_addr learned my addr 172.21.15.86:0/2749246909 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb7370b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f674caa6640 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370b830 0x55bb73715bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f674d2a7640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f67380b2bb0 0x7f67380b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 -- 172.21.15.86:0/2749246909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 msgr2=0x55bb7370b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb7370b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6745ffb640 1 -- 172.21.15.86:0/1707056253 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f67400e2ca0 con 0x7f67481089d0 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 -- 172.21.15.86:0/2749246909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370b830 msgr2=0x55bb73715bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370b830 0x55bb73715bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 -- 172.21.15.86:0/2749246909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb73382210 con 0x55bb737160f0 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f6747fff640 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb737184e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6734012570 tx=0x7f673400b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a2e62ae8e1a0f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.007+0000 7f674d2a7640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f67380b2bb0 0x7f67380b5070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67400e0210 tx=0x7f6740076670 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6732ffd640 1 -- 172.21.15.86:0/2749246909 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734004260 con 0x55bb737160f0 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6732ffd640 1 -- 172.21.15.86:0/2749246909 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6734004400 con 0x55bb737160f0 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6732ffd640 1 -- 172.21.15.86:0/2749246909 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734004d60 con 0x55bb737160f0 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 -- 172.21.15.86:0/2749246909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 msgr2=0x55bb737184e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb737184e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6734012570 tx=0x7f673400b500 comp rx=0 tx=0).stop 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 -- 172.21.15.86:0/2749246909 shutdown_connections 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb737184e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370b830 0x55bb73715bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 --2- 172.21.15.86:0/2749246909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb7370b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 -- 172.21.15.86:0/2749246909 >> 172.21.15.86:0/2749246909 conn(0x55bb73707420 msgr2=0x55bb73707800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 -- 172.21.15.86:0/2749246909 shutdown_connections 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.008+0000 7f6751a23740 1 -- 172.21.15.86:0/2749246909 wait complete. 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 1 -- start start 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 1 Processor -- start 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb73712ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb73713530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb737160f0 0x55bb73713a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bb73718d20 con 0x55bb7370b830 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bb7362d370 con 0x55bb737160f0 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bb73718ea0 con 0x55bb7370af10 2024-05-12T11:10:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6751a23740 10 client.0 _ll_register_callbacks cb 0x55bb73381a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f674caa6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb73713530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f674caa6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb73713530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42088/0 (socket says 172.21.15.86:42088) 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f674caa6640 1 -- 172.21.15.86:0/337124131 learned_addr learned my addr 172.21.15.86:0/337124131 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.009+0000 7f6747fff640 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb737160f0 0x55bb73713a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f674caa6640 1 -- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 msgr2=0x55bb73712ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6747fff640 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb73712ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f674caa6640 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb73712ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f674caa6640 1 -- 172.21.15.86:0/337124131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb737160f0 msgr2=0x55bb73713a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f674caa6640 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb737160f0 0x55bb73713a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f674caa6640 1 -- 172.21.15.86:0/337124131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb7344e620 con 0x55bb7370b830 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6747fff640 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb73712ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f674caa6640 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb73713530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f673c009930 tx=0x7f673c0314c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820133c831daa0b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6727fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6727fff640 1 -- 172.21.15.86:0/337124131 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c035040 con 0x55bb7370b830 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6727fff640 1 -- 172.21.15.86:0/337124131 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f673c004040 con 0x55bb7370b830 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6751a23740 1 -- 172.21.15.86:0/337124131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6734004400 con 0x55bb7370b830 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6727fff640 1 -- 172.21.15.86:0/337124131 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f673c0318f0 con 0x55bb7370b830 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6751a23740 10 client.15519 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6751a23740 1 -- 172.21.15.86:0/337124131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bb73724b90 con 0x55bb7370b830 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6727fff640 1 -- 172.21.15.86:0/337124131 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6734004400 con 0x55bb7370b830 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6727fff640 1 -- 172.21.15.86:0/337124131 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f673c046480 con 0x55bb7370b830 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6751a23740 10 client.15519 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6751a23740 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.010+0000 7f6751a23740 20 client.15519 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.011+0000 7f6751a23740 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55bb737260a0 0x55bb73728490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.011+0000 7f6751a23740 4 client.15519 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.011+0000 7f6751a23740 1 -- 172.21.15.86:0/337124131 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb7367e1e0 con 0x55bb737260a0 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.011+0000 7f6747fff640 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55bb737260a0 0x55bb73728490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.011+0000 7f6727fff640 10 client.15519 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.011+0000 7f6747fff640 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55bb737260a0 0x55bb73728490 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77846ff851964a2c server_cookie=fa182d952a548063 in_seq=0 out_seq=0 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6727fff640 1 -- 172.21.15.86:0/337124131 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bb7367e1e0 con 0x55bb737260a0 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6727fff640 10 client.15519 handle_command_reply: tid=0 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 client.15519 shutdown 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 -- 172.21.15.86:0/337124131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 msgr2=0x55bb73713530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb73713530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f673c009930 tx=0x7f673c0314c0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 -- 172.21.15.86:0/337124131 shutdown_connections 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55bb737260a0 0x55bb73728490 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb737160f0 0x55bb73713a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb73713530 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6727fff640 0 client.15519 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 --2- 172.21.15.86:0/337124131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370af10 0x55bb73712ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 -- 172.21.15.86:0/337124131 >> 172.21.15.86:0/337124131 conn(0x55bb73707420 msgr2=0x55bb7370d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 -- 172.21.15.86:0/337124131 shutdown_connections 2024-05-12T11:10:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 1 -- 172.21.15.86:0/337124131 wait complete. 2024-05-12T11:10:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.012+0000 7f6751a23740 20 client.15519 trim_cache size 0 max 16384 2024-05-12T11:10:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.028+0000 7f6751a23740 1 Processor -- start 2024-05-12T11:10:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.028+0000 7f6751a23740 1 -- start start 2024-05-12T11:10:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.028+0000 7f6751a23740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb73722260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.028+0000 7f6751a23740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370b830 0x55bb7372dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.028+0000 7f6751a23740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb7372e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.028+0000 7f6751a23740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67481ae510 con 0x55bb737160f0 2024-05-12T11:10:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.028+0000 7f6751a23740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67481b0050 con 0x55bb7370af10 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.028+0000 7f6751a23740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67481aebe0 con 0x55bb7370b830 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb7372e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb7372e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42098/0 (socket says 172.21.15.86:42098) 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 -- 172.21.15.86:0/3867846546 learned_addr learned my addr 172.21.15.86:0/3867846546 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f674caa6640 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370b830 0x55bb7372dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb73722260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 -- 172.21.15.86:0/3867846546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370b830 msgr2=0x55bb7372dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370b830 0x55bb7372dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 -- 172.21.15.86:0/3867846546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 msgr2=0x55bb73722260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb73722260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 -- 172.21.15.86:0/3867846546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7370b660 con 0x55bb737160f0 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f6747fff640 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb7372e2a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6734004a30 tx=0x7f673401f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c00c5875d4fcad2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f67327fc640 1 -- 172.21.15.86:0/3867846546 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673402ce60 con 0x55bb737160f0 2024-05-12T11:10:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f67327fc640 1 -- 172.21.15.86:0/3867846546 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f673402a7d0 con 0x55bb737160f0 2024-05-12T11:10:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.029+0000 7f67327fc640 1 -- 172.21.15.86:0/3867846546 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734003a10 con 0x55bb737160f0 2024-05-12T11:10:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 -- 172.21.15.86:0/3867846546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 msgr2=0x55bb7372e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb7372e2a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6734004a30 tx=0x7f673401f040 comp rx=0 tx=0).stop 2024-05-12T11:10:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 -- 172.21.15.86:0/3867846546 shutdown_connections 2024-05-12T11:10:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb737160f0 0x55bb7372e2a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb7370b830 0x55bb7372dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 --2- 172.21.15.86:0/3867846546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb73722260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 -- 172.21.15.86:0/3867846546 >> 172.21.15.86:0/3867846546 conn(0x55bb73707420 msgr2=0x55bb737023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 -- 172.21.15.86:0/3867846546 shutdown_connections 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 -- 172.21.15.86:0/3867846546 wait complete. 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.030+0000 7f6751a23740 1 -- start start 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6751a23740 1 Processor -- start 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6751a23740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb7371e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6751a23740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb7370fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6751a23740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb737160f0 0x55bb7370ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6751a23740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67481af980 con 0x55bb7370b830 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6751a23740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67481af2b0 con 0x55bb7370af10 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6751a23740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67481ac4f0 con 0x55bb737160f0 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6751a23740 10 client.0 _ll_register_callbacks cb 0x7f673c031cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f674caa6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb7370fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f674caa6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb7370fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42114/0 (socket says 172.21.15.86:42114) 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f674caa6640 1 -- 172.21.15.86:0/1221607076 learned_addr learned my addr 172.21.15.86:0/1221607076 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6747fff640 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb737160f0 0x55bb7370ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6747fff640 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb7371e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f674caa6640 1 -- 172.21.15.86:0/1221607076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb737160f0 msgr2=0x55bb7370ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f674caa6640 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb737160f0 0x55bb7370ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f674caa6640 1 -- 172.21.15.86:0/1221607076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 msgr2=0x55bb7371e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f674caa6640 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb7371e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f674caa6640 1 -- 172.21.15.86:0/1221607076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb73710630 con 0x55bb7370b830 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.031+0000 7f6747fff640 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb7371e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f674caa6640 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb7370fa00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f673c006010 tx=0x7f673c0466b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804ffdd486056c16 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6727fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6727fff640 1 -- 172.21.15.86:0/1221607076 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c053040 con 0x55bb7370b830 2024-05-12T11:10:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6727fff640 1 -- 172.21.15.86:0/1221607076 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f673c046a90 con 0x55bb7370b830 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 1 -- 172.21.15.86:0/1221607076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f673402a7d0 con 0x55bb7370b830 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6727fff640 1 -- 172.21.15.86:0/1221607076 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f673c064050 con 0x55bb7370b830 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 10 client.15525 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 1 -- 172.21.15.86:0/1221607076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bb73790810 con 0x55bb7370b830 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6727fff640 1 -- 172.21.15.86:0/1221607076 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f673402a7d0 con 0x55bb7370b830 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6727fff640 1 -- 172.21.15.86:0/1221607076 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f673c05f030 con 0x55bb7370b830 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 10 client.15525 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 20 client.15525 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55bb73790fe0 0x55bb73793400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 4 client.15525 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.032+0000 7f6751a23740 1 -- 172.21.15.86:0/1221607076 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb73678050 con 0x55bb73790fe0 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.033+0000 7f6747fff640 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55bb73790fe0 0x55bb73793400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.033+0000 7f6727fff640 10 client.15525 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.033+0000 7f6747fff640 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55bb73790fe0 0x55bb73793400 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcbc5d1c721c551e server_cookie=b3e8cedd2329a89d in_seq=0 out_seq=0 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6727fff640 1 -- 172.21.15.86:0/1221607076 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb73678050 con 0x55bb73790fe0 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6727fff640 10 client.15525 handle_command_reply: tid=0 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 client.15525 shutdown 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 -- 172.21.15.86:0/1221607076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 msgr2=0x55bb7370fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb7370fa00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f673c006010 tx=0x7f673c0466b0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 -- 172.21.15.86:0/1221607076 shutdown_connections 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55bb73790fe0 0x55bb73793400 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb737160f0 0x55bb7370ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6727fff640 0 client.15525 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb7370b830 0x55bb7370fa00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 --2- 172.21.15.86:0/1221607076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb7370af10 0x55bb7371e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 -- 172.21.15.86:0/1221607076 >> 172.21.15.86:0/1221607076 conn(0x55bb73707420 msgr2=0x55bb73714820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 -- 172.21.15.86:0/1221607076 shutdown_connections 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 1 -- 172.21.15.86:0/1221607076 wait complete. 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.037+0000 7f6751a23740 20 client.15525 trim_cache size 0 max 16384 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 -- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f67380b2bb0 msgr2=0x7f67380b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f67380b2bb0 0x7f67380b5070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67400e0210 tx=0x7f6740076670 comp rx=0 tx=0).stop 2024-05-12T11:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 -- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 msgr2=0x7f674819d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 0x7f674819d930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f674000e960 tx=0x7f674000ee20 comp rx=0 tx=0).stop 2024-05-12T11:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 -- 172.21.15.86:0/1707056253 shutdown_connections 2024-05-12T11:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f67380b2bb0 0x7f67380b5070 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67481089d0 0x7f674819d930 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6748103380 0x7f67481995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 --2- 172.21.15.86:0/1707056253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67481029c0 0x7f6748199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 -- 172.21.15.86:0/1707056253 >> 172.21.15.86:0/1707056253 conn(0x7f6748079e40 msgr2=0x7f6748100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 -- 172.21.15.86:0/1707056253 shutdown_connections 2024-05-12T11:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:20.038+0000 7f674ed0a640 1 -- 172.21.15.86:0/1707056253 wait complete. 2024-05-12T11:10:20.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 -- 172.21.15.86:0/1963569056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c108450 msgr2=0x7f6e5c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 --2- 172.21.15.86:0/1963569056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c108450 0x7f6e5c108830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009990 tx=0x7f6e50009ca0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 -- 172.21.15.86:0/1963569056 shutdown_connections 2024-05-12T11:10:20.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 --2- 172.21.15.86:0/1963569056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c102d90 0x7f6e5c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 --2- 172.21.15.86:0/1963569056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c108450 0x7f6e5c108830 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 --2- 172.21.15.86:0/1963569056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5c1023d0 0x7f6e5c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 -- 172.21.15.86:0/1963569056 >> 172.21.15.86:0/1963569056 conn(0x7f6e5c078410 msgr2=0x7f6e5c078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:20.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 -- 172.21.15.86:0/1963569056 shutdown_connections 2024-05-12T11:10:20.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.550+0000 7f6e61940700 1 -- 172.21.15.86:0/1963569056 wait complete. 2024-05-12T11:10:20.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.551+0000 7f6e61940700 1 Processor -- start 2024-05-12T11:10:20.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.551+0000 7f6e61940700 1 -- start start 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.551+0000 7f6e61940700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5c1023d0 0x7f6e5c104080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.551+0000 7f6e61940700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102d90 0x7f6e5c1045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.551+0000 7f6e61940700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c108450 0x7f6e5c104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e61940700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c112620 con 0x7f6e5c102d90 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e61940700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c1124a0 con 0x7f6e5c1023d0 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e61940700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c1127a0 con 0x7f6e5c108450 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102d90 0x7f6e5c1045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102d90 0x7f6e5c1045c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42128/0 (socket says 172.21.15.86:42128) 2024-05-12T11:10:20.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 -- 172.21.15.86:0/4127119947 learned_addr learned my addr 172.21.15.86:0/4127119947 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5affd700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5c1023d0 0x7f6e5c104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5b7fe700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c108450 0x7f6e5c104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 -- 172.21.15.86:0/4127119947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c108450 msgr2=0x7f6e5c104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c108450 0x7f6e5c104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 -- 172.21.15.86:0/4127119947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5c1023d0 msgr2=0x7f6e5c104080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5c1023d0 0x7f6e5c104080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 -- 172.21.15.86:0/4127119947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c1a8190 con 0x7f6e5c102d90 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e5a7fc700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102d90 0x7f6e5c1045c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00b530 tx=0x7f6e4c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e6093e700 1 -- 172.21.15.86:0/4127119947 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c015020 con 0x7f6e5c102d90 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c1a8480 con 0x7f6e5c102d90 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e6093e700 1 -- 172.21.15.86:0/4127119947 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e4c011ce0 con 0x7f6e5c102d90 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e6093e700 1 -- 172.21.15.86:0/4127119947 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c010e40 con 0x7f6e5c102d90 2024-05-12T11:10:20.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.552+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c1a89c0 con 0x7f6e5c102d90 2024-05-12T11:10:20.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.553+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c103ac0 con 0x7f6e5c102d90 2024-05-12T11:10:20.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.555+0000 7f6e6093e700 1 -- 172.21.15.86:0/4127119947 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f6e4c018020 con 0x7f6e5c102d90 2024-05-12T11:10:20.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.555+0000 7f6e6093e700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f6e440b2ba0 0x7f6e440b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:20.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.555+0000 7f6e5affd700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f6e440b2ba0 0x7f6e440b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:20.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.556+0000 7f6e6093e700 1 -- 172.21.15.86:0/4127119947 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f6e4c0e1ff0 con 0x7f6e5c102d90 2024-05-12T11:10:20.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.556+0000 7f6e5affd700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f6e440b2ba0 0x7f6e440b5060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e500098e0 tx=0x7f6e50005960 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:20.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.560+0000 7f6e6093e700 1 -- 172.21.15.86:0/4127119947 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6e4c01f020 con 0x7f6e5c102d90 2024-05-12T11:10:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.809+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e5c1a8c80 con 0x7f6e5c102d90 2024-05-12T11:10:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.810+0000 7f6e6093e700 1 -- 172.21.15.86:0/4127119947 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7f6e4c0a98a0 con 0x7f6e5c102d90 2024-05-12T11:10:20.801 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:10:20.801 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:10:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f6e440b2ba0 msgr2=0x7f6e440b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f6e440b2ba0 0x7f6e440b5060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e500098e0 tx=0x7f6e50005960 comp rx=0 tx=0).stop 2024-05-12T11:10:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102d90 msgr2=0x7f6e5c1045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102d90 0x7f6e5c1045c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00b530 tx=0x7f6e4c00b840 comp rx=0 tx=0).stop 2024-05-12T11:10:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 shutdown_connections 2024-05-12T11:10:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c108450 0x7f6e5c104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5c1023d0 0x7f6e5c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f6e440b2ba0 0x7f6e440b5060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 --2- 172.21.15.86:0/4127119947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102d90 0x7f6e5c1045c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 >> 172.21.15.86:0/4127119947 conn(0x7f6e5c078410 msgr2=0x7f6e5c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 shutdown_connections 2024-05-12T11:10:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:20.812+0000 7f6e61940700 1 -- 172.21.15.86:0/4127119947 wait complete. 2024-05-12T11:10:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:10:21.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:21 smithi086 ceph-mon[30110]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:21.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:21 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4127119947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:10:21.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:21 smithi172 ceph-mon[34517]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:21.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:21 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4127119947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:10:21.498 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-12T11:10:21.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24466 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-12T11:10:21.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:21 smithi176 ceph-mon[34357]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:21.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:21 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4127119947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:10:21.753 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:10:23.293 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:23 smithi086 ceph-mon[30110]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:23.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:23 smithi172 ceph-mon[34517]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:23 smithi176 ceph-mon[34357]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 -- 172.21.15.86:0/3380944556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 msgr2=0x7efff806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 --2- 172.21.15.86:0/3380944556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 0x7efff806c5d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7effe8009990 tx=0x7effe8009ca0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 -- 172.21.15.86:0/3380944556 shutdown_connections 2024-05-12T11:10:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 --2- 172.21.15.86:0/3380944556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff8105f30 0x7efff81063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 --2- 172.21.15.86:0/3380944556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff81084c0 0x7efff806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 --2- 172.21.15.86:0/3380944556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 0x7efff806c5d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 -- 172.21.15.86:0/3380944556 >> 172.21.15.86:0/3380944556 conn(0x7efff80783f0 msgr2=0x7efff8078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 -- 172.21.15.86:0/3380944556 shutdown_connections 2024-05-12T11:10:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 -- 172.21.15.86:0/3380944556 wait complete. 2024-05-12T11:10:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 Processor -- start 2024-05-12T11:10:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.546+0000 7effffa76700 1 -- start start 2024-05-12T11:10:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7effffa76700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 0x7efff819ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7effffa76700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff8105f30 0x7efff81a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7effffa76700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81084c0 0x7efff81a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7effffa76700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efff8119c50 con 0x7efff806c150 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7effffa76700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efff8119ad0 con 0x7efff81084c0 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7effffa76700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efff8119dd0 con 0x7efff8105f30 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 0x7efff819ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 0x7efff819ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35380/0 (socket says 172.21.15.86:35380) 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 -- 172.21.15.86:0/1578403509 learned_addr learned my addr 172.21.15.86:0/1578403509 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd011700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff8105f30 0x7efff81a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffe013700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81084c0 0x7efff81a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 -- 172.21.15.86:0/1578403509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff8105f30 msgr2=0x7efff81a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff8105f30 0x7efff81a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 -- 172.21.15.86:0/1578403509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81084c0 msgr2=0x7efff81a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81084c0 0x7efff81a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 -- 172.21.15.86:0/1578403509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff81a4fd0 con 0x7efff806c150 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffe013700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81084c0 0x7efff81a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.547+0000 7efffd812700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 0x7efff819ffc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7efff400d980 tx=0x7efff400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.548+0000 7effeeffd700 1 -- 172.21.15.86:0/1578403509 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4017070 con 0x7efff806c150 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.548+0000 7effffa76700 1 -- 172.21.15.86:0/1578403509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff81a52c0 con 0x7efff806c150 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.548+0000 7effeeffd700 1 -- 172.21.15.86:0/1578403509 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efff4005020 con 0x7efff806c150 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.548+0000 7effeeffd700 1 -- 172.21.15.86:0/1578403509 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4009b50 con 0x7efff806c150 2024-05-12T11:10:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.548+0000 7effffa76700 1 -- 172.21.15.86:0/1578403509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff81acb40 con 0x7efff806c150 2024-05-12T11:10:23.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.550+0000 7effeeffd700 1 -- 172.21.15.86:0/1578403509 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7efff40051d0 con 0x7efff806c150 2024-05-12T11:10:23.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.551+0000 7effeeffd700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7effe40b2c40 0x7effe40b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.551+0000 7efffd011700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7effe40b2c40 0x7effe40b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.551+0000 7effeeffd700 1 -- 172.21.15.86:0/1578403509 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7efff40e2820 con 0x7efff806c150 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.551+0000 7efffd011700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7effe40b2c40 0x7effe40b5100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efff8078c60 tx=0x7effe8005960 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.551+0000 7f000a309b80 1 Processor -- start 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7f000a309b80 1 -- start start 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7f000a309b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844df410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7f000a309b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 0x5573844da830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7f000a309b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844dae50 0x5573844db2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7f000a309b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55738442c9f0 con 0x5573844dae50 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7f000a309b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5573843cb950 con 0x5573844df030 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7f000a309b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5573844289b0 con 0x5573844df950 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844dae50 0x5573844db2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844dae50 0x5573844db2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35390/0 (socket says 172.21.15.86:35390) 2024-05-12T11:10:23.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 -- 172.21.15.86:0/2368531678 learned_addr learned my addr 172.21.15.86:0/2368531678 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffd011700 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 0x5573844da830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffd812700 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 -- 172.21.15.86:0/2368531678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 msgr2=0x5573844da830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 0x5573844da830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 -- 172.21.15.86:0/2368531678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 msgr2=0x5573844df410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844df410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 -- 172.21.15.86:0/2368531678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557384379a60 con 0x5573844dae50 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffd812700 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844df410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.552+0000 7efffe013700 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844dae50 0x5573844db2b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7efff0009e60 tx=0x7efff00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd598d9c2f5d2638 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.553+0000 7effe3fff700 1 -- 172.21.15.86:0/2368531678 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0014610 con 0x5573844dae50 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.553+0000 7effe3fff700 1 -- 172.21.15.86:0/2368531678 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efff0019070 con 0x5573844dae50 2024-05-12T11:10:23.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.553+0000 7effe3fff700 1 -- 172.21.15.86:0/2368531678 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0013ab0 con 0x5573844dae50 2024-05-12T11:10:23.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 -- 172.21.15.86:0/2368531678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844dae50 msgr2=0x5573844db2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844dae50 0x5573844db2b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7efff0009e60 tx=0x7efff00077e0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 -- 172.21.15.86:0/2368531678 shutdown_connections 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844dae50 0x5573844db2b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844df410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 --2- 172.21.15.86:0/2368531678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 0x5573844da830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 -- 172.21.15.86:0/2368531678 >> 172.21.15.86:0/2368531678 conn(0x557384406290 msgr2=0x5573844d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 -- 172.21.15.86:0/2368531678 shutdown_connections 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 -- 172.21.15.86:0/2368531678 wait complete. 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 -- start start 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.554+0000 7f000a309b80 1 Processor -- start 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7f000a309b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7f000a309b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7f000a309b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7f000a309b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5573844e7520 con 0x5573844df950 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7f000a309b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557384392dc0 con 0x5573844df030 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7f000a309b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5573844e76a0 con 0x5573844dae50 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7f000a309b80 10 client.0 _ll_register_callbacks cb 0x5573843c4ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffe013700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffe013700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844e3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35406/0 (socket says 172.21.15.86:35406) 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffe013700 1 -- 172.21.15.86:0/848460993 learned_addr learned my addr 172.21.15.86:0/848460993 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffd011700 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffd812700 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffe013700 1 -- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 msgr2=0x5573844e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffe013700 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffe013700 1 -- 172.21.15.86:0/848460993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 msgr2=0x5573844e3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffe013700 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844e3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffe013700 1 -- 172.21.15.86:0/848460993 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573843c8820 con 0x5573844df950 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.555+0000 7efffd812700 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7efffe013700 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844e3fd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7efff00135f0 tx=0x7efff0013f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4e55f0daa07e82 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7effe17fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7effe17fa700 1 -- 172.21.15.86:0/848460993 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0028610 con 0x5573844df950 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7effe17fa700 1 -- 172.21.15.86:0/848460993 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7efff00287b0 con 0x5573844df950 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7f000a309b80 1 -- 172.21.15.86:0/848460993 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efff0019070 con 0x5573844df950 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7effe17fa700 1 -- 172.21.15.86:0/848460993 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efff00289b0 con 0x5573844df950 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7f000a309b80 10 client.15543 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7f000a309b80 1 -- 172.21.15.86:0/848460993 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5573844f1cc0 con 0x5573844df950 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7effe17fa700 1 -- 172.21.15.86:0/848460993 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efff0019070 con 0x5573844df950 2024-05-12T11:10:23.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.556+0000 7effe17fa700 1 -- 172.21.15.86:0/848460993 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efff0014b10 con 0x5573844df950 2024-05-12T11:10:23.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7f000a309b80 10 client.15543 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:23.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7f000a309b80 10 client.15543 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:10:23.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7f000a309b80 20 client.15543 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:23.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7f000a309b80 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5573844f4240 0x5573844f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7f000a309b80 4 client.15543 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:10:23.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7f000a309b80 1 -- 172.21.15.86:0/848460993 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573844a67e0 con 0x5573844f4240 2024-05-12T11:10:23.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7efffd812700 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5573844f4240 0x5573844f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7efffd812700 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5573844f4240 0x5573844f6630 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ed5807a8aaf951 server_cookie=c80b1561ff28b203 in_seq=0 out_seq=0 2024-05-12T11:10:23.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.557+0000 7effe17fa700 10 client.15543 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:23.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7effe17fa700 1 -- 172.21.15.86:0/848460993 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5573844a67e0 con 0x5573844f4240 2024-05-12T11:10:23.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7effe17fa700 10 client.15543 handle_command_reply: tid=0 2024-05-12T11:10:23.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 client.15543 shutdown 2024-05-12T11:10:23.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 -- 172.21.15.86:0/848460993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 msgr2=0x5573844e3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844e3fd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7efff00135f0 tx=0x7efff0013f30 comp rx=0 tx=0).stop 2024-05-12T11:10:23.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 -- 172.21.15.86:0/848460993 shutdown_connections 2024-05-12T11:10:23.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5573844f4240 0x5573844f6630 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844e3fd0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7effe17fa700 0 client.15543 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:23.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 --2- 172.21.15.86:0/848460993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844e3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 -- 172.21.15.86:0/848460993 >> 172.21.15.86:0/848460993 conn(0x557384406290 msgr2=0x5573844e0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:23.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 -- 172.21.15.86:0/848460993 shutdown_connections 2024-05-12T11:10:23.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.558+0000 7f000a309b80 1 -- 172.21.15.86:0/848460993 wait complete. 2024-05-12T11:10:23.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.559+0000 7f000a309b80 20 client.15543 trim_cache size 0 max 16384 2024-05-12T11:10:23.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.578+0000 7f000a309b80 1 Processor -- start 2024-05-12T11:10:23.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.578+0000 7f000a309b80 1 -- start start 2024-05-12T11:10:23.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7f000a309b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844dae50 0x5573844f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7f000a309b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df030 0x5573844fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7f000a309b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 0x5573844fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7f000a309b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b4290 con 0x5573844df030 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7f000a309b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b5dd0 con 0x5573844dae50 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7f000a309b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b4960 con 0x5573844df950 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df030 0x5573844fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df030 0x5573844fbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35412/0 (socket says 172.21.15.86:35412) 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 -- 172.21.15.86:0/3166404920 learned_addr learned my addr 172.21.15.86:0/3166404920 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd812700 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844dae50 0x5573844f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffe013700 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 0x5573844fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 -- 172.21.15.86:0/3166404920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 msgr2=0x5573844fc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 0x5573844fc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 -- 172.21.15.86:0/3166404920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844dae50 msgr2=0x5573844f05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844dae50 0x5573844f05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 -- 172.21.15.86:0/3166404920 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573844d6160 con 0x5573844df030 2024-05-12T11:10:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd812700 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844dae50 0x5573844f05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7efffd011700 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df030 0x5573844fbc60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effe8015000 tx=0x7effe8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1235cb5f4a9efc70 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7effe37fe700 1 -- 172.21.15.86:0/3166404920 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe8034070 con 0x5573844df030 2024-05-12T11:10:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7effe37fe700 1 -- 172.21.15.86:0/3166404920 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe800bc20 con 0x5573844df030 2024-05-12T11:10:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.579+0000 7effe37fe700 1 -- 172.21.15.86:0/3166404920 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe800fc90 con 0x5573844df030 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 -- 172.21.15.86:0/3166404920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df030 msgr2=0x5573844fbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df030 0x5573844fbc60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effe8015000 tx=0x7effe8021000 comp rx=0 tx=0).stop 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 -- 172.21.15.86:0/3166404920 shutdown_connections 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844df950 0x5573844fc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844dae50 0x5573844f05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 --2- 172.21.15.86:0/3166404920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df030 0x5573844fbc60 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 -- 172.21.15.86:0/3166404920 >> 172.21.15.86:0/3166404920 conn(0x557384406290 msgr2=0x5573844e3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 -- 172.21.15.86:0/3166404920 shutdown_connections 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 -- 172.21.15.86:0/3166404920 wait complete. 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.580+0000 7f000a309b80 1 -- start start 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7f000a309b80 1 Processor -- start 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7f000a309b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7f000a309b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844ec930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7f000a309b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844ece70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7f000a309b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b5700 con 0x5573844df950 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7f000a309b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b5030 con 0x5573844df030 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7f000a309b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b2230 con 0x5573844dae50 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7f000a309b80 10 client.0 _ll_register_callbacks cb 0x5573843c4ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffe013700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffe013700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844ece70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35414/0 (socket says 172.21.15.86:35414) 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffe013700 1 -- 172.21.15.86:0/2620971985 learned_addr learned my addr 172.21.15.86:0/2620971985 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffd011700 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffd812700 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffe013700 1 -- 172.21.15.86:0/2620971985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 msgr2=0x5573844e15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffe013700 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffe013700 1 -- 172.21.15.86:0/2620971985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 msgr2=0x5573844ec930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffe013700 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844ec930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.581+0000 7efffe013700 1 -- 172.21.15.86:0/2620971985 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573844dfdb0 con 0x5573844df950 2024-05-12T11:10:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7efffe013700 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844ece70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efff0005c30 tx=0x7efff0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af6f8e44cc14d46 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7effe17fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7effe17fa700 1 -- 172.21.15.86:0/2620971985 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0035070 con 0x5573844df950 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7effe17fa700 1 -- 172.21.15.86:0/2620971985 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7efff0028d50 con 0x5573844df950 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 1 -- 172.21.15.86:0/2620971985 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe800bc20 con 0x5573844df950 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7effe17fa700 1 -- 172.21.15.86:0/2620971985 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efff0004a90 con 0x5573844df950 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 10 client.15549 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 1 -- 172.21.15.86:0/2620971985 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55738455fb50 con 0x5573844df950 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7effe17fa700 1 -- 172.21.15.86:0/2620971985 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe800bc20 con 0x5573844df950 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7effe17fa700 1 -- 172.21.15.86:0/2620971985 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efff001ea60 con 0x5573844df950 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 10 client.15549 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 10 client.15549 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 20 client.15549 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x557384560190 0x5573845625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:23.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 4 client.15549 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-12T11:10:23.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.582+0000 7f000a309b80 1 -- 172.21.15.86:0/2620971985 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x55738443a3d0 con 0x557384560190 2024-05-12T11:10:23.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.583+0000 7efffd812700 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x557384560190 0x5573845625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:23.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.583+0000 7efffd812700 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x557384560190 0x5573845625b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42356550764883a2 server_cookie=78eb657b68fc532 in_seq=0 out_seq=0 2024-05-12T11:10:23.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.583+0000 7effe17fa700 10 client.15549 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:23.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.593+0000 7effe17fa700 1 -- 172.21.15.86:0/2620971985 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55738443a3d0 con 0x557384560190 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.593+0000 7effe17fa700 10 client.15549 handle_command_reply: tid=0 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.593+0000 7f000a309b80 1 client.15549 shutdown 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.593+0000 7f000a309b80 1 -- 172.21.15.86:0/2620971985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 msgr2=0x5573844ece70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.593+0000 7f000a309b80 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844ece70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efff0005c30 tx=0x7efff0007d20 comp rx=0 tx=0).stop 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 1 -- 172.21.15.86:0/2620971985 shutdown_connections 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x557384560190 0x5573845625b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573844df950 0x5573844ece70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5573844dae50 0x5573844e15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 1 --2- 172.21.15.86:0/2620971985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573844df030 0x5573844ec930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effe17fa700 0 client.15549 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 1 -- 172.21.15.86:0/2620971985 >> 172.21.15.86:0/2620971985 conn(0x557384406290 msgr2=0x5573844d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 1 -- 172.21.15.86:0/2620971985 shutdown_connections 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 1 -- 172.21.15.86:0/2620971985 wait complete. 2024-05-12T11:10:23.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7f000a309b80 20 client.15549 trim_cache size 0 max 16384 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "epoch": 29, 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "leader": 24466, 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "set_version": 2, 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "sets": { 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "2ea46ef6": { 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "version": 2, 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "age_ref": 0.0, 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "state": { 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "QUIESCED", 2024-05-12T11:10:23.586 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: "timeout": 60.0, 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: "expiration": 70.0, 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: "members": { 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: "file:/": { 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: "excluded": false, 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: "state": { 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "QUIESCED", 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:23.587 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:10:23.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 -- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7effe40b2c40 msgr2=0x7effe40b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7effe40b2c40 0x7effe40b5100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efff8078c60 tx=0x7effe8005960 comp rx=0 tx=0).stop 2024-05-12T11:10:23.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 -- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 msgr2=0x7efff819ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:23.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 0x7efff819ffc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7efff400d980 tx=0x7efff400dc90 comp rx=0 tx=0).stop 2024-05-12T11:10:23.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 -- 172.21.15.86:0/1578403509 shutdown_connections 2024-05-12T11:10:23.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81084c0 0x7efff81a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7effe40b2c40 0x7effe40b5100 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff806c150 0x7efff819ffc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 --2- 172.21.15.86:0/1578403509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff8105f30 0x7efff81a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:23.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.594+0000 7effffa76700 1 -- 172.21.15.86:0/1578403509 >> 172.21.15.86:0/1578403509 conn(0x7efff80783f0 msgr2=0x7efff8101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:23.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.595+0000 7effffa76700 1 -- 172.21.15.86:0/1578403509 shutdown_connections 2024-05-12T11:10:23.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:23.595+0000 7effffa76700 1 -- 172.21.15.86:0/1578403509 wait complete. 2024-05-12T11:10:24.401 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2ea46ef6', quiesce took 6.0 seconds. Will release after: 10 2024-05-12T11:10:25.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:25 smithi086 ceph-mon[30110]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:25.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:25 smithi172 ceph-mon[34517]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:25.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:25 smithi176 ceph-mon[34357]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:27.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:27 smithi086 ceph-mon[30110]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-12T11:10:27.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:27 smithi172 ceph-mon[34517]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-12T11:10:27.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:27 smithi176 ceph-mon[34357]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-12T11:10:29.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:29 smithi086 ceph-mon[30110]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:29.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:29 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:10:29.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:29 smithi172 ceph-mon[34517]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:29.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:29 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:10:29.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:29 smithi176 ceph-mon[34357]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:29.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:29 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:10:30.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:30 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:10:30.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:30 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:10:30.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:30 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:10:30.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:30 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:10:30.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:30 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:10:30.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:30 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:10:30.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:30 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:10:30.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:30 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:10:30.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:30 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:10:31.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:31 smithi086 ceph-mon[30110]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-12T11:10:31.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:31 smithi172 ceph-mon[34517]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-12T11:10:31.515 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:31 smithi176 ceph-mon[34357]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-12T11:10:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.134+0000 7f84b8590640 1 -- 172.21.15.86:0/2216983037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01029c0 msgr2=0x7f84b0102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.134+0000 7f84b8590640 1 --2- 172.21.15.86:0/2216983037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01029c0 0x7f84b0102e40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009930 tx=0x7f84a002a420 comp rx=0 tx=0).stop 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 -- 172.21.15.86:0/2216983037 shutdown_connections 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 --2- 172.21.15.86:0/2216983037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b0103380 0x7f84b010f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 --2- 172.21.15.86:0/2216983037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01029c0 0x7f84b0102e40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 --2- 172.21.15.86:0/2216983037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b01089d0 0x7f84b0108db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 -- 172.21.15.86:0/2216983037 >> 172.21.15.86:0/2216983037 conn(0x7f84b0079e40 msgr2=0x7f84b007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 -- 172.21.15.86:0/2216983037 shutdown_connections 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 -- 172.21.15.86:0/2216983037 wait complete. 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 Processor -- start 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 -- start start 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b01029c0 0x7f84b019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b0103380 0x7f84b019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01089d0 0x7f84b019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84b0112c90 con 0x7f84b01089d0 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84b0112b10 con 0x7f84b01029c0 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.135+0000 7f84b8590640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84b0112e10 con 0x7f84b0103380 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01089d0 0x7f84b019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01089d0 0x7f84b019fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39842/0 (socket says 172.21.15.86:39842) 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 -- 172.21.15.86:0/3568365620 learned_addr learned my addr 172.21.15.86:0/3568365620 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b0103380 0x7f84b019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b632c640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b01029c0 0x7f84b019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 -- 172.21.15.86:0/3568365620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b0103380 msgr2=0x7f84b019b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b0103380 0x7f84b019b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 -- 172.21.15.86:0/3568365620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b01029c0 msgr2=0x7f84b019b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b01029c0 0x7f84b019b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 -- 172.21.15.86:0/3568365620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b01a0340 con 0x7f84b01089d0 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b632c640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b01029c0 0x7f84b019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b0103380 0x7f84b019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b6b2d640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01089d0 0x7f84b019fc10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e960 tx=0x7f84a800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84a77fe640 1 -- 172.21.15.86:0/3568365620 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8004d20 con 0x7f84b01089d0 2024-05-12T11:10:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b8590640 1 -- 172.21.15.86:0/3568365620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b01a0630 con 0x7f84b01089d0 2024-05-12T11:10:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84a77fe640 1 -- 172.21.15.86:0/3568365620 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84a8005020 con 0x7f84b01089d0 2024-05-12T11:10:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84a77fe640 1 -- 172.21.15.86:0/3568365620 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a80116d0 con 0x7f84b01089d0 2024-05-12T11:10:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.136+0000 7f84b8590640 1 -- 172.21.15.86:0/3568365620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b01a7ec0 con 0x7f84b01089d0 2024-05-12T11:10:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84bb386740 1 Processor -- start 2024-05-12T11:10:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84a77fe640 1 -- 172.21.15.86:0/3568365620 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f84a80051d0 con 0x7f84b01089d0 2024-05-12T11:10:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84bb386740 1 -- start start 2024-05-12T11:10:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84bb386740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa41f10 0x560d2aa422f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84bb386740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa42830 0x560d2aa4cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84bb386740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84bb386740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560d2a9a75d0 con 0x560d2aa4d0f0 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84bb386740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560d2a960890 con 0x560d2aa42830 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84bb386740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560d2a9a3590 con 0x560d2aa41f10 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84b5b2b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84b5b2b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39844/0 (socket says 172.21.15.86:39844) 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.140+0000 7f84b5b2b640 1 -- 172.21.15.86:0/686704464 learned_addr learned my addr 172.21.15.86:0/686704464 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84a77fe640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f849c0b2bb0 0x7f849c0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b632c640 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa42830 0x560d2aa4cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa41f10 0x560d2aa422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b6b2d640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f849c0b2bb0 0x7f849c0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b5b2b640 1 -- 172.21.15.86:0/686704464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa41f10 msgr2=0x560d2aa422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa41f10 0x560d2aa422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b5b2b640 1 -- 172.21.15.86:0/686704464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa42830 msgr2=0x560d2aa4cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa42830 0x560d2aa4cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b5b2b640 1 -- 172.21.15.86:0/686704464 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2a6b9210 con 0x560d2aa4d0f0 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b632c640 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa42830 0x560d2aa4cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84a77fe640 1 -- 172.21.15.86:0/3568365620 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f84a80e2de0 con 0x7f84b01089d0 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4f4e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f84a0005c40 tx=0x7f84a0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe6a2a6fde94b4e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84b6b2d640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f849c0b2bb0 0x7f849c0b5070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84a80e0350 tx=0x7f84a8000f40 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84a4bfe640 1 -- 172.21.15.86:0/686704464 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0035040 con 0x560d2aa4d0f0 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84a4bfe640 1 -- 172.21.15.86:0/686704464 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84a0031520 con 0x560d2aa4d0f0 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.141+0000 7f84a4bfe640 1 -- 172.21.15.86:0/686704464 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a00035f0 con 0x560d2aa4d0f0 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 -- 172.21.15.86:0/686704464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 msgr2=0x560d2aa4f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4f4e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f84a0005c40 tx=0x7f84a0005bd0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 -- 172.21.15.86:0/686704464 shutdown_connections 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4f4e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa42830 0x560d2aa4cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 --2- 172.21.15.86:0/686704464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa41f10 0x560d2aa422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 -- 172.21.15.86:0/686704464 >> 172.21.15.86:0/686704464 conn(0x560d2aa3e420 msgr2=0x560d2aa3e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 -- 172.21.15.86:0/686704464 shutdown_connections 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 -- 172.21.15.86:0/686704464 wait complete. 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.142+0000 7f84bb386740 1 -- start start 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84bb386740 1 Processor -- start 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84bb386740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa49ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84bb386740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa4a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84bb386740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84bb386740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560d2aa4fcc0 con 0x560d2aa42830 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84bb386740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560d2a964370 con 0x560d2aa41f10 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84bb386740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560d2aa4fe40 con 0x560d2aa4d0f0 2024-05-12T11:10:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84bb386740 10 client.0 _ll_register_callbacks cb 0x560d2a6b8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa4a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa4a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39854/0 (socket says 172.21.15.86:39854) 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 -- 172.21.15.86:0/737542105 learned_addr learned my addr 172.21.15.86:0/737542105 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa49ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 -- 172.21.15.86:0/737542105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 msgr2=0x560d2aa4aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 -- 172.21.15.86:0/737542105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 msgr2=0x560d2aa49ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa49ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 -- 172.21.15.86:0/737542105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d2a785620 con 0x560d2aa42830 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa49ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f84b632c640 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa4a530 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00def0 tx=0x7f84ac011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72781fe98f0f73a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.143+0000 7f8499ffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f8499ffb640 1 -- 172.21.15.86:0/737542105 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac005220 con 0x560d2aa42830 2024-05-12T11:10:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f8499ffb640 1 -- 172.21.15.86:0/737542105 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f84ac0053c0 con 0x560d2aa42830 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 1 -- 172.21.15.86:0/737542105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84a0031520 con 0x560d2aa42830 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f8499ffb640 1 -- 172.21.15.86:0/737542105 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f84ac0055c0 con 0x560d2aa42830 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 10 client.15561 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 1 -- 172.21.15.86:0/737542105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d2aa5bbc0 con 0x560d2aa42830 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f8499ffb640 1 -- 172.21.15.86:0/737542105 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84a0031520 con 0x560d2aa42830 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f8499ffb640 1 -- 172.21.15.86:0/737542105 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f84ac00fb30 con 0x560d2aa42830 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 10 client.15561 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 20 client.15561 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560d2aa5d080 0x560d2aa5f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 4 client.15561 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.144+0000 7f84bb386740 1 -- 172.21.15.86:0/737542105 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d2a9b51e0 con 0x560d2aa5d080 2024-05-12T11:10:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.145+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560d2aa5d080 0x560d2aa5f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.145+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560d2aa5d080 0x560d2aa5f4f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9081fcd64a2c903 server_cookie=a9199191f6e484d9 in_seq=0 out_seq=0 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.145+0000 7f8499ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f8499ffb640 1 -- 172.21.15.86:0/737542105 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560d2a9b51e0 con 0x560d2aa5d080 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f8499ffb640 10 client.15561 handle_command_reply: tid=0 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 client.15561 shutdown 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 -- 172.21.15.86:0/737542105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 msgr2=0x560d2aa4a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa4a530 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00def0 tx=0x7f84ac011810 comp rx=0 tx=0).stop 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 -- 172.21.15.86:0/737542105 shutdown_connections 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560d2aa5d080 0x560d2aa5f4f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa4a530 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 --2- 172.21.15.86:0/737542105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa49ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f8499ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:33.143 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 -- 172.21.15.86:0/737542105 >> 172.21.15.86:0/737542105 conn(0x560d2aa3e420 msgr2=0x560d2aa44150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:33.144 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 -- 172.21.15.86:0/737542105 shutdown_connections 2024-05-12T11:10:33.144 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 1 -- 172.21.15.86:0/737542105 wait complete. 2024-05-12T11:10:33.144 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.146+0000 7f84bb386740 20 client.15561 trim_cache size 0 max 16384 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84bb386740 1 Processor -- start 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84bb386740 1 -- start start 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84bb386740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa64e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84bb386740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa65340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84bb386740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84bb386740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84b01b07e0 con 0x560d2aa42830 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84bb386740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84b01b2320 con 0x560d2aa41f10 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84bb386740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84b01b0eb0 con 0x560d2aa4d0f0 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84b632c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa65340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84b632c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa65340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39860/0 (socket says 172.21.15.86:39860) 2024-05-12T11:10:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84b632c640 1 -- 172.21.15.86:0/1782480052 learned_addr learned my addr 172.21.15.86:0/1782480052 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84b632c640 1 -- 172.21.15.86:0/1782480052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 msgr2=0x560d2aa4b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84b632c640 1 --2- 172.21.15.86:0/1782480052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84b632c640 1 -- 172.21.15.86:0/1782480052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 msgr2=0x560d2aa64e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84b632c640 1 --2- 172.21.15.86:0/1782480052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa64e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.161+0000 7f84b632c640 1 -- 172.21.15.86:0/1782480052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2aa42660 con 0x560d2aa42830 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84b632c640 1 --2- 172.21.15.86:0/1782480052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa65340 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f84ac023400 tx=0x7f84ac011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b020816e8ba3b74b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f849bfff640 1 -- 172.21.15.86:0/1782480052 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac030070 con 0x560d2aa42830 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f849bfff640 1 -- 172.21.15.86:0/1782480052 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84ac00fb40 con 0x560d2aa42830 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f849bfff640 1 -- 172.21.15.86:0/1782480052 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac02b430 con 0x560d2aa42830 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 -- 172.21.15.86:0/1782480052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 msgr2=0x560d2aa65340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 --2- 172.21.15.86:0/1782480052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa65340 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f84ac023400 tx=0x7f84ac011e30 comp rx=0 tx=0).stop 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 -- 172.21.15.86:0/1782480052 shutdown_connections 2024-05-12T11:10:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 --2- 172.21.15.86:0/1782480052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa4d0f0 0x560d2aa4b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 --2- 172.21.15.86:0/1782480052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa42830 0x560d2aa65340 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 --2- 172.21.15.86:0/1782480052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa64e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 -- 172.21.15.86:0/1782480052 >> 172.21.15.86:0/1782480052 conn(0x560d2aa3e420 msgr2=0x560d2aa3e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 -- 172.21.15.86:0/1782480052 shutdown_connections 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.162+0000 7f84bb386740 1 -- 172.21.15.86:0/1782480052 wait complete. 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 1 -- start start 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 1 Processor -- start 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa46d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa42830 0x560d2aa47260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa477a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84b01b1c50 con 0x560d2aa4d0f0 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84b01b1580 con 0x560d2aa41f10 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84b01ae7c0 con 0x560d2aa42830 2024-05-12T11:10:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84bb386740 10 client.0 _ll_register_callbacks cb 0x7f84ac00d440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b5b2b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b5b2b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39870/0 (socket says 172.21.15.86:39870) 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b5b2b640 1 -- 172.21.15.86:0/996534750 learned_addr learned my addr 172.21.15.86:0/996534750 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b632c640 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa42830 0x560d2aa47260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b5b2b640 1 -- 172.21.15.86:0/996534750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa42830 msgr2=0x560d2aa47260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa42830 0x560d2aa47260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b5b2b640 1 -- 172.21.15.86:0/996534750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 msgr2=0x560d2aa46d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa46d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.163+0000 7f84b5b2b640 1 -- 172.21.15.86:0/996534750 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d2aac69b0 con 0x560d2aa4d0f0 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84b5b2b640 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa477a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f84a0005c40 tx=0x7f84a0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f268399d67a8c2e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f8499ffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f8499ffb640 1 -- 172.21.15.86:0/996534750 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0035070 con 0x560d2aa4d0f0 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f8499ffb640 1 -- 172.21.15.86:0/996534750 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f84a0031970 con 0x560d2aa4d0f0 2024-05-12T11:10:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 1 -- 172.21.15.86:0/996534750 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84ac00fb40 con 0x560d2aa4d0f0 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f8499ffb640 1 -- 172.21.15.86:0/996534750 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f84a0031b70 con 0x560d2aa4d0f0 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 10 client.15567 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 1 -- 172.21.15.86:0/996534750 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d2aac7c20 con 0x560d2aa4d0f0 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f8499ffb640 1 -- 172.21.15.86:0/996534750 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84ac00fb40 con 0x560d2aa4d0f0 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f8499ffb640 1 -- 172.21.15.86:0/996534750 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f84a003a040 con 0x560d2aa4d0f0 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 10 client.15567 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 10 client.15567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 20 client.15567 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560d2aac7f00 0x560d2aaca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 4 client.15567 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84bb386740 1 -- 172.21.15.86:0/996534750 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d2a9af050 con 0x560d2aac7f00 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.164+0000 7f84b632c640 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560d2aac7f00 0x560d2aaca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.165+0000 7f8499ffb640 10 client.15567 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.165+0000 7f84b632c640 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560d2aac7f00 0x560d2aaca2f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a075456fe470d282 server_cookie=967d0439f94f4cac in_seq=0 out_seq=0 2024-05-12T11:10:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f8499ffb640 1 -- 172.21.15.86:0/996534750 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d2a9af050 con 0x560d2aac7f00 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f8499ffb640 10 client.15567 handle_command_reply: tid=0 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 client.15567 shutdown 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 -- 172.21.15.86:0/996534750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 msgr2=0x560d2aa477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa477a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f84a0005c40 tx=0x7f84a0009880 comp rx=0 tx=0).stop 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 -- 172.21.15.86:0/996534750 shutdown_connections 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560d2aac7f00 0x560d2aaca2f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560d2aa4d0f0 0x560d2aa477a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d2aa42830 0x560d2aa47260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 --2- 172.21.15.86:0/996534750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d2aa41f10 0x560d2aa46d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f8499ffb640 0 client.15567 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 -- 172.21.15.86:0/996534750 >> 172.21.15.86:0/996534750 conn(0x560d2aa3e420 msgr2=0x560d2aa3ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.172+0000 7f84bb386740 1 -- 172.21.15.86:0/996534750 shutdown_connections 2024-05-12T11:10:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84bb386740 1 -- 172.21.15.86:0/996534750 wait complete. 2024-05-12T11:10:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84bb386740 20 client.15567 trim_cache size 0 max 16384 2024-05-12T11:10:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:10:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:10:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:10:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:10:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 -- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f849c0b2bb0 msgr2=0x7f849c0b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f849c0b2bb0 0x7f849c0b5070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84a80e0350 tx=0x7f84a8000f40 comp rx=0 tx=0).stop 2024-05-12T11:10:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 -- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01089d0 msgr2=0x7f84b019fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01089d0 0x7f84b019fc10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e960 tx=0x7f84a800ee20 comp rx=0 tx=0).stop 2024-05-12T11:10:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 -- 172.21.15.86:0/3568365620 shutdown_connections 2024-05-12T11:10:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f849c0b2bb0 0x7f849c0b5070 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84b01089d0 0x7f84b019fc10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84b0103380 0x7f84b019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 --2- 172.21.15.86:0/3568365620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b01029c0 0x7f84b019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 -- 172.21.15.86:0/3568365620 >> 172.21.15.86:0/3568365620 conn(0x7f84b0079e40 msgr2=0x7f84b010e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 -- 172.21.15.86:0/3568365620 shutdown_connections 2024-05-12T11:10:33.167 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:33.173+0000 7f84b8590640 1 -- 172.21.15.86:0/3568365620 wait complete. 2024-05-12T11:10:33.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:33 smithi086 ceph-mon[30110]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:33.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:33 smithi172 ceph-mon[34517]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:33.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:33 smithi176 ceph-mon[34357]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:34.403 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:10:34.660 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:10:35.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:35 smithi086 ceph-mon[30110]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:35.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:35 smithi172 ceph-mon[34517]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:35.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:35 smithi176 ceph-mon[34357]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-12T11:10:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.418+0000 7f705cdf8700 1 -- 172.21.15.86:0/2527738398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581026f0 msgr2=0x7f7058102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.418+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2527738398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581026f0 0x7f7058102b70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7048009990 tx=0x7f7048009ca0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.418+0000 7f705cdf8700 1 -- 172.21.15.86:0/2527738398 shutdown_connections 2024-05-12T11:10:36.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.418+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2527738398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70581030b0 0x7f705810f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.418+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2527738398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7058107420 0x7f7058107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.418+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2527738398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581026f0 0x7f7058102b70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.418+0000 7f705cdf8700 1 -- 172.21.15.86:0/2527738398 >> 172.21.15.86:0/2527738398 conn(0x7f7058078210 msgr2=0x7f7058078620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.418+0000 7f705cdf8700 1 -- 172.21.15.86:0/2527738398 shutdown_connections 2024-05-12T11:10:36.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.419+0000 7f705cdf8700 1 -- 172.21.15.86:0/2527738398 wait complete. 2024-05-12T11:10:36.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.419+0000 7f705cdf8700 1 Processor -- start 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.419+0000 7f705cdf8700 1 -- start start 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f705cdf8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70581026f0 0x7f705819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f705cdf8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581030b0 0x7f705819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f705cdf8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7058107420 0x7f7058198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f705cdf8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f70581125d0 con 0x7f70581030b0 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f705cdf8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7058112450 con 0x7f70581026f0 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f705cdf8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7058112750 con 0x7f7058107420 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581030b0 0x7f705819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581030b0 0x7f705819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39888/0 (socket says 172.21.15.86:39888) 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 -- 172.21.15.86:0/2387819723 learned_addr learned my addr 172.21.15.86:0/2387819723 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f705659c700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70581026f0 0x7f705819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7056d9d700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7058107420 0x7f7058198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 -- 172.21.15.86:0/2387819723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7058107420 msgr2=0x7f7058198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:36.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7058107420 0x7f7058198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 -- 172.21.15.86:0/2387819723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70581026f0 msgr2=0x7f705819e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70581026f0 0x7f705819e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 -- 172.21.15.86:0/2387819723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7058198ff0 con 0x7f70581030b0 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f7055d9b700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581030b0 0x7f705819ebd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7048000c00 tx=0x7f70480047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.420+0000 7f70477fe700 1 -- 172.21.15.86:0/2387819723 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7048027070 con 0x7f70581030b0 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.421+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7058199280 con 0x7f70581030b0 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.421+0000 7f70477fe700 1 -- 172.21.15.86:0/2387819723 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70480040e0 con 0x7f70581030b0 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.421+0000 7f70477fe700 1 -- 172.21.15.86:0/2387819723 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704800f460 con 0x7f70581030b0 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.421+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70581a54f0 con 0x7f70581030b0 2024-05-12T11:10:36.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.421+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7058103b10 con 0x7f70581030b0 2024-05-12T11:10:36.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.424+0000 7f70477fe700 1 -- 172.21.15.86:0/2387819723 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7f704802a070 con 0x7f70581030b0 2024-05-12T11:10:36.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.424+0000 7f70477fe700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f70400b2ba0 0x7f70400b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.424+0000 7f705659c700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f70400b2ba0 0x7f70400b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.424+0000 7f70477fe700 1 -- 172.21.15.86:0/2387819723 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f70480e3cd0 con 0x7f70581030b0 2024-05-12T11:10:36.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.425+0000 7f705659c700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f70400b2ba0 0x7f70400b5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f705807a730 tx=0x7f704c00a380 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:36.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.428+0000 7f70477fe700 1 -- 172.21.15.86:0/2387819723 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7048031070 con 0x7f70581030b0 2024-05-12T11:10:36.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.675+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7058199d40 con 0x7f70581030b0 2024-05-12T11:10:36.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.676+0000 7f70477fe700 1 -- 172.21.15.86:0/2387819723 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7f7048013070 con 0x7f70581030b0 2024-05-12T11:10:36.668 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:10:36.668 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:10:36.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f70400b2ba0 msgr2=0x7f70400b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f70400b2ba0 0x7f70400b5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f705807a730 tx=0x7f704c00a380 comp rx=0 tx=0).stop 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581030b0 msgr2=0x7f705819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581030b0 0x7f705819ebd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7048000c00 tx=0x7f70480047b0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 shutdown_connections 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7058107420 0x7f7058198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70581026f0 0x7f705819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f70400b2ba0 0x7f70400b5060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 --2- 172.21.15.86:0/2387819723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70581030b0 0x7f705819ebd0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:36.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.678+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 >> 172.21.15.86:0/2387819723 conn(0x7f7058078210 msgr2=0x7f7058100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:36.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.679+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 shutdown_connections 2024-05-12T11:10:36.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:36.679+0000 7f705cdf8700 1 -- 172.21.15.86:0/2387819723 wait complete. 2024-05-12T11:10:36.672 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:10:37.329 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:37 smithi086 ceph-mon[30110]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-05-12T11:10:37.329 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:37 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2387819723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:10:37.358 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --set-id 2ea46ef6 --release --await' 2024-05-12T11:10:37.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24466 quiesce db --set-id 2ea46ef6 --release --await 2024-05-12T11:10:37.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:37 smithi172 ceph-mon[34517]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-05-12T11:10:37.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:37 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2387819723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:10:37.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:37 smithi176 ceph-mon[34357]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-05-12T11:10:37.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:37 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2387819723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:10:37.602 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/2322770582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8108880 msgr2=0x7fa5b8110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/2322770582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8108880 0x7fa5b8110400 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b0d0 tx=0x7fa5b000b3e0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/2322770582 shutdown_connections 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/2322770582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8108880 0x7fa5b8110400 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/2322770582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b81037b0 0x7fa5b8103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/2322770582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b8104160 0x7fa5b8108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/2322770582 >> 172.21.15.86:0/2322770582 conn(0x7fa5b807a530 msgr2=0x7fa5b807a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/2322770582 shutdown_connections 2024-05-12T11:10:39.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.314+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/2322770582 wait complete. 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bf2f5700 1 Processor -- start 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bf2f5700 1 -- start start 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bf2f5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b81037b0 0x7fa5b819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bf2f5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8104160 0x7fa5b819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bf2f5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b8108880 0x7fa5b81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bf2f5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b8113650 con 0x7fa5b8104160 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bf2f5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b81134d0 con 0x7fa5b8108880 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bf2f5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b81137d0 con 0x7fa5b81037b0 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bc890700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8104160 0x7fa5b819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bc890700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8104160 0x7fa5b819fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39912/0 (socket says 172.21.15.86:39912) 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bc890700 1 -- 172.21.15.86:0/947473284 learned_addr learned my addr 172.21.15.86:0/947473284 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.315+0000 7fa5bd091700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b81037b0 0x7fa5b819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bd892700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b8108880 0x7fa5b81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bc890700 1 -- 172.21.15.86:0/947473284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b81037b0 msgr2=0x7fa5b819f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bc890700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b81037b0 0x7fa5b819f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bc890700 1 -- 172.21.15.86:0/947473284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b8108880 msgr2=0x7fa5b81998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bc890700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b8108880 0x7fa5b81998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bc890700 1 -- 172.21.15.86:0/947473284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b819a030 con 0x7fa5b8104160 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bc890700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8104160 0x7fa5b819fc00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800d980 tx=0x7fa5a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5ae7fc700 1 -- 172.21.15.86:0/947473284 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8016070 con 0x7fa5b8104160 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5ae7fc700 1 -- 172.21.15.86:0/947473284 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5a8004830 con 0x7fa5b8104160 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5ae7fc700 1 -- 172.21.15.86:0/947473284 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8005540 con 0x7fa5b8104160 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/947473284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b819a320 con 0x7fa5b8104160 2024-05-12T11:10:39.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.316+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/947473284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b81a6590 con 0x7fa5b8104160 2024-05-12T11:10:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.319+0000 7fa5ae7fc700 1 -- 172.21.15.86:0/947473284 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7fa5a8004220 con 0x7fa5b8104160 2024-05-12T11:10:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.320+0000 7fa5ae7fc700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa5a40b2ba0 0x7fa5a40b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.320+0000 7fa5bd091700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa5a40b2ba0 0x7fa5a40b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.320+0000 7fa5ae7fc700 1 -- 172.21.15.86:0/947473284 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa5a80e2680 con 0x7fa5b8104160 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.320+0000 7fa5c9b88b80 1 Processor -- start 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.320+0000 7fa5bd091700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa5a40b2ba0 0x7fa5a40b5060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4005950 tx=0x7fa5b400a300 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.320+0000 7fa5c9b88b80 1 -- start start 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.320+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edefa0 0x564252edf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.320+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252eda7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252edb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564252e2c960 con 0x564252edf8c0 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564252dcb8c0 con 0x564252edadc0 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564252e28920 con 0x564252edefa0 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252eda7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252eda7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39920/0 (socket says 172.21.15.86:39920) 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 -- 172.21.15.86:0/3729064695 learned_addr learned my addr 172.21.15.86:0/3729064695 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:39.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bd892700 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252edb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bd091700 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edefa0 0x564252edf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 -- 172.21.15.86:0/3729064695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edefa0 msgr2=0x564252edf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:39.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edefa0 0x564252edf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 -- 172.21.15.86:0/3729064695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 msgr2=0x564252edb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:39.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252edb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 -- 172.21.15.86:0/3729064695 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564252d799d0 con 0x564252edf8c0 2024-05-12T11:10:39.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5bc890700 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252eda7a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80a96b0 tx=0x7fa5a80a8fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a7856b39b4a9a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:39.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5a37fe700 1 -- 172.21.15.86:0/3729064695 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80adad0 con 0x564252edf8c0 2024-05-12T11:10:39.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5a37fe700 1 -- 172.21.15.86:0/3729064695 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5a80b0e50 con 0x564252edf8c0 2024-05-12T11:10:39.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.321+0000 7fa5a37fe700 1 -- 172.21.15.86:0/3729064695 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80a9980 con 0x564252edf8c0 2024-05-12T11:10:39.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3729064695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 msgr2=0x564252eda7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252eda7a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80a96b0 tx=0x7fa5a80a8fc0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3729064695 shutdown_connections 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252edb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edefa0 0x564252edf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/3729064695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252eda7a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3729064695 >> 172.21.15.86:0/3729064695 conn(0x564252e06200 msgr2=0x564252ed4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3729064695 shutdown_connections 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.322+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3729064695 wait complete. 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 1 -- start start 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 1 Processor -- start 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252ee6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252ee3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252ee3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564252eeb840 con 0x564252edefa0 2024-05-12T11:10:39.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564252d92d30 con 0x564252edadc0 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564252eeb9c0 con 0x564252edf8c0 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.323+0000 7fa5c9b88b80 10 client.0 _ll_register_callbacks cb 0x564252dc4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bc890700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252ee3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bd091700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252ee6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bc890700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252ee3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39934/0 (socket says 172.21.15.86:39934) 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bc890700 1 -- 172.21.15.86:0/706902276 learned_addr learned my addr 172.21.15.86:0/706902276 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bd892700 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252ee3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bd091700 1 -- 172.21.15.86:0/706902276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 msgr2=0x564252ee3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bd091700 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252ee3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bd091700 1 -- 172.21.15.86:0/706902276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 msgr2=0x564252ee3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bd091700 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252ee3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bd091700 1 -- 172.21.15.86:0/706902276 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564252dc8790 con 0x564252edadc0 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bc890700 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252ee3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:10:39.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5bd091700 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252ee6640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa5b81083d0 tx=0x7fa5b40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91384c7049660a86 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.324+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/706902276 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b402a060 con 0x564252edadc0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/706902276 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5a80b0e50 con 0x564252edadc0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/706902276 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa5b401b910 con 0x564252edadc0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/706902276 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa5b4016070 con 0x564252edadc0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 10 client.25019 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/706902276 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564252ef60f0 con 0x564252edadc0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/706902276 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5a80b0e50 con 0x564252edadc0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/706902276 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa5b4024030 con 0x564252edadc0 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 10 client.25019 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 10 client.25019 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 20 client.25019 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x564252ef8730 0x564252efab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 4 client.25019 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:10:39.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.325+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/706902276 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564252ea6750 con 0x564252ef8730 2024-05-12T11:10:39.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.326+0000 7fa5bc890700 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x564252ef8730 0x564252efab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.326+0000 7fa5bc890700 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x564252ef8730 0x564252efab20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f034dede7d71b53 server_cookie=3f767b95f97e3fc1 in_seq=0 out_seq=0 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.326+0000 7fa5a0ff9700 10 client.25019 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/706902276 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564252ea6750 con 0x564252ef8730 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5a0ff9700 10 client.25019 handle_command_reply: tid=0 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 client.25019 shutdown 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/706902276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 msgr2=0x564252ee6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252ee6640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa5b81083d0 tx=0x7fa5b40047c0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/706902276 shutdown_connections 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x564252ef8730 0x564252efab20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252ee3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252ee6640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5a0ff9700 0 client.25019 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:39.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/706902276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252ee3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/706902276 >> 172.21.15.86:0/706902276 conn(0x564252e06200 msgr2=0x564252ed3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:39.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/706902276 shutdown_connections 2024-05-12T11:10:39.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/706902276 wait complete. 2024-05-12T11:10:39.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.327+0000 7fa5c9b88b80 20 client.25019 trim_cache size 0 max 16384 2024-05-12T11:10:39.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5c9b88b80 1 Processor -- start 2024-05-12T11:10:39.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5c9b88b80 1 -- start start 2024-05-12T11:10:39.351 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:39 smithi086 ceph-mon[30110]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:39.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edadc0 0x564252ee2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edefa0 0x564252ee28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252f003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b81abb60 con 0x564252edf8c0 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b81ad6a0 con 0x564252edefa0 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b81ac230 con 0x564252edadc0 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5bd892700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252f003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5bd892700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252f003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39942/0 (socket says 172.21.15.86:39942) 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.357+0000 7fa5bd892700 1 -- 172.21.15.86:0/3234479025 learned_addr learned my addr 172.21.15.86:0/3234479025 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bd091700 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edadc0 0x564252ee2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bc890700 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edefa0 0x564252ee28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bd892700 1 -- 172.21.15.86:0/3234479025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edadc0 msgr2=0x564252ee2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bd892700 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edadc0 0x564252ee2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bd892700 1 -- 172.21.15.86:0/3234479025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edefa0 msgr2=0x564252ee28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bd892700 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edefa0 0x564252ee28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bd892700 1 -- 172.21.15.86:0/3234479025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564252ecff40 con 0x564252edf8c0 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bc890700 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edefa0 0x564252ee28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5bd892700 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252f003f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009350 tx=0x7fa5b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2b02977ac5168c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5a2ffd700 1 -- 172.21.15.86:0/3234479025 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0003c00 con 0x564252edf8c0 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5a2ffd700 1 -- 172.21.15.86:0/3234479025 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5b0003da0 con 0x564252edf8c0 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.358+0000 7fa5a2ffd700 1 -- 172.21.15.86:0/3234479025 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0005470 con 0x564252edf8c0 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3234479025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 msgr2=0x564252f003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252f003f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009350 tx=0x7fa5b000b040 comp rx=0 tx=0).stop 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3234479025 shutdown_connections 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edf8c0 0x564252f003f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edadc0 0x564252ee2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/3234479025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edefa0 0x564252ee28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3234479025 >> 172.21.15.86:0/3234479025 conn(0x564252e06200 msgr2=0x564252ed4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3234479025 shutdown_connections 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.359+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/3234479025 wait complete. 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 1 -- start start 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 1 Processor -- start 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252ef0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252eed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252eed840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b81acfd0 con 0x564252edefa0 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b81ac900 con 0x564252edadc0 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b81a9b20 con 0x564252edf8c0 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5c9b88b80 10 client.0 _ll_register_callbacks cb 0x564252dc4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5bd892700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252eed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5bc890700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252eed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5bd892700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252eed840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.86:59086/0 (socket says 172.21.15.86:59086) 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.360+0000 7fa5bd892700 1 -- 172.21.15.86:0/1564477869 learned_addr learned my addr 172.21.15.86:0/1564477869 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.361+0000 7fa5bc890700 1 -- 172.21.15.86:0/1564477869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 msgr2=0x564252eed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.361+0000 7fa5bc890700 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252eed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.361+0000 7fa5bc890700 1 -- 172.21.15.86:0/1564477869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 msgr2=0x564252ef0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.361+0000 7fa5bc890700 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252ef0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.361+0000 7fa5bc890700 1 -- 172.21.15.86:0/1564477869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564252edebf0 con 0x564252edefa0 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.361+0000 7fa5bc890700 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252eed300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80dfcd0 tx=0x7fa5a8007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c866372a3bc9ce30 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.361+0000 7fa5a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.361+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/1564477869 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80a94f0 con 0x564252edefa0 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/1564477869 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa5a80910b0 con 0x564252edefa0 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/1564477869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5b0003da0 con 0x564252edefa0 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/1564477869 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa5a80912b0 con 0x564252edefa0 2024-05-12T11:10:39.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 10 client.15591 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/1564477869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564252f63c00 con 0x564252edefa0 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/1564477869 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5b0003da0 con 0x564252edefa0 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/1564477869 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa5a80beb70 con 0x564252edefa0 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 10 client.15591 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 10 client.15591 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 20 client.15591 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x564252f63ef0 0x564252f662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 4 client.15591 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2ea46ef6", "release": true, "await": true}] 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.362+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/1564477869 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2ea46ef6", "release": true, "await": true}) -- 0x564252e3a340 con 0x564252f63ef0 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.363+0000 7fa5bd091700 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x564252f63ef0 0x564252f662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:39.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.363+0000 7fa5bd091700 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x564252f63ef0 0x564252f662e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d2d3afa5441fdf6 server_cookie=8f5d24c39abf099c in_seq=0 out_seq=0 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.363+0000 7fa5a0ff9700 10 client.15591 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5a0ff9700 1 -- 172.21.15.86:0/1564477869 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x564252e3a340 con 0x564252f63ef0 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5a0ff9700 10 client.15591 handle_command_reply: tid=0 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 client.15591 shutdown 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/1564477869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 msgr2=0x564252eed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252eed300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80dfcd0 tx=0x7fa5a8007680 comp rx=0 tx=0).stop 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/1564477869 shutdown_connections 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x564252f63ef0 0x564252f662e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564252edf8c0 0x564252eed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564252edadc0 0x564252ef0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 --2- 172.21.15.86:0/1564477869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564252edefa0 0x564252eed300 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/1564477869 >> 172.21.15.86:0/1564477869 conn(0x564252e06200 msgr2=0x564252ee1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:39.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5a0ff9700 0 client.15591 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:39.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/1564477869 shutdown_connections 2024-05-12T11:10:39.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.366+0000 7fa5c9b88b80 1 -- 172.21.15.86:0/1564477869 wait complete. 2024-05-12T11:10:39.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5c9b88b80 20 client.15591 trim_cache size 0 max 16384 2024-05-12T11:10:39.365 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:10:39.365 INFO:teuthology.orchestra.run.smithi086.stdout: "epoch": 29, 2024-05-12T11:10:39.365 INFO:teuthology.orchestra.run.smithi086.stdout: "leader": 24466, 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "set_version": 4, 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "sets": { 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "2ea46ef6": { 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "version": 4, 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "age_ref": 0.0, 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "state": { 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RELEASED", 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "timeout": 60.0, 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "expiration": 70.0, 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "members": { 2024-05-12T11:10:39.366 INFO:teuthology.orchestra.run.smithi086.stdout: "file:/": { 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: "excluded": false, 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: "state": { 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RELEASED", 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:10:39.367 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:10:39.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa5a40b2ba0 msgr2=0x7fa5a40b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa5a40b2ba0 0x7fa5a40b5060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4005950 tx=0x7fa5b400a300 comp rx=0 tx=0).stop 2024-05-12T11:10:39.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8104160 msgr2=0x7fa5b819fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:39.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8104160 0x7fa5b819fc00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800d980 tx=0x7fa5a800dc90 comp rx=0 tx=0).stop 2024-05-12T11:10:39.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/947473284 shutdown_connections 2024-05-12T11:10:39.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b8108880 0x7fa5b81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b81037b0 0x7fa5b819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa5a40b2ba0 0x7fa5a40b5060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 --2- 172.21.15.86:0/947473284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b8104160 0x7fa5b819fc00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:39.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.367+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/947473284 >> 172.21.15.86:0/947473284 conn(0x7fa5b807a530 msgr2=0x7fa5b8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:39.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.368+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/947473284 shutdown_connections 2024-05-12T11:10:39.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:10:39.368+0000 7fa5bf2f5700 1 -- 172.21.15.86:0/947473284 wait complete. 2024-05-12T11:10:39.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:39 smithi172 ceph-mon[34517]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:39.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:39 smithi176 ceph-mon[34357]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:40.145 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2ea46ef6', seconds elapsed: 21.7 2024-05-12T11:10:41.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:41 smithi086 ceph-mon[30110]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:41.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:41 smithi172 ceph-mon[34517]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:41.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:41 smithi176 ceph-mon[34357]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:43.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:43 smithi086 ceph-mon[30110]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:43.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:43 smithi172 ceph-mon[34517]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:43.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:43 smithi176 ceph-mon[34357]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:45.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:45 smithi086 ceph-mon[30110]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:45.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:45 smithi172 ceph-mon[34517]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:45.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:45 smithi176 ceph-mon[34357]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 -- 172.21.15.86:0/1415070978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba241025c0 msgr2=0x7fba2410e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 --2- 172.21.15.86:0/1415070978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba241025c0 0x7fba2410e6d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009900 tx=0x7fba1c02a410 comp rx=0 tx=0).stop 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 -- 172.21.15.86:0/1415070978 shutdown_connections 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 --2- 172.21.15.86:0/1415070978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba241025c0 0x7fba2410e6d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 --2- 172.21.15.86:0/1415070978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba24101c00 0x7fba24102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 --2- 172.21.15.86:0/1415070978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba24106850 0x7fba24106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 -- 172.21.15.86:0/1415070978 >> 172.21.15.86:0/1415070978 conn(0x7fba240776b0 msgr2=0x7fba24077ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 -- 172.21.15.86:0/1415070978 shutdown_connections 2024-05-12T11:10:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.271+0000 7fba2ad91640 1 -- 172.21.15.86:0/1415070978 wait complete. 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2ad91640 1 Processor -- start 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2ad91640 1 -- start start 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2ad91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba24101c00 0x7fba24199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2ad91640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba241025c0 0x7fba2419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2ad91640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba24106850 0x7fba241a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2ad91640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba24111b30 con 0x7fba24106850 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2ad91640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba241119b0 con 0x7fba24101c00 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2ad91640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fba24111cb0 con 0x7fba241025c0 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2932e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba24106850 0x7fba241a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2932e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba24106850 0x7fba241a4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33280/0 (socket says 172.21.15.86:33280) 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2932e640 1 -- 172.21.15.86:0/939871114 learned_addr learned my addr 172.21.15.86:0/939871114 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2932e640 1 -- 172.21.15.86:0/939871114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba241025c0 msgr2=0x7fba2419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2932e640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba241025c0 0x7fba2419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba2932e640 1 -- 172.21.15.86:0/939871114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba24101c00 msgr2=0x7fba24199dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.272+0000 7fba28b2d640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba24101c00 0x7fba24199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.273+0000 7fba2932e640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba24101c00 0x7fba24199dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.273+0000 7fba2932e640 1 -- 172.21.15.86:0/939871114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba241a5390 con 0x7fba24106850 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.273+0000 7fba2932e640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba24106850 0x7fba241a4e50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009a20 tx=0x7fba1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.273+0000 7fba21ffb640 1 -- 172.21.15.86:0/939871114 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c03f030 con 0x7fba24106850 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.273+0000 7fba21ffb640 1 -- 172.21.15.86:0/939871114 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba1c003aa0 con 0x7fba24106850 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.273+0000 7fba2ad91640 1 -- 172.21.15.86:0/939871114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba241a5560 con 0x7fba24106850 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.273+0000 7fba21ffb640 1 -- 172.21.15.86:0/939871114 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c035070 con 0x7fba24106850 2024-05-12T11:10:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.273+0000 7fba2ad91640 1 -- 172.21.15.86:0/939871114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba241a5a20 con 0x7fba24106850 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba21ffb640 1 -- 172.21.15.86:0/939871114 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) ==== 149936+0+0 (secure 0 0 0) 0x7fba1c042030 con 0x7fba24106850 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba2db82740 1 Processor -- start 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba2db82740 1 -- start start 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba2db82740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba2db82740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abd8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba2db82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 0x55d71abdb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba2db82740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d71ab335d0 con 0x55d71abce830 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba2db82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d71aaec890 con 0x55d71abd90f0 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba2db82740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d71ab2f590 con 0x55d71abcdf10 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba28b2d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abd8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba28b2d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abd8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33284/0 (socket says 172.21.15.86:33284) 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba28b2d640 1 -- 172.21.15.86:0/320511766 learned_addr learned my addr 172.21.15.86:0/320511766 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba23fff640 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba23fff640 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 0x55d71abdb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba28b2d640 1 -- 172.21.15.86:0/320511766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 msgr2=0x55d71abce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba28b2d640 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba28b2d640 1 -- 172.21.15.86:0/320511766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 msgr2=0x55d71abdb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba28b2d640 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 0x55d71abdb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba28b2d640 1 -- 172.21.15.86:0/320511766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d71a845210 con 0x55d71abce830 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.276+0000 7fba21ffb640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fba100b2bb0 0x7fba100b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.277+0000 7fba23fff640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fba100b2bb0 0x7fba100b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.277+0000 7fba28b2d640 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abd8bb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00ba30 tx=0x7fba0c00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c32b16b57731337 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.277+0000 7fba21ffb640 1 -- 172.21.15.86:0/939871114 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fba1c1031d0 con 0x7fba24106850 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.277+0000 7fba1affd640 1 -- 172.21.15.86:0/320511766 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c017420 con 0x55d71abce830 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.277+0000 7fba1affd640 1 -- 172.21.15.86:0/320511766 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba0c017a70 con 0x55d71abce830 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.277+0000 7fba1affd640 1 -- 172.21.15.86:0/320511766 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00fa10 con 0x55d71abce830 2024-05-12T11:10:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 -- 172.21.15.86:0/320511766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 msgr2=0x55d71abd8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba23fff640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fba100b2bb0 0x7fba100b5070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55d71abcb840 tx=0x7fba14005e40 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abd8bb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00ba30 tx=0x7fba0c00bef0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 -- 172.21.15.86:0/320511766 shutdown_connections 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 0x55d71abdb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abd8bb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 --2- 172.21.15.86:0/320511766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 -- 172.21.15.86:0/320511766 >> 172.21.15.86:0/320511766 conn(0x55d71abca420 msgr2=0x55d71abca800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 -- 172.21.15.86:0/320511766 shutdown_connections 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 -- 172.21.15.86:0/320511766 wait complete. 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 -- start start 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.278+0000 7fba2db82740 1 Processor -- start 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abd6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abd6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abd90f0 0x55d71abd6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d71abdbd20 con 0x55d71abd90f0 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d71aaf0370 con 0x55d71abce830 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d71abdbea0 con 0x55d71abcdf10 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 10 client.0 _ll_register_callbacks cb 0x55d71a844a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abd90f0 0x55d71abd6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abd90f0 0x55d71abd6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33288/0 (socket says 172.21.15.86:33288) 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 -- 172.21.15.86:0/4151756349 learned_addr learned my addr 172.21.15.86:0/4151756349 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba28b2d640 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abd6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba23fff640 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abd6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 -- 172.21.15.86:0/4151756349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 msgr2=0x55d71abd6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abd6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 -- 172.21.15.86:0/4151756349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 msgr2=0x55d71abd6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abd6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 -- 172.21.15.86:0/4151756349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d71a911620 con 0x55d71abd90f0 2024-05-12T11:10:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2932e640 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abd90f0 0x55d71abd6ac0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba1c100f60 tx=0x7fba1c0c97f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83ccdfebf00876b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba03fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba03fff640 1 -- 172.21.15.86:0/4151756349 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c049040 con 0x55d71abd90f0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba03fff640 1 -- 172.21.15.86:0/4151756349 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fba1c0c6250 con 0x55d71abd90f0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 1 -- 172.21.15.86:0/4151756349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba0c017a70 con 0x55d71abd90f0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba03fff640 1 -- 172.21.15.86:0/4151756349 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fba1c0ce370 con 0x55d71abd90f0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 10 client.15603 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.279+0000 7fba2db82740 1 -- 172.21.15.86:0/4151756349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d71abe7ba0 con 0x55d71abd90f0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba03fff640 1 -- 172.21.15.86:0/4151756349 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba0c017a70 con 0x55d71abd90f0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba03fff640 1 -- 172.21.15.86:0/4151756349 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fba1c0cc070 con 0x55d71abd90f0 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba2db82740 10 client.15603 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba2db82740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba2db82740 20 client.15603 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba2db82740 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55d71abe9080 0x55d71abeb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba2db82740 4 client.15603 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:10:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba2db82740 1 -- 172.21.15.86:0/4151756349 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d71ab411e0 con 0x55d71abe9080 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba28b2d640 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55d71abe9080 0x55d71abeb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba03fff640 10 client.15603 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.280+0000 7fba28b2d640 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55d71abe9080 0x55d71abeb500 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26935c298ec28b5d server_cookie=713e7504b1f0dd34 in_seq=0 out_seq=0 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba03fff640 1 -- 172.21.15.86:0/4151756349 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d71ab411e0 con 0x55d71abe9080 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba03fff640 10 client.15603 handle_command_reply: tid=0 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 client.15603 shutdown 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 -- 172.21.15.86:0/4151756349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abd90f0 msgr2=0x55d71abd6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abd90f0 0x55d71abd6ac0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba1c100f60 tx=0x7fba1c0c97f0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 -- 172.21.15.86:0/4151756349 shutdown_connections 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55d71abe9080 0x55d71abeb500 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abd90f0 0x55d71abd6ac0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abd6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 --2- 172.21.15.86:0/4151756349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abd6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba03fff640 0 client.15603 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:46.278 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.281+0000 7fba2db82740 1 -- 172.21.15.86:0/4151756349 >> 172.21.15.86:0/4151756349 conn(0x55d71abca420 msgr2=0x55d71abd0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:46.279 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.282+0000 7fba2db82740 1 -- 172.21.15.86:0/4151756349 shutdown_connections 2024-05-12T11:10:46.279 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.282+0000 7fba2db82740 1 -- 172.21.15.86:0/4151756349 wait complete. 2024-05-12T11:10:46.279 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.282+0000 7fba2db82740 20 client.15603 trim_cache size 0 max 16384 2024-05-12T11:10:46.293 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2db82740 1 Processor -- start 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2db82740 1 -- start start 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2db82740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abd08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2db82740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abc9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2db82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 0x55d71abf0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2db82740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba241ae4b0 con 0x55d71abce830 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2db82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba241afff0 con 0x55d71abd90f0 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2db82740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fba241aeb80 con 0x55d71abcdf10 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba23fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abc9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba23fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abc9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33302/0 (socket says 172.21.15.86:33302) 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba23fff640 1 -- 172.21.15.86:0/2588505056 learned_addr learned my addr 172.21.15.86:0/2588505056 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba28b2d640 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abd08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba23fff640 1 -- 172.21.15.86:0/2588505056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 msgr2=0x55d71abd08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba23fff640 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abd08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba23fff640 1 -- 172.21.15.86:0/2588505056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 msgr2=0x55d71abf0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba2932e640 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 0x55d71abf0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba23fff640 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 0x55d71abf0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.297+0000 7fba23fff640 1 -- 172.21.15.86:0/2588505056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d71abd4ff0 con 0x55d71abce830 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba23fff640 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abc9400 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fba14011540 tx=0x7fba14012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee3c9871dfa1003 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba1a7fc640 1 -- 172.21.15.86:0/2588505056 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1401e5b0 con 0x55d71abce830 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba1a7fc640 1 -- 172.21.15.86:0/2588505056 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba1401ec00 con 0x55d71abce830 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba1a7fc640 1 -- 172.21.15.86:0/2588505056 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba14026cb0 con 0x55d71abce830 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 -- 172.21.15.86:0/2588505056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 msgr2=0x55d71abc9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abc9400 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fba14011540 tx=0x7fba14012000 comp rx=0 tx=0).stop 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 -- 172.21.15.86:0/2588505056 shutdown_connections 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abd90f0 0x55d71abf0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abce830 0x55d71abc9400 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 --2- 172.21.15.86:0/2588505056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abcdf10 0x55d71abd08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 -- 172.21.15.86:0/2588505056 >> 172.21.15.86:0/2588505056 conn(0x55d71abca420 msgr2=0x55d71abc8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 -- 172.21.15.86:0/2588505056 shutdown_connections 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.298+0000 7fba2db82740 1 -- 172.21.15.86:0/2588505056 wait complete. 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 1 -- start start 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 1 Processor -- start 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abcdf10 0x55d71abdd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abdd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abd90f0 0x55d71ac529c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba241af920 con 0x55d71abcdf10 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba241af250 con 0x55d71abce830 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fba241ac490 con 0x55d71abd90f0 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba2db82740 10 client.0 _ll_register_callbacks cb 0x7fba1c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba28b2d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abcdf10 0x55d71abdd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba28b2d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abcdf10 0x55d71abdd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33312/0 (socket says 172.21.15.86:33312) 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba28b2d640 1 -- 172.21.15.86:0/1760788939 learned_addr learned my addr 172.21.15.86:0/1760788939 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba23fff640 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abdd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba28b2d640 1 -- 172.21.15.86:0/1760788939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abd90f0 msgr2=0x55d71ac529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba28b2d640 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abd90f0 0x55d71ac529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.299+0000 7fba28b2d640 1 -- 172.21.15.86:0/1760788939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 msgr2=0x55d71abdd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba28b2d640 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abdd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba28b2d640 1 -- 172.21.15.86:0/1760788939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d71abce660 con 0x55d71abcdf10 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba23fff640 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abdd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba28b2d640 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abcdf10 0x55d71abdd490 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00d7d0 tx=0x7fba0c00dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70d7f2d51fedb34 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba03fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba03fff640 1 -- 172.21.15.86:0/1760788939 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c005250 con 0x55d71abcdf10 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba03fff640 1 -- 172.21.15.86:0/1760788939 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fba0c01d040 con 0x55d71abcdf10 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 1 -- 172.21.15.86:0/1760788939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba1401ec00 con 0x55d71abcdf10 2024-05-12T11:10:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba03fff640 1 -- 172.21.15.86:0/1760788939 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fba0c03a050 con 0x55d71abcdf10 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 10 client.15609 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 1 -- 172.21.15.86:0/1760788939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d71ac540a0 con 0x55d71abcdf10 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba03fff640 1 -- 172.21.15.86:0/1760788939 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba1401ec00 con 0x55d71abcdf10 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba03fff640 1 -- 172.21.15.86:0/1760788939 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fba0c035030 con 0x55d71abcdf10 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 10 client.15609 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 10 client.15609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 20 client.15609 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55d71ac54540 0x55d71ac56980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 4 client.15609 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.300+0000 7fba2db82740 1 -- 172.21.15.86:0/1760788939 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d71ab3b050 con 0x55d71ac54540 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.301+0000 7fba23fff640 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55d71ac54540 0x55d71ac56980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.301+0000 7fba03fff640 10 client.15609 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.301+0000 7fba23fff640 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55d71ac54540 0x55d71ac56980 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf92ae17ef7f6ca2 server_cookie=52243ee94aad06da in_seq=0 out_seq=0 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba03fff640 1 -- 172.21.15.86:0/1760788939 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d71ab3b050 con 0x55d71ac54540 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba03fff640 10 client.15609 handle_command_reply: tid=0 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 client.15609 shutdown 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 -- 172.21.15.86:0/1760788939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abcdf10 msgr2=0x55d71abdd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abcdf10 0x55d71abdd490 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00d7d0 tx=0x7fba0c00dee0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 -- 172.21.15.86:0/1760788939 shutdown_connections 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55d71ac54540 0x55d71ac56980 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d71abd90f0 0x55d71ac529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d71abce830 0x55d71abdd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba03fff640 0 client.15609 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:46.300 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 --2- 172.21.15.86:0/1760788939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d71abcdf10 0x55d71abdd490 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 -- 172.21.15.86:0/1760788939 >> 172.21.15.86:0/1760788939 conn(0x55d71abca420 msgr2=0x55d71abd6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 -- 172.21.15.86:0/1760788939 shutdown_connections 2024-05-12T11:10:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 1 -- 172.21.15.86:0/1760788939 wait complete. 2024-05-12T11:10:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.305+0000 7fba2db82740 20 client.15609 trim_cache size 0 max 16384 2024-05-12T11:10:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:10:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:10:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:10:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 -- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fba100b2bb0 msgr2=0x7fba100b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fba100b2bb0 0x7fba100b5070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55d71abcb840 tx=0x7fba14005e40 comp rx=0 tx=0).stop 2024-05-12T11:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 -- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba24106850 msgr2=0x7fba241a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba24106850 0x7fba241a4e50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009a20 tx=0x7fba1c004270 comp rx=0 tx=0).stop 2024-05-12T11:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 -- 172.21.15.86:0/939871114 shutdown_connections 2024-05-12T11:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fba100b2bb0 0x7fba100b5070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba24106850 0x7fba241a4e50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba241025c0 0x7fba2419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 --2- 172.21.15.86:0/939871114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba24101c00 0x7fba24199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 -- 172.21.15.86:0/939871114 >> 172.21.15.86:0/939871114 conn(0x7fba240776b0 msgr2=0x7fba240ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 -- 172.21.15.86:0/939871114 shutdown_connections 2024-05-12T11:10:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:46.306+0000 7fba2ad91640 1 -- 172.21.15.86:0/939871114 wait complete. 2024-05-12T11:10:47.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:47 smithi086 ceph-mon[30110]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:47.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:47 smithi172 ceph-mon[34517]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:47.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:47 smithi176 ceph-mon[34357]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:49.461 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:49 smithi086 ceph-mon[30110]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:49.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:49 smithi172 ceph-mon[34517]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:49.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:49 smithi176 ceph-mon[34357]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:10:51.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:51 smithi086 ceph-mon[30110]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:10:51.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:51 smithi172 ceph-mon[34517]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:10:51.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:51 smithi176 ceph-mon[34357]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:10:53.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:53 smithi086 ceph-mon[30110]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:10:53.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:53 smithi172 ceph-mon[34517]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:10:53.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:53 smithi176 ceph-mon[34357]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:10:55.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:55 smithi086 ceph-mon[30110]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:10:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:55 smithi172 ceph-mon[34517]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:10:55.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:55 smithi176 ceph-mon[34357]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:10:57.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:57 smithi086 ceph-mon[30110]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:57.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:57 smithi086 ceph-mon[30110]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-05-12T11:10:57.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:57 smithi172 ceph-mon[34517]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:57.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:57 smithi172 ceph-mon[34517]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-05-12T11:10:57.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:57 smithi176 ceph-mon[34357]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-12T11:10:57.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:57 smithi176 ceph-mon[34357]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-05-12T11:10:58.718 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.0 2024-05-12T11:10:58.718 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:10:58.980 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:10:59.362 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:10:59 smithi086 ceph-mon[30110]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.403+0000 7eff7c97f640 1 -- 172.21.15.86:0/1861632076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 msgr2=0x7eff7810ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.403+0000 7eff7c97f640 1 --2- 172.21.15.86:0/1861632076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 0x7eff7810ca50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009900 tx=0x7eff6c02a480 comp rx=0 tx=0).stop 2024-05-12T11:10:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.403+0000 7eff7c97f640 1 -- 172.21.15.86:0/1861632076 shutdown_connections 2024-05-12T11:10:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.403+0000 7eff7c97f640 1 --2- 172.21.15.86:0/1861632076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff7810cf90 0x7eff7810f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.403+0000 7eff7c97f640 1 --2- 172.21.15.86:0/1861632076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 0x7eff7810ca50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.403+0000 7eff7c97f640 1 --2- 172.21.15.86:0/1861632076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff78103c50 0x7eff78104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.403+0000 7eff7c97f640 1 -- 172.21.15.86:0/1861632076 >> 172.21.15.86:0/1861632076 conn(0x7eff78078a00 msgr2=0x7eff78078e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.404+0000 7eff7c97f640 1 -- 172.21.15.86:0/1861632076 shutdown_connections 2024-05-12T11:10:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.404+0000 7eff7c97f640 1 -- 172.21.15.86:0/1861632076 wait complete. 2024-05-12T11:10:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7c97f640 1 Processor -- start 2024-05-12T11:10:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7c97f640 1 -- start start 2024-05-12T11:10:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7c97f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff78103c50 0x7eff78199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7c97f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 0x7eff78199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7c97f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff7810cf90 0x7eff7819d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7c97f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7eff78112c90 con 0x7eff78104570 2024-05-12T11:10:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7c97f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff78112b10 con 0x7eff78103c50 2024-05-12T11:10:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7c97f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff78112e10 con 0x7eff7810cf90 2024-05-12T11:10:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff78103c50 0x7eff78199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff78103c50 0x7eff78199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.86:33876/0 (socket says 172.21.15.86:33876) 2024-05-12T11:10:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff7659c640 1 -- 172.21.15.86:0/179052775 learned_addr learned my addr 172.21.15.86:0/179052775 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff75d9b640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 0x7eff78199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.405+0000 7eff76d9d640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff7810cf90 0x7eff7819d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff7659c640 1 -- 172.21.15.86:0/179052775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff7810cf90 msgr2=0x7eff7819d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff7659c640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff7810cf90 0x7eff7819d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff7659c640 1 -- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 msgr2=0x7eff78199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff7659c640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 0x7eff78199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff7659c640 1 -- 172.21.15.86:0/179052775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7819e0f0 con 0x7eff78103c50 2024-05-12T11:10:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff75d9b640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 0x7eff78199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:10:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff7659c640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff78103c50 0x7eff78199150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff6800ea60 tx=0x7eff6800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff677fe640 1 -- 172.21.15.86:0/179052775 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6800cde0 con 0x7eff78103c50 2024-05-12T11:10:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff677fe640 1 -- 172.21.15.86:0/179052775 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff680035f0 con 0x7eff78103c50 2024-05-12T11:10:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff7c97f640 1 -- 172.21.15.86:0/179052775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7819e3e0 con 0x7eff78103c50 2024-05-12T11:10:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff677fe640 1 -- 172.21.15.86:0/179052775 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68010690 con 0x7eff78103c50 2024-05-12T11:10:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.406+0000 7eff7c97f640 1 -- 172.21.15.86:0/179052775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff781a5c70 con 0x7eff78103c50 2024-05-12T11:10:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.408+0000 7eff7f772740 1 Processor -- start 2024-05-12T11:10:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff7f772740 1 -- start start 2024-05-12T11:10:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff677fe640 1 -- 172.21.15.86:0/179052775 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7eff680037a0 con 0x7eff78103c50 2024-05-12T11:10:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff7f772740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff7f772740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 0x5578a3e33bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff7f772740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 0x5578a3e364e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff7f772740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5578a3d8e5d0 con 0x5578a3e28f10 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff7f772740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5578a3d47890 con 0x5578a3e340f0 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff7f772740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5578a3d8a590 con 0x5578a3e29830 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff76d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff76d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e292f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48582/0 (socket says 172.21.15.86:48582) 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff76d9d640 1 -- 172.21.15.86:0/416188210 learned_addr learned my addr 172.21.15.86:0/416188210 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff75d9b640 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 0x5578a3e364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff7659c640 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 0x5578a3e33bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff76d9d640 1 -- 172.21.15.86:0/416188210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 msgr2=0x5578a3e33bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff76d9d640 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 0x5578a3e33bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff76d9d640 1 -- 172.21.15.86:0/416188210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 msgr2=0x5578a3e364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff76d9d640 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 0x5578a3e364e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.409+0000 7eff76d9d640 1 -- 172.21.15.86:0/416188210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a3aa0210 con 0x5578a3e28f10 2024-05-12T11:10:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.410+0000 7eff76d9d640 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e292f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7eff70009f40 tx=0x7eff70010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b092a06a14ea02 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.410+0000 7eff64ff9640 1 -- 172.21.15.86:0/416188210 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70003b70 con 0x5578a3e28f10 2024-05-12T11:10:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.410+0000 7eff677fe640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff600b2a10 0x7eff600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.410+0000 7eff64ff9640 1 -- 172.21.15.86:0/416188210 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff70003d10 con 0x5578a3e28f10 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.410+0000 7eff64ff9640 1 -- 172.21.15.86:0/416188210 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70011960 con 0x5578a3e28f10 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.410+0000 7eff7659c640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff600b2a10 0x7eff600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.410+0000 7eff677fe640 1 -- 172.21.15.86:0/179052775 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7eff680e2970 con 0x7eff78103c50 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 -- 172.21.15.86:0/416188210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 msgr2=0x5578a3e292f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7659c640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff600b2a10 0x7eff600b4ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff680e5fd0 tx=0x7eff680cc040 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e292f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7eff70009f40 tx=0x7eff70010860 comp rx=0 tx=0).stop 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 -- 172.21.15.86:0/416188210 shutdown_connections 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 0x5578a3e364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 0x5578a3e33bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 --2- 172.21.15.86:0/416188210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e292f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 -- 172.21.15.86:0/416188210 >> 172.21.15.86:0/416188210 conn(0x5578a3e25420 msgr2=0x5578a3e25800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 -- 172.21.15.86:0/416188210 shutdown_connections 2024-05-12T11:10:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 -- 172.21.15.86:0/416188210 wait complete. 2024-05-12T11:10:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 -- start start 2024-05-12T11:10:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.411+0000 7eff7f772740 1 Processor -- start 2024-05-12T11:10:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff7f772740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e310d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff7f772740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 0x5578a3e31610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff7f772740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 0x5578a3e31b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff7f772740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5578a3e36d20 con 0x5578a3e28f10 2024-05-12T11:10:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff7f772740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5578a3d4b370 con 0x5578a3e340f0 2024-05-12T11:10:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff7f772740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5578a3e36ea0 con 0x5578a3e29830 2024-05-12T11:10:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff7f772740 10 client.0 _ll_register_callbacks cb 0x5578a3a9fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e310d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48586/0 (socket says 172.21.15.86:48586) 2024-05-12T11:10:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 -- 172.21.15.86:0/4149689257 learned_addr learned my addr 172.21.15.86:0/4149689257 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff75d9b640 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 0x5578a3e31610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 0x5578a3e31b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 -- 172.21.15.86:0/4149689257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 msgr2=0x5578a3e31610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 0x5578a3e31610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 -- 172.21.15.86:0/4149689257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 msgr2=0x5578a3e31b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 0x5578a3e31b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 -- 172.21.15.86:0/4149689257 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a3b6c620 con 0x5578a3e28f10 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff76d9d640 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e310d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7eff70005c40 tx=0x7eff70009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a8ea0446976081 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.412+0000 7eff5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.413+0000 7eff5dffb640 1 -- 172.21.15.86:0/4149689257 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70011b70 con 0x5578a3e28f10 2024-05-12T11:10:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.413+0000 7eff5dffb640 1 -- 172.21.15.86:0/4149689257 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7eff70011d10 con 0x5578a3e28f10 2024-05-12T11:10:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.413+0000 7eff7f772740 1 -- 172.21.15.86:0/4149689257 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff70003d10 con 0x5578a3e28f10 2024-05-12T11:10:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.413+0000 7eff5dffb640 1 -- 172.21.15.86:0/4149689257 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7eff70003ec0 con 0x5578a3e28f10 2024-05-12T11:10:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.413+0000 7eff7f772740 10 client.15621 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.413+0000 7eff7f772740 1 -- 172.21.15.86:0/4149689257 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5578a3e47050 con 0x5578a3e28f10 2024-05-12T11:10:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.413+0000 7eff5dffb640 1 -- 172.21.15.86:0/4149689257 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff70003d10 con 0x5578a3e28f10 2024-05-12T11:10:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff5dffb640 1 -- 172.21.15.86:0/4149689257 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7eff700053b0 con 0x5578a3e28f10 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff7f772740 10 client.15621 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff7f772740 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff7f772740 20 client.15621 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff7f772740 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5578a3e48400 0x5578a3e4a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff7f772740 4 client.15621 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff7f772740 1 -- 172.21.15.86:0/4149689257 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578a3d9c1e0 con 0x5578a3e48400 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff75d9b640 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5578a3e48400 0x5578a3e4a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff75d9b640 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5578a3e48400 0x5578a3e4a7f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a820133f032b458 server_cookie=dc649667ae0e249f in_seq=0 out_seq=0 2024-05-12T11:10:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.414+0000 7eff5dffb640 10 client.15621 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff5dffb640 1 -- 172.21.15.86:0/4149689257 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5578a3d9c1e0 con 0x5578a3e48400 2024-05-12T11:10:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff5dffb640 10 client.15621 handle_command_reply: tid=0 2024-05-12T11:10:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 client.15621 shutdown 2024-05-12T11:10:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 -- 172.21.15.86:0/4149689257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 msgr2=0x5578a3e310d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e310d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7eff70005c40 tx=0x7eff70009920 comp rx=0 tx=0).stop 2024-05-12T11:10:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 -- 172.21.15.86:0/4149689257 shutdown_connections 2024-05-12T11:10:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5578a3e48400 0x5578a3e4a7f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff5dffb640 0 client.15621 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e340f0 0x5578a3e31b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e29830 0x5578a3e31610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 --2- 172.21.15.86:0/4149689257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e310d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 -- 172.21.15.86:0/4149689257 >> 172.21.15.86:0/4149689257 conn(0x5578a3e25420 msgr2=0x5578a3e2b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 -- 172.21.15.86:0/4149689257 shutdown_connections 2024-05-12T11:10:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 1 -- 172.21.15.86:0/4149689257 wait complete. 2024-05-12T11:10:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.415+0000 7eff7f772740 20 client.15621 trim_cache size 0 max 16384 2024-05-12T11:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.430+0000 7eff7f772740 1 Processor -- start 2024-05-12T11:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.430+0000 7eff7f772740 1 -- start start 2024-05-12T11:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.430+0000 7eff7f772740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.430+0000 7eff7f772740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e29830 0x5578a3e30880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.430+0000 7eff7f772740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 0x5578a3e4fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff7f772740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7eff781ac480 con 0x5578a3e28f10 2024-05-12T11:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff7f772740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff781adfc0 con 0x5578a3e29830 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff7f772740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff781acb50 con 0x5578a3e340f0 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e247c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48598/0 (socket says 172.21.15.86:48598) 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 -- 172.21.15.86:0/3954540530 learned_addr learned my addr 172.21.15.86:0/3954540530 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff75d9b640 1 --2- 172.21.15.86:0/3954540530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e29830 0x5578a3e30880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 -- 172.21.15.86:0/3954540530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 msgr2=0x5578a3e4fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 --2- 172.21.15.86:0/3954540530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 0x5578a3e4fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 -- 172.21.15.86:0/3954540530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e29830 msgr2=0x5578a3e30880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 --2- 172.21.15.86:0/3954540530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e29830 0x5578a3e30880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 -- 172.21.15.86:0/3954540530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a3e2f620 con 0x5578a3e28f10 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff76d9d640 1 --2- 172.21.15.86:0/3954540530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e247c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7eff70002230 tx=0x7eff700096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b46e25d88551eb server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff5ffff640 1 -- 172.21.15.86:0/3954540530 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70010d60 con 0x5578a3e28f10 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff5ffff640 1 -- 172.21.15.86:0/3954540530 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff70020070 con 0x5578a3e28f10 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.431+0000 7eff5ffff640 1 -- 172.21.15.86:0/3954540530 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70005080 con 0x5578a3e28f10 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 -- 172.21.15.86:0/3954540530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 msgr2=0x5578a3e247c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 --2- 172.21.15.86:0/3954540530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e247c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7eff70002230 tx=0x7eff700096b0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 -- 172.21.15.86:0/3954540530 shutdown_connections 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 --2- 172.21.15.86:0/3954540530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 0x5578a3e4fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 --2- 172.21.15.86:0/3954540530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e29830 0x5578a3e30880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 --2- 172.21.15.86:0/3954540530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e28f10 0x5578a3e247c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 -- 172.21.15.86:0/3954540530 >> 172.21.15.86:0/3954540530 conn(0x5578a3e25420 msgr2=0x5578a3e2b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 -- 172.21.15.86:0/3954540530 shutdown_connections 2024-05-12T11:10:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 -- 172.21.15.86:0/3954540530 wait complete. 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.432+0000 7eff7f772740 1 -- start start 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff7f772740 1 Processor -- start 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff7f772740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e28f10 0x5578a3e40c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff7f772740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e29830 0x5578a3e2dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff7f772740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 0x5578a3e2e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff7f772740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7eff781ad8f0 con 0x5578a3e29830 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff7f772740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff781ad220 con 0x5578a3e28f10 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff7f772740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff781aa460 con 0x5578a3e340f0 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e29830 0x5578a3e2dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e29830 0x5578a3e2dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48610/0 (socket says 172.21.15.86:48610) 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 -- 172.21.15.86:0/3849915959 learned_addr learned my addr 172.21.15.86:0/3849915959 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff7f772740 10 client.0 _ll_register_callbacks cb 0x7eff700093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff76d9d640 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e28f10 0x5578a3e40c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff76d9d640 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 0x5578a3e2e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 -- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 msgr2=0x5578a3e2e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 0x5578a3e2e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 -- 172.21.15.86:0/3849915959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e28f10 msgr2=0x5578a3e40c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e28f10 0x5578a3e40c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 -- 172.21.15.86:0/3849915959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a3eb1970 con 0x5578a3e29830 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff76d9d640 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 0x5578a3e2e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff75d9b640 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e29830 0x5578a3e2dd80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7eff6c005ab0 tx=0x7eff6c005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa5a5c1d7b5833f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.433+0000 7eff5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff5dffb640 1 -- 172.21.15.86:0/3849915959 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c035040 con 0x5578a3e29830 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff5dffb640 1 -- 172.21.15.86:0/3849915959 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7eff6c004b80 con 0x5578a3e29830 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 1 -- 172.21.15.86:0/3849915959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff70020070 con 0x5578a3e29830 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff5dffb640 1 -- 172.21.15.86:0/3849915959 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7eff6c004d80 con 0x5578a3e29830 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 10 client.15627 fetch_fsmap learned FSMap version 29 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 1 -- 172.21.15.86:0/3849915959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5578a3eb2b50 con 0x5578a3e29830 2024-05-12T11:10:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff5dffb640 1 -- 172.21.15.86:0/3849915959 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff70020070 con 0x5578a3e29830 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff5dffb640 1 -- 172.21.15.86:0/3849915959 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7eff6c0035f0 con 0x5578a3e29830 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 10 client.15627 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 20 client.15627 populate_metadata read hostname 'smithi086' 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5578a3e48400 0x5578a3eb52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 4 client.15627 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.434+0000 7eff7f772740 1 -- 172.21.15.86:0/3849915959 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578a3d96050 con 0x5578a3e48400 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.436+0000 7eff76d9d640 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5578a3e48400 0x5578a3eb52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.439+0000 7eff76d9d640 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5578a3e48400 0x5578a3eb52f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eb0b6884c7cfe17 server_cookie=f4c7709c504a6ff5 in_seq=0 out_seq=0 2024-05-12T11:10:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.439+0000 7eff5dffb640 10 client.15627 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff5dffb640 1 -- 172.21.15.86:0/3849915959 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578a3d96050 con 0x5578a3e48400 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff5dffb640 10 client.15627 handle_command_reply: tid=0 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 client.15627 shutdown 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 -- 172.21.15.86:0/3849915959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e29830 msgr2=0x5578a3e2dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e29830 0x5578a3e2dd80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7eff6c005ab0 tx=0x7eff6c005430 comp rx=0 tx=0).stop 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 -- 172.21.15.86:0/3849915959 shutdown_connections 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5578a3e48400 0x5578a3eb52f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5578a3e340f0 0x5578a3e2e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578a3e29830 0x5578a3e2dd80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff5dffb640 0 client.15627 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 --2- 172.21.15.86:0/3849915959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578a3e28f10 0x5578a3e40c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.445+0000 7eff7f772740 1 -- 172.21.15.86:0/3849915959 >> 172.21.15.86:0/3849915959 conn(0x5578a3e25420 msgr2=0x5578a3e2a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7f772740 1 -- 172.21.15.86:0/3849915959 shutdown_connections 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7f772740 1 -- 172.21.15.86:0/3849915959 wait complete. 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7f772740 20 client.15627 trim_cache size 0 max 16384 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:10:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:10:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 -- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff600b2a10 msgr2=0x7eff600b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff600b2a10 0x7eff600b4ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff680e5fd0 tx=0x7eff680cc040 comp rx=0 tx=0).stop 2024-05-12T11:10:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 -- 172.21.15.86:0/179052775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff78103c50 msgr2=0x7eff78199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:10:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff78103c50 0x7eff78199150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff6800ea60 tx=0x7eff6800ef20 comp rx=0 tx=0).stop 2024-05-12T11:10:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 -- 172.21.15.86:0/179052775 shutdown_connections 2024-05-12T11:10:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7eff600b2a10 0x7eff600b4ed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff7810cf90 0x7eff7819d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff78104570 0x7eff78199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 --2- 172.21.15.86:0/179052775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff78103c50 0x7eff78199150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:10:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 -- 172.21.15.86:0/179052775 >> 172.21.15.86:0/179052775 conn(0x7eff78078a00 msgr2=0x7eff780fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:10:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 -- 172.21.15.86:0/179052775 shutdown_connections 2024-05-12T11:10:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:10:59.446+0000 7eff7c97f640 1 -- 172.21.15.86:0/179052775 wait complete. 2024-05-12T11:10:59.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:10:59 smithi172 ceph-mon[34517]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:10:59.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:10:59 smithi176 ceph-mon[34357]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.774+0000 7fd24c508700 1 -- 172.21.15.86:0/156489301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244101a90 msgr2=0x7fd244101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.774+0000 7fd24c508700 1 --2- 172.21.15.86:0/156489301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244101a90 0x7fd244101f10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd234009990 tx=0x7fd234009ca0 comp rx=0 tx=0).stop 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 -- 172.21.15.86:0/156489301 shutdown_connections 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 --2- 172.21.15.86:0/156489301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd244102450 0x7fd244110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 --2- 172.21.15.86:0/156489301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd244109520 0x7fd244109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 --2- 172.21.15.86:0/156489301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244101a90 0x7fd244101f10 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 -- 172.21.15.86:0/156489301 >> 172.21.15.86:0/156489301 conn(0x7fd244078a10 msgr2=0x7fd2440ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 -- 172.21.15.86:0/156489301 shutdown_connections 2024-05-12T11:11:00.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 -- 172.21.15.86:0/156489301 wait complete. 2024-05-12T11:11:00.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 Processor -- start 2024-05-12T11:11:00.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 -- start start 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.775+0000 7fd24c508700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd244101a90 0x7fd24419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24c508700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd244102450 0x7fd24419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24c508700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244109520 0x7fd244199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24c508700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd2441136b0 con 0x7fd244109520 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24c508700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd244113530 con 0x7fd244101a90 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24c508700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd244113830 con 0x7fd244102450 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244109520 0x7fd244199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24a2a4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd244101a90 0x7fd24419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244109520 0x7fd244199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48624/0 (socket says 172.21.15.86:48624) 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 -- 172.21.15.86:0/2509439028 learned_addr learned my addr 172.21.15.86:0/2509439028 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd249aa3700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd244102450 0x7fd24419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:00.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 -- 172.21.15.86:0/2509439028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd244102450 msgr2=0x7fd24419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:00.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd244102450 0x7fd24419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:00.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 -- 172.21.15.86:0/2509439028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd244101a90 msgr2=0x7fd24419f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:00.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd244101a90 0x7fd24419f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:00.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 -- 172.21.15.86:0/2509439028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24419a0d0 con 0x7fd244109520 2024-05-12T11:11:00.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd249aa3700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd244102450 0x7fd24419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24aaa5700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244109520 0x7fd244199970 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00b970 tx=0x7fd23c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd23b7fe700 1 -- 172.21.15.86:0/2509439028 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c019070 con 0x7fd244109520 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd23b7fe700 1 -- 172.21.15.86:0/2509439028 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd23c00cde0 con 0x7fd244109520 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd23b7fe700 1 -- 172.21.15.86:0/2509439028 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c007370 con 0x7fd244109520 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.776+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24419a3c0 con 0x7fd244109520 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.777+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2441a6680 con 0x7fd244109520 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.777+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24406a190 con 0x7fd244109520 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.779+0000 7fd23b7fe700 1 -- 172.21.15.86:0/2509439028 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd23c01c070 con 0x7fd244109520 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.780+0000 7fd23b7fe700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2300b29f0 0x7fd2300b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.780+0000 7fd24a2a4700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2300b29f0 0x7fd2300b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.780+0000 7fd23b7fe700 1 -- 172.21.15.86:0/2509439028 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fd23c0e2110 con 0x7fd244109520 2024-05-12T11:11:00.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.780+0000 7fd24a2a4700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2300b29f0 0x7fd2300b4eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd24419aab0 tx=0x7fd24000a380 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:00.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:00.783+0000 7fd23b7fe700 1 -- 172.21.15.86:0/2509439028 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd23c023070 con 0x7fd244109520 2024-05-12T11:11:01.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.042+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd24419aea0 con 0x7fd244109520 2024-05-12T11:11:01.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.043+0000 7fd23b7fe700 1 -- 172.21.15.86:0/2509439028 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7fd23c0a9c00 con 0x7fd244109520 2024-05-12T11:11:01.034 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:11:01.035 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:11:01.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2300b29f0 msgr2=0x7fd2300b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:01.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2300b29f0 0x7fd2300b4eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd24419aab0 tx=0x7fd24000a380 comp rx=0 tx=0).stop 2024-05-12T11:11:01.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244109520 msgr2=0x7fd244199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:01.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244109520 0x7fd244199970 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00b970 tx=0x7fd23c00bc80 comp rx=0 tx=0).stop 2024-05-12T11:11:01.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 shutdown_connections 2024-05-12T11:11:01.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2300b29f0 0x7fd2300b4eb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:01.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd244109520 0x7fd244199970 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:01.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd244101a90 0x7fd24419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:01.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 --2- 172.21.15.86:0/2509439028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd244102450 0x7fd24419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:01.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.045+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 >> 172.21.15.86:0/2509439028 conn(0x7fd244078a10 msgr2=0x7fd244100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:01.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.046+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 shutdown_connections 2024-05-12T11:11:01.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:01.046+0000 7fd24c508700 1 -- 172.21.15.86:0/2509439028 wait complete. 2024-05-12T11:11:01.038 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:11:01.345 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:01 smithi086 ceph-mon[30110]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-05-12T11:11:01.345 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:01 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2509439028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:11:01.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:01 smithi172 ceph-mon[34517]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-05-12T11:11:01.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:01 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2509439028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:11:01.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:01 smithi176 ceph-mon[34357]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-05-12T11:11:01.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:01 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2509439028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:11:01.800 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 60 --expiration 86.0 --await-for 42.0' 2024-05-12T11:11:01.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24466 quiesce db / --timeout 60 --expiration 86.0 --await-for 42.0 2024-05-12T11:11:02.062 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:11:03.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:03 smithi086 ceph-mon[30110]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:11:03.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:03 smithi172 ceph-mon[34517]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:11:03.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:03 smithi176 ceph-mon[34357]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:11:03.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 -- 172.21.15.86:0/132906776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448103ee0 msgr2=0x7f0448110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 --2- 172.21.15.86:0/132906776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448103ee0 0x7f0448110360 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f044000b0d0 tx=0x7f044000b3e0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 -- 172.21.15.86:0/132906776 shutdown_connections 2024-05-12T11:11:03.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 --2- 172.21.15.86:0/132906776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448103ee0 0x7f0448110360 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 --2- 172.21.15.86:0/132906776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0448109590 0x7f0448109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 --2- 172.21.15.86:0/132906776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0448103520 0x7f04481039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 -- 172.21.15.86:0/132906776 >> 172.21.15.86:0/132906776 conn(0x7f044807a5c0 msgr2=0x7f044807a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:03.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 -- 172.21.15.86:0/132906776 shutdown_connections 2024-05-12T11:11:03.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.889+0000 7f044e14e700 1 -- 172.21.15.86:0/132906776 wait complete. 2024-05-12T11:11:03.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f044e14e700 1 Processor -- start 2024-05-12T11:11:03.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f044e14e700 1 -- start start 2024-05-12T11:11:03.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f044e14e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0448103520 0x7f04480757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f044e14e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0448103ee0 0x7f0448075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f044e14e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448109590 0x7f0448076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f044e14e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0448113680 con 0x7f0448109590 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f044e14e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0448113500 con 0x7f0448103520 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f044e14e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0448113800 con 0x7f0448103ee0 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f0447fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448109590 0x7f0448076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.890+0000 7f0447fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448109590 0x7f0448076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49064/0 (socket says 172.21.15.86:49064) 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0447fff700 1 -- 172.21.15.86:0/3699918044 learned_addr learned my addr 172.21.15.86:0/3699918044 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f04477fe700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0448103520 0x7f04480757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0446ffd700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0448103ee0 0x7f0448075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0447fff700 1 -- 172.21.15.86:0/3699918044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0448103ee0 msgr2=0x7f0448075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0447fff700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0448103ee0 0x7f0448075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0447fff700 1 -- 172.21.15.86:0/3699918044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0448103520 msgr2=0x7f04480757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0447fff700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0448103520 0x7f04480757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0447fff700 1 -- 172.21.15.86:0/3699918044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04481ac320 con 0x7f0448109590 2024-05-12T11:11:03.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f04477fe700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0448103520 0x7f04480757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:03.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0447fff700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448109590 0x7f0448076220 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0440009850 tx=0x7f0440007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:03.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0444ff9700 1 -- 172.21.15.86:0/3699918044 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044001f070 con 0x7f0448109590 2024-05-12T11:11:03.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f0444ff9700 1 -- 172.21.15.86:0/3699918044 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0440004c50 con 0x7f0448109590 2024-05-12T11:11:03.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.891+0000 7f044e14e700 1 -- 172.21.15.86:0/3699918044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04481ac550 con 0x7f0448109590 2024-05-12T11:11:03.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.892+0000 7f0444ff9700 1 -- 172.21.15.86:0/3699918044 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044001b690 con 0x7f0448109590 2024-05-12T11:11:03.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.892+0000 7f044e14e700 1 -- 172.21.15.86:0/3699918044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04481aca50 con 0x7f0448109590 2024-05-12T11:11:03.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.895+0000 7f04589e1b80 1 Processor -- start 2024-05-12T11:11:03.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.895+0000 7f0444ff9700 1 -- 172.21.15.86:0/3699918044 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f0440022070 con 0x7f0448109590 2024-05-12T11:11:03.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.895+0000 7f04589e1b80 1 -- start start 2024-05-12T11:11:03.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.895+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 0x55e5bdbbdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.895+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbb7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f04589e1b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e5bdb09ad0 con 0x55e5bdbb84c0 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f04589e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e5bda6ef30 con 0x55e5bdbb7b00 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f04589e1b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e5bdb05a90 con 0x55e5bdbbd850 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f0446ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f0446ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49066/0 (socket says 172.21.15.86:49066) 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f0446ffd700 1 -- 172.21.15.86:0/1384353590 learned_addr learned my addr 172.21.15.86:0/1384353590 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f04477fe700 1 --2- 172.21.15.86:0/1384353590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbb7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f0446ffd700 1 -- 172.21.15.86:0/1384353590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 msgr2=0x55e5bdbbdc30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f0446ffd700 1 --2- 172.21.15.86:0/1384353590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 0x55e5bdbbdc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f0446ffd700 1 -- 172.21.15.86:0/1384353590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 msgr2=0x55e5bdbb7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f0446ffd700 1 --2- 172.21.15.86:0/1384353590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbb7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.896+0000 7f0446ffd700 1 -- 172.21.15.86:0/1384353590 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5bda56a60 con 0x55e5bdbb84c0 2024-05-12T11:11:03.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.897+0000 7f0446ffd700 1 --2- 172.21.15.86:0/1384353590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc4610 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f043c00ae30 tx=0x7f043c00f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7faa791125dfb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.897+0000 7f042dffb700 1 -- 172.21.15.86:0/1384353590 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c00fe00 con 0x55e5bdbb84c0 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.897+0000 7f042dffb700 1 -- 172.21.15.86:0/1384353590 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f043c0044d0 con 0x55e5bdbb84c0 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.897+0000 7f042dffb700 1 -- 172.21.15.86:0/1384353590 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c0053a0 con 0x55e5bdbb84c0 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.897+0000 7f0444ff9700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f04300b2b20 0x7f04300b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.897+0000 7f04477fe700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f04300b2b20 0x7f04300b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f0444ff9700 1 -- 172.21.15.86:0/3699918044 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f044000f020 con 0x7f0448109590 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f04589e1b80 1 -- 172.21.15.86:0/1384353590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb84c0 msgr2=0x55e5bdbc4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1384353590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc4610 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f043c00ae30 tx=0x7f043c00f6a0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f04477fe700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f04300b2b20 0x7f04300b4fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55e5bdbb8b80 tx=0x7f0438009260 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:03.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f04589e1b80 1 -- 172.21.15.86:0/1384353590 shutdown_connections 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1384353590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc4610 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1384353590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 0x55e5bdbbdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1384353590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbb7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.898+0000 7f04589e1b80 1 -- 172.21.15.86:0/1384353590 >> 172.21.15.86:0/1384353590 conn(0x55e5bdae3d00 msgr2=0x55e5bdbb2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.899+0000 7f04589e1b80 1 -- 172.21.15.86:0/1384353590 shutdown_connections 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.899+0000 7f04589e1b80 1 -- 172.21.15.86:0/1384353590 wait complete. 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.899+0000 7f04589e1b80 1 -- start start 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.899+0000 7f04589e1b80 1 Processor -- start 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbc41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04589e1b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e5bdbc4b50 con 0x55e5bdbb7b00 2024-05-12T11:11:03.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04589e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e5bdac3060 con 0x55e5bdbbd850 2024-05-12T11:11:03.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04589e1b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e5bdbc4cd0 con 0x55e5bdbb84c0 2024-05-12T11:11:03.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbc41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbc41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49082/0 (socket says 172.21.15.86:49082) 2024-05-12T11:11:03.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04477fe700 1 -- 172.21.15.86:0/1916823052 learned_addr learned my addr 172.21.15.86:0/1916823052 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:03.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f0446ffd700 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f0447fff700 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04477fe700 1 -- 172.21.15.86:0/1916823052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 msgr2=0x55e5bdbc1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04477fe700 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04589e1b80 10 client.0 _ll_register_callbacks cb 0x55e5bda9d740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04477fe700 1 -- 172.21.15.86:0/1916823052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbbd850 msgr2=0x55e5bdbc1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04477fe700 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f04477fe700 1 -- 172.21.15.86:0/1916823052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5bdac08f0 con 0x55e5bdbb7b00 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.900+0000 7f0447fff700 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.901+0000 7f04589e1b80 1 -- 172.21.15.86:0/1916823052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043c0044d0 con 0x55e5bdbb7b00 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.901+0000 7f04477fe700 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbc41f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f043801dad0 tx=0x7f04380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54c6e45c4891d84 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.901+0000 7f0426ffd700 10 client.15645 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.901+0000 7f0426ffd700 1 -- 172.21.15.86:0/1916823052 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438004020 con 0x55e5bdbb7b00 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.901+0000 7f0426ffd700 1 -- 172.21.15.86:0/1916823052 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f0438018030 con 0x55e5bdbb7b00 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.901+0000 7f0426ffd700 1 -- 172.21.15.86:0/1916823052 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f04380041c0 con 0x55e5bdbb7b00 2024-05-12T11:11:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.901+0000 7f04589e1b80 10 client.15645 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.901+0000 7f04589e1b80 1 -- 172.21.15.86:0/1916823052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e5bdbcf270 con 0x55e5bdbb7b00 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f0426ffd700 1 -- 172.21.15.86:0/1916823052 <== mon.0 v2:172.21.15.86:3300/0 4 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0438004360 con 0x55e5bdbb7b00 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f04589e1b80 10 client.15645 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f04589e1b80 10 client.15645 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f04589e1b80 20 client.15645 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e5bdbd17a0 0x55e5bdbd3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f04589e1b80 4 client.15645 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f04589e1b80 1 -- 172.21.15.86:0/1916823052 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5bdb174b0 con 0x55e5bdbd17a0 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f0446ffd700 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e5bdbd17a0 0x55e5bdbd3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f0426ffd700 10 client.15645 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.902+0000 7f0446ffd700 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e5bdbd17a0 0x55e5bdbd3b90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=881df2692bb62484 server_cookie=397e25792ba4bfe5 in_seq=0 out_seq=0 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f0426ffd700 1 -- 172.21.15.86:0/1916823052 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e5bdb174b0 con 0x55e5bdbd17a0 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f0426ffd700 10 client.15645 handle_command_reply: tid=0 2024-05-12T11:11:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 client.15645 shutdown 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 -- 172.21.15.86:0/1916823052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 msgr2=0x55e5bdbc41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbc41f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f043801dad0 tx=0x7f04380047c0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 -- 172.21.15.86:0/1916823052 shutdown_connections 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e5bdbd17a0 0x55e5bdbd3b90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f0426ffd700 0 client.15645 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbc41f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 --2- 172.21.15.86:0/1916823052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 -- 172.21.15.86:0/1916823052 >> 172.21.15.86:0/1916823052 conn(0x55e5bdae3d00 msgr2=0x55e5bdbbcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.903+0000 7f04589e1b80 1 -- 172.21.15.86:0/1916823052 shutdown_connections 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.904+0000 7f04589e1b80 1 -- 172.21.15.86:0/1916823052 wait complete. 2024-05-12T11:11:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.904+0000 7f04589e1b80 20 client.15645 trim_cache size 0 max 16384 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.923+0000 7f04589e1b80 1 Processor -- start 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.923+0000 7f04589e1b80 1 -- start start 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbcdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbbd850 0x55e5bdbd9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f04589e1b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b41b0 con 0x55e5bdbbd850 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f04589e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b5cf0 con 0x55e5bdbb7b00 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f04589e1b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b4880 con 0x55e5bdbb84c0 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbbd850 0x55e5bdbd9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbbd850 0x55e5bdbd9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49098/0 (socket says 172.21.15.86:49098) 2024-05-12T11:11:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 -- 172.21.15.86:0/469981992 learned_addr learned my addr 172.21.15.86:0/469981992 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0446ffd700 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f04477fe700 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbcdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 -- 172.21.15.86:0/469981992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 msgr2=0x55e5bdbc3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 -- 172.21.15.86:0/469981992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 msgr2=0x55e5bdbcdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbcdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 -- 172.21.15.86:0/469981992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5bdbb3500 con 0x55e5bdbbd850 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f04477fe700 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbcdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0446ffd700 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.924+0000 7f0447fff700 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbbd850 0x55e5bdbd9440 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f04400aa950 tx=0x7f04400aa1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25988bcfeda483fd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.925+0000 7f042d7fa700 1 -- 172.21.15.86:0/469981992 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400aa4d0 con 0x55e5bdbbd850 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.925+0000 7f042d7fa700 1 -- 172.21.15.86:0/469981992 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0440009cb0 con 0x55e5bdbbd850 2024-05-12T11:11:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.925+0000 7f042d7fa700 1 -- 172.21.15.86:0/469981992 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400b3790 con 0x55e5bdbbd850 2024-05-12T11:11:03.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 -- 172.21.15.86:0/469981992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbbd850 msgr2=0x55e5bdbd9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbbd850 0x55e5bdbd9440 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f04400aa950 tx=0x7f04400aa1b0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 -- 172.21.15.86:0/469981992 shutdown_connections 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbbd850 0x55e5bdbd9440 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbcdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 --2- 172.21.15.86:0/469981992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 -- 172.21.15.86:0/469981992 >> 172.21.15.86:0/469981992 conn(0x55e5bdae3d00 msgr2=0x55e5bdbc2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 -- 172.21.15.86:0/469981992 shutdown_connections 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 -- 172.21.15.86:0/469981992 wait complete. 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 -- start start 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.926+0000 7f04589e1b80 1 Processor -- start 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04589e1b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04589e1b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b5620 con 0x55e5bdbb7b00 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04589e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b4f50 con 0x55e5bdbb84c0 2024-05-12T11:11:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04589e1b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b2150 con 0x55e5bdbbd850 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04589e1b80 10 client.0 _ll_register_callbacks cb 0x55e5bda9d740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49112/0 (socket says 172.21.15.86:49112) 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04477fe700 1 -- 172.21.15.86:0/4248884403 learned_addr learned my addr 172.21.15.86:0/4248884403 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f0447fff700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f0446ffd700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f0447fff700 1 -- 172.21.15.86:0/4248884403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb84c0 msgr2=0x55e5bdbc6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f0447fff700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f0447fff700 1 -- 172.21.15.86:0/4248884403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 msgr2=0x55e5bdbca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f0447fff700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f0447fff700 1 -- 172.21.15.86:0/4248884403 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5bdbaf0a0 con 0x55e5bdbbd850 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f04477fe700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:03.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.927+0000 7f0446ffd700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f0447fff700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc7490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55e5bdbc2a70 tx=0x7f04400a68f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d19508bbd8b0719 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f0426ffd700 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f0426ffd700 1 -- 172.21.15.86:0/4248884403 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400aa9c0 con 0x55e5bdbbd850 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f0426ffd700 1 -- 172.21.15.86:0/4248884403 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f04400cd0b0 con 0x55e5bdbbd850 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 1 -- 172.21.15.86:0/4248884403 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0440009cb0 con 0x55e5bdbbd850 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f0426ffd700 1 -- 172.21.15.86:0/4248884403 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0440088050 con 0x55e5bdbbd850 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 10 client.25102 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 1 -- 172.21.15.86:0/4248884403 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e5bdc3cef0 con 0x55e5bdbbd850 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f0426ffd700 1 -- 172.21.15.86:0/4248884403 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0440009cb0 con 0x55e5bdbbd850 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f0426ffd700 1 -- 172.21.15.86:0/4248884403 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0440011070 con 0x55e5bdbbd850 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 10 client.25102 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 10 client.25102 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 20 client.25102 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:03.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e5bdbd17a0 0x55e5bdc3f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:03.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 4 client.25102 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.0, "await_for": 42.0}] 2024-05-12T11:11:03.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.928+0000 7f04589e1b80 1 -- 172.21.15.86:0/4248884403 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.0, "await_for": 42.0}) -- 0x55e5bdb11550 con 0x55e5bdbd17a0 2024-05-12T11:11:03.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.929+0000 7f04477fe700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e5bdbd17a0 0x55e5bdc3f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:03.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.929+0000 7f0426ffd700 10 client.25102 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:03.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.929+0000 7f04477fe700 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e5bdbd17a0 0x55e5bdc3f470 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2182cd9d9f44f7b server_cookie=d8527b2d3ce35209 in_seq=0 out_seq=0 2024-05-12T11:11:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.937+0000 7f0426ffd700 1 -- 172.21.15.86:0/4248884403 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55e5bdb11550 con 0x55e5bdbd17a0 2024-05-12T11:11:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.937+0000 7f0426ffd700 10 client.25102 handle_command_reply: tid=0 2024-05-12T11:11:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.937+0000 7f04589e1b80 1 client.25102 shutdown 2024-05-12T11:11:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 -- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 msgr2=0x55e5bdbc7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc7490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55e5bdbc2a70 tx=0x7f04400a68f0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 -- 172.21.15.86:0/4248884403 shutdown_connections 2024-05-12T11:11:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55e5bdbd17a0 0x55e5bdc3f470 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f0426ffd700 0 client.25102 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5bdbbd850 0x55e5bdbc7490 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5bdbb7b00 0x55e5bdbca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 --2- 172.21.15.86:0/4248884403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5bdbb84c0 0x55e5bdbc6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 -- 172.21.15.86:0/4248884403 >> 172.21.15.86:0/4248884403 conn(0x55e5bdae3d00 msgr2=0x55e5bdbc3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 -- 172.21.15.86:0/4248884403 shutdown_connections 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 1 -- 172.21.15.86:0/4248884403 wait complete. 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.938+0000 7f04589e1b80 20 client.25102 trim_cache size 0 max 16384 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:11:03.930 INFO:teuthology.orchestra.run.smithi086.stdout: "epoch": 29, 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "leader": 24466, 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "set_version": 6, 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "sets": { 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "5ef77ac4": { 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "version": 6, 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "age_ref": 0.0, 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "state": { 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "QUIESCED", 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0 2024-05-12T11:11:03.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: "timeout": 60.0, 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: "expiration": 86.0, 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: "members": { 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: "file:/": { 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: "excluded": false, 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: "state": { 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "QUIESCED", 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:03.932 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:11:03.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 -- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f04300b2b20 msgr2=0x7f04300b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f04300b2b20 0x7f04300b4fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55e5bdbb8b80 tx=0x7f0438009260 comp rx=0 tx=0).stop 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 -- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448109590 msgr2=0x7f0448076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448109590 0x7f0448076220 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0440009850 tx=0x7f0440007a20 comp rx=0 tx=0).stop 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 -- 172.21.15.86:0/3699918044 shutdown_connections 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f04300b2b20 0x7f04300b4fe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0448109590 0x7f0448076220 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0448103520 0x7f04480757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 --2- 172.21.15.86:0/3699918044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0448103ee0 0x7f0448075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 -- 172.21.15.86:0/3699918044 >> 172.21.15.86:0/3699918044 conn(0x7f044807a5c0 msgr2=0x7f0448101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 -- 172.21.15.86:0/3699918044 shutdown_connections 2024-05-12T11:11:03.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:03.939+0000 7f044e14e700 1 -- 172.21.15.86:0/3699918044 wait complete. 2024-05-12T11:11:04.744 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5ef77ac4', quiesce took 6.0 seconds. Will release after: 26.0 2024-05-12T11:11:05.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:05 smithi086 ceph-mon[30110]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:11:05.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:05 smithi172 ceph-mon[34517]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:11:05.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:05 smithi176 ceph-mon[34357]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-12T11:11:07.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:07 smithi086 ceph-mon[30110]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-05-12T11:11:07.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:07 smithi172 ceph-mon[34517]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-05-12T11:11:07.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:07 smithi176 ceph-mon[34357]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-05-12T11:11:09.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:09 smithi086 ceph-mon[30110]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-05-12T11:11:09.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:09 smithi172 ceph-mon[34517]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-05-12T11:11:09.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:09 smithi176 ceph-mon[34357]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-05-12T11:11:11.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:11 smithi086 ceph-mon[30110]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-05-12T11:11:11.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:11 smithi172 ceph-mon[34517]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-05-12T11:11:11.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:11 smithi176 ceph-mon[34357]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-05-12T11:11:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 -- 172.21.15.86:0/1057450402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c102270 msgr2=0x7f985c10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 --2- 172.21.15.86:0/1057450402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c102270 0x7f985c10e780 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9854009cd0 tx=0x7f985402a8e0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 -- 172.21.15.86:0/1057450402 shutdown_connections 2024-05-12T11:11:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 --2- 172.21.15.86:0/1057450402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c102270 0x7f985c10e780 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 --2- 172.21.15.86:0/1057450402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f985c1018b0 0x7f985c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 --2- 172.21.15.86:0/1057450402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c1078c0 0x7f985c107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 -- 172.21.15.86:0/1057450402 >> 172.21.15.86:0/1057450402 conn(0x7f985c078a30 msgr2=0x7f985c078e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 -- 172.21.15.86:0/1057450402 shutdown_connections 2024-05-12T11:11:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.583+0000 7f98617ef640 1 -- 172.21.15.86:0/1057450402 wait complete. 2024-05-12T11:11:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.584+0000 7f98617ef640 1 Processor -- start 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.584+0000 7f98617ef640 1 -- start start 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.584+0000 7f98617ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c1018b0 0x7f985c196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.584+0000 7f98617ef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f985c102270 0x7f985c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.584+0000 7f98617ef640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c1078c0 0x7f985c19b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.584+0000 7f98617ef640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f985c110a70 con 0x7f985c1018b0 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.584+0000 7f98617ef640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1108f0 con 0x7f985c102270 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.584+0000 7f98617ef640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f985c110bf0 con 0x7f985c1078c0 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c1018b0 0x7f985c196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c1018b0 0x7f985c196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35690/0 (socket says 172.21.15.86:35690) 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 -- 172.21.15.86:0/2999645680 learned_addr learned my addr 172.21.15.86:0/2999645680 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985b7fe640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c1078c0 0x7f985c19b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985a7fc640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f985c102270 0x7f985c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 -- 172.21.15.86:0/2999645680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c1078c0 msgr2=0x7f985c19b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c1078c0 0x7f985c19b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 -- 172.21.15.86:0/2999645680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f985c102270 msgr2=0x7f985c1973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f985c102270 0x7f985c1973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 -- 172.21.15.86:0/2999645680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c19be50 con 0x7f985c1018b0 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f985affd640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c1018b0 0x7f985c196eb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f984c00ed60 tx=0x7f984c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.585+0000 7f9843fff640 1 -- 172.21.15.86:0/2999645680 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c009e10 con 0x7f985c1018b0 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.586+0000 7f9843fff640 1 -- 172.21.15.86:0/2999645680 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f984c0108e0 con 0x7f985c1018b0 2024-05-12T11:11:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.586+0000 7f98617ef640 1 -- 172.21.15.86:0/2999645680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c19c140 con 0x7f985c1018b0 2024-05-12T11:11:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.586+0000 7f98617ef640 1 -- 172.21.15.86:0/2999645680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c1a39d0 con 0x7f985c1018b0 2024-05-12T11:11:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.587+0000 7f9843fff640 1 -- 172.21.15.86:0/2999645680 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c018950 con 0x7f985c1018b0 2024-05-12T11:11:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.589+0000 7f98645df740 1 Processor -- start 2024-05-12T11:11:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.589+0000 7f98645df740 1 -- start start 2024-05-12T11:11:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.589+0000 7f98645df740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f98645df740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f13bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f98645df740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f164e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f98645df740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55dfd9e6e5d0 con 0x55dfd9f09830 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f98645df740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dfd9e27890 con 0x55dfd9f140f0 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f9843fff640 1 -- 172.21.15.86:0/2999645680 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f984c010430 con 0x7f985c1018b0 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f98645df740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55dfd9e6a590 con 0x55dfd9f08f10 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f13bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f13bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35700/0 (socket says 172.21.15.86:35700) 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985affd640 1 -- 172.21.15.86:0/823178024 learned_addr learned my addr 172.21.15.86:0/823178024 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985b7fe640 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985a7fc640 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f164e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985affd640 1 -- 172.21.15.86:0/823178024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 msgr2=0x55dfd9f092f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985affd640 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f092f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985affd640 1 -- 172.21.15.86:0/823178024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 msgr2=0x55dfd9f164e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985affd640 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f164e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985affd640 1 -- 172.21.15.86:0/823178024 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd9b80210 con 0x55dfd9f09830 2024-05-12T11:11:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.590+0000 7f985b7fe640 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.591+0000 7f985affd640 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f13bb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f984c0dfeb0 tx=0x7f984c0ea670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c561601de26135b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.591+0000 7f98417fa640 1 -- 172.21.15.86:0/823178024 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c0f1070 con 0x55dfd9f09830 2024-05-12T11:11:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.591+0000 7f98417fa640 1 -- 172.21.15.86:0/823178024 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f984c0e4780 con 0x55dfd9f09830 2024-05-12T11:11:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.591+0000 7f9843fff640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f98440b2a90 0x7f98440b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.591+0000 7f985b7fe640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f98440b2a90 0x7f98440b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98417fa640 1 -- 172.21.15.86:0/823178024 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c0e5e60 con 0x55dfd9f09830 2024-05-12T11:11:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f9843fff640 1 -- 172.21.15.86:0/2999645680 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f984c0e2880 con 0x7f985c1018b0 2024-05-12T11:11:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f985b7fe640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f98440b2a90 0x7f98440b4f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9854005e10 tx=0x7f985403d040 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 -- 172.21.15.86:0/823178024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 msgr2=0x55dfd9f13bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f13bb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f984c0dfeb0 tx=0x7f984c0ea670 comp rx=0 tx=0).stop 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 -- 172.21.15.86:0/823178024 shutdown_connections 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f164e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f13bb0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 --2- 172.21.15.86:0/823178024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 -- 172.21.15.86:0/823178024 >> 172.21.15.86:0/823178024 conn(0x55dfd9f05420 msgr2=0x55dfd9f05800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 -- 172.21.15.86:0/823178024 shutdown_connections 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.592+0000 7f98645df740 1 -- 172.21.15.86:0/823178024 wait complete. 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.593+0000 7f98645df740 1 -- start start 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.593+0000 7f98645df740 1 Processor -- start 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f98645df740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f08f10 0x55dfd9f10fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f98645df740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f11510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f98645df740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f140f0 0x55dfd9f11a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f98645df740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55dfd9f1b180 con 0x55dfd9f140f0 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f98645df740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dfd9e2b370 con 0x55dfd9f08f10 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f98645df740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55dfd9f1b300 con 0x55dfd9f09830 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f140f0 0x55dfd9f11a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985a7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f11510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f140f0 0x55dfd9f11a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35708/0 (socket says 172.21.15.86:35708) 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985b7fe640 1 -- 172.21.15.86:0/532453317 learned_addr learned my addr 172.21.15.86:0/532453317 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985affd640 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f08f10 0x55dfd9f10fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f98645df740 10 client.0 _ll_register_callbacks cb 0x55dfd9b7fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985b7fe640 1 -- 172.21.15.86:0/532453317 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 msgr2=0x55dfd9f11510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985b7fe640 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f11510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985b7fe640 1 -- 172.21.15.86:0/532453317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f08f10 msgr2=0x55dfd9f10fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985b7fe640 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f08f10 0x55dfd9f10fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985b7fe640 1 -- 172.21.15.86:0/532453317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd9c4c620 con 0x55dfd9f140f0 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f985a7fc640 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.594+0000 7f98645df740 1 -- 172.21.15.86:0/532453317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f984c0e4780 con 0x55dfd9f140f0 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.595+0000 7f985b7fe640 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f140f0 0x55dfd9f11a50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9854035000 tx=0x7f985402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82892941ebc64cd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.595+0000 7f983eff5640 10 client.15663 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.595+0000 7f983eff5640 1 -- 172.21.15.86:0/532453317 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854056060 con 0x55dfd9f140f0 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.595+0000 7f983eff5640 1 -- 172.21.15.86:0/532453317 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f9854004750 con 0x55dfd9f140f0 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.595+0000 7f983eff5640 1 -- 172.21.15.86:0/532453317 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f98540305a0 con 0x55dfd9f140f0 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.595+0000 7f98645df740 10 client.15663 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.595+0000 7f98645df740 1 -- 172.21.15.86:0/532453317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55dfd9f26f50 con 0x55dfd9f140f0 2024-05-12T11:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f983eff5640 1 -- 172.21.15.86:0/532453317 <== mon.0 v2:172.21.15.86:3300/0 4 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f9854030070 con 0x55dfd9f140f0 2024-05-12T11:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f98645df740 10 client.15663 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f98645df740 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f98645df740 20 client.15663 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f98645df740 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55dfd9f28300 0x55dfd9f2a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f98645df740 4 client.15663 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f98645df740 1 -- 172.21.15.86:0/532453317 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfd9e7c1e0 con 0x55dfd9f28300 2024-05-12T11:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f985affd640 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55dfd9f28300 0x55dfd9f2a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f985affd640 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55dfd9f28300 0x55dfd9f2a770 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3c6f4f306de90f6 server_cookie=6d3e223bdf7c51a5 in_seq=0 out_seq=0 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.596+0000 7f983eff5640 10 client.15663 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.597+0000 7f983eff5640 1 -- 172.21.15.86:0/532453317 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dfd9e7c1e0 con 0x55dfd9f28300 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.597+0000 7f983eff5640 10 client.15663 handle_command_reply: tid=0 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.597+0000 7f98645df740 1 client.15663 shutdown 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.597+0000 7f98645df740 1 -- 172.21.15.86:0/532453317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f140f0 msgr2=0x55dfd9f11a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.597+0000 7f98645df740 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f140f0 0x55dfd9f11a50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9854035000 tx=0x7f985402a8e0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 1 -- 172.21.15.86:0/532453317 shutdown_connections 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55dfd9f28300 0x55dfd9f2a770 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f983eff5640 0 client.15663 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f140f0 0x55dfd9f11a50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 1 --2- 172.21.15.86:0/532453317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f08f10 0x55dfd9f10fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 1 -- 172.21.15.86:0/532453317 >> 172.21.15.86:0/532453317 conn(0x55dfd9f05420 msgr2=0x55dfd9f0b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 1 -- 172.21.15.86:0/532453317 shutdown_connections 2024-05-12T11:11:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 1 -- 172.21.15.86:0/532453317 wait complete. 2024-05-12T11:11:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.598+0000 7f98645df740 20 client.15663 trim_cache size 0 max 16384 2024-05-12T11:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f98645df740 1 Processor -- start 2024-05-12T11:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f98645df740 1 -- start start 2024-05-12T11:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f98645df740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f08f10 0x55dfd9f11870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f98645df740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f30080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f98645df740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f98645df740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1ac390 con 0x55dfd9f08f10 2024-05-12T11:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f98645df740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1aded0 con 0x55dfd9f140f0 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f98645df740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1aca60 con 0x55dfd9f09830 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f985affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f08f10 0x55dfd9f11870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f985affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f08f10 0x55dfd9f11870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35714/0 (socket says 172.21.15.86:35714) 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f985affd640 1 -- 172.21.15.86:0/2330448853 learned_addr learned my addr 172.21.15.86:0/2330448853 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f985a7fc640 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f30080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.627+0000 7f985b7fe640 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f985affd640 1 -- 172.21.15.86:0/2330448853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 msgr2=0x55dfd9f30080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f985affd640 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f30080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f985affd640 1 -- 172.21.15.86:0/2330448853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 msgr2=0x55dfd9f305c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f985affd640 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f305c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f985affd640 1 -- 172.21.15.86:0/2330448853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd9f09620 con 0x55dfd9f08f10 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f985b7fe640 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f985affd640 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f08f10 0x55dfd9f11870 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f984c00cfd0 tx=0x7f984c0ed4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa0651b381dc253 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f9840ff9640 1 -- 172.21.15.86:0/2330448853 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c0f1070 con 0x55dfd9f08f10 2024-05-12T11:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f9840ff9640 1 -- 172.21.15.86:0/2330448853 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f984c0e8300 con 0x55dfd9f08f10 2024-05-12T11:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.628+0000 7f9840ff9640 1 -- 172.21.15.86:0/2330448853 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c0e5e60 con 0x55dfd9f08f10 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 -- 172.21.15.86:0/2330448853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f08f10 msgr2=0x55dfd9f11870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f08f10 0x55dfd9f11870 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f984c00cfd0 tx=0x7f984c0ed4c0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 -- 172.21.15.86:0/2330448853 shutdown_connections 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f09830 0x55dfd9f30080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 --2- 172.21.15.86:0/2330448853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f08f10 0x55dfd9f11870 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 -- 172.21.15.86:0/2330448853 >> 172.21.15.86:0/2330448853 conn(0x55dfd9f05420 msgr2=0x55dfd9f00450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 -- 172.21.15.86:0/2330448853 shutdown_connections 2024-05-12T11:11:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.629+0000 7f98645df740 1 -- 172.21.15.86:0/2330448853 wait complete. 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.630+0000 7f98645df740 1 -- start start 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.630+0000 7f98645df740 1 Processor -- start 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.630+0000 7f98645df740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f1c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.630+0000 7f98645df740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f1c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.630+0000 7f98645df740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f1ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.630+0000 7f98645df740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1ad800 con 0x55dfd9f09830 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f98645df740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1ad130 con 0x55dfd9f140f0 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985a7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f1c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985affd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f1c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985affd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f1c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.86:55370/0 (socket says 172.21.15.86:55370) 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985affd640 1 -- 172.21.15.86:0/1925173337 learned_addr learned my addr 172.21.15.86:0/1925173337 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1aa370 con 0x55dfd9f08f10 2024-05-12T11:11:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985b7fe640 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f1ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f98645df740 10 client.0 _ll_register_callbacks cb 0x7f9854031430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985a7fc640 1 -- 172.21.15.86:0/1925173337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 msgr2=0x55dfd9f1c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985a7fc640 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f1c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985a7fc640 1 -- 172.21.15.86:0/1925173337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 msgr2=0x55dfd9f1ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985a7fc640 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f1ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985a7fc640 1 -- 172.21.15.86:0/1925173337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd9f91d30 con 0x55dfd9f09830 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985affd640 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f1c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985b7fe640 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f1ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f985a7fc640 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f1c780 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9850005e00 tx=0x7f98500039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00e56ac9a830b53 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.631+0000 7f983eff5640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f983eff5640 1 -- 172.21.15.86:0/1925173337 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850005220 con 0x55dfd9f09830 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f983eff5640 1 -- 172.21.15.86:0/1925173337 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f98500053c0 con 0x55dfd9f09830 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f984c0e8300 con 0x55dfd9f09830 2024-05-12T11:11:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f983eff5640 1 -- 172.21.15.86:0/1925173337 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f98500055c0 con 0x55dfd9f09830 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f98645df740 10 client.15669 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dfd9f93040 con 0x55dfd9f09830 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f983eff5640 1 -- 172.21.15.86:0/1925173337 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f984c0e8300 con 0x55dfd9f09830 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f983eff5640 1 -- 172.21.15.86:0/1925173337 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f985001b070 con 0x55dfd9f09830 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f98645df740 10 client.15669 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f98645df740 10 client.15669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f98645df740 20 client.15669 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.632+0000 7f98645df740 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55dfd9f28300 0x55dfd9f957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.633+0000 7f98645df740 4 client.15669 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.633+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dfd9e76050 con 0x55dfd9f28300 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.633+0000 7f985affd640 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55dfd9f28300 0x55dfd9f957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.633+0000 7f983eff5640 10 client.15669 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.633+0000 7f985affd640 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55dfd9f28300 0x55dfd9f957f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e926be3bb88f30fd server_cookie=15e5e102f697ebfb in_seq=0 out_seq=0 2024-05-12T11:11:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.639+0000 7f983eff5640 1 -- 172.21.15.86:0/1925173337 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfd9e76050 con 0x55dfd9f28300 2024-05-12T11:11:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.639+0000 7f983eff5640 10 client.15669 handle_command_reply: tid=0 2024-05-12T11:11:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.639+0000 7f98645df740 1 client.15669 shutdown 2024-05-12T11:11:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 msgr2=0x55dfd9f1c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f1c780 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9850005e00 tx=0x7f98500039c0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 shutdown_connections 2024-05-12T11:11:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55dfd9f28300 0x55dfd9f957f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd9f140f0 0x55dfd9f1ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dfd9f09830 0x55dfd9f1c780 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 --2- 172.21.15.86:0/1925173337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfd9f08f10 0x55dfd9f1c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 >> 172.21.15.86:0/1925173337 conn(0x55dfd9f05420 msgr2=0x55dfd9f0a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f983eff5640 0 client.15669 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 shutdown_connections 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 1 -- 172.21.15.86:0/1925173337 wait complete. 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.640+0000 7f98645df740 20 client.15669 trim_cache size 0 max 16384 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:11:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:11:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:11:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:11:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 -- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f98440b2a90 msgr2=0x7f98440b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f98440b2a90 0x7f98440b4f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9854005e10 tx=0x7f985403d040 comp rx=0 tx=0).stop 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 -- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c1018b0 msgr2=0x7f985c196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c1018b0 0x7f985c196eb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f984c00ed60 tx=0x7f984c00c6a0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 -- 172.21.15.86:0/2999645680 shutdown_connections 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f98440b2a90 0x7f98440b4f50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c1078c0 0x7f985c19b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f985c102270 0x7f985c1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 --2- 172.21.15.86:0/2999645680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f985c1018b0 0x7f985c196eb0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 -- 172.21.15.86:0/2999645680 >> 172.21.15.86:0/2999645680 conn(0x7f985c078a30 msgr2=0x7f985c104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 -- 172.21.15.86:0/2999645680 shutdown_connections 2024-05-12T11:11:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:12.641+0000 7f98617ef640 1 -- 172.21.15.86:0/2999645680 wait complete. 2024-05-12T11:11:13.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:13 smithi086 ceph-mon[30110]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:11:13.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:13 smithi172 ceph-mon[34517]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:11:13.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:13 smithi176 ceph-mon[34357]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:11:15.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:15 smithi086 ceph-mon[30110]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:11:15.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:15 smithi172 ceph-mon[34517]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:11:15.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:15 smithi176 ceph-mon[34357]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:11:17.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:17 smithi086 ceph-mon[30110]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-05-12T11:11:17.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:17 smithi172 ceph-mon[34517]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-05-12T11:11:17.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:17 smithi176 ceph-mon[34357]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-05-12T11:11:19.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:19 smithi086 ceph-mon[30110]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 9 op/s 2024-05-12T11:11:19.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:19 smithi172 ceph-mon[34517]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 9 op/s 2024-05-12T11:11:19.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:19 smithi176 ceph-mon[34357]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 9 op/s 2024-05-12T11:11:21.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:21 smithi086 ceph-mon[30110]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2024-05-12T11:11:21.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:21 smithi172 ceph-mon[34517]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2024-05-12T11:11:21.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:21 smithi176 ceph-mon[34357]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2024-05-12T11:11:23.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:23 smithi086 ceph-mon[30110]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-12T11:11:23.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:23 smithi172 ceph-mon[34517]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-12T11:11:23.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:23 smithi176 ceph-mon[34357]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-12T11:11:25.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:25 smithi086 ceph-mon[30110]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-12T11:11:25.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:25 smithi172 ceph-mon[34517]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-12T11:11:25.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:25 smithi176 ceph-mon[34357]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 -- 172.21.15.86:0/612718583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81022a0 msgr2=0x7fe1d810e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 --2- 172.21.15.86:0/612718583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81022a0 0x7fe1d810e760 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009cd0 tx=0x7fe1d002a8e0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 -- 172.21.15.86:0/612718583 shutdown_connections 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 --2- 172.21.15.86:0/612718583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81022a0 0x7fe1d810e760 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 --2- 172.21.15.86:0/612718583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d81018e0 0x7fe1d8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 --2- 172.21.15.86:0/612718583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d81078a0 0x7fe1d8107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 -- 172.21.15.86:0/612718583 >> 172.21.15.86:0/612718583 conn(0x7fe1d8078a30 msgr2=0x7fe1d8078e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 -- 172.21.15.86:0/612718583 shutdown_connections 2024-05-12T11:11:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.754+0000 7fe1dc859640 1 -- 172.21.15.86:0/612718583 wait complete. 2024-05-12T11:11:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1dc859640 1 Processor -- start 2024-05-12T11:11:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1dc859640 1 -- start start 2024-05-12T11:11:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1dc859640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d81018e0 0x7fe1d8199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1dc859640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d81022a0 0x7fe1d819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1dc859640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81078a0 0x7fe1d81a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1dc859640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8111b60 con 0x7fe1d81078a0 2024-05-12T11:11:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1dc859640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81119e0 con 0x7fe1d81022a0 2024-05-12T11:11:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1dc859640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8111ce0 con 0x7fe1d81018e0 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1d6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81078a0 0x7fe1d81a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1d6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81078a0 0x7fe1d81a4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46116/0 (socket says 172.21.15.86:46116) 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/1073162060 learned_addr learned my addr 172.21.15.86:0/1073162060 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.755+0000 7fe1d5d9b640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d81022a0 0x7fe1d819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1d659c640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d81018e0 0x7fe1d8199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/1073162060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d81018e0 msgr2=0x7fe1d8199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d81018e0 0x7fe1d8199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/1073162060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d81022a0 msgr2=0x7fe1d819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d81022a0 0x7fe1d819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/1073162060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d8197cd0 con 0x7fe1d81078a0 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81078a0 0x7fe1d81a4f60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0005cc0 tx=0x7fe1d0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1c77fe640 1 -- 172.21.15.86:0/1073162060 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0004450 con 0x7fe1d81078a0 2024-05-12T11:11:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1dc859640 1 -- 172.21.15.86:0/1073162060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d8197f60 con 0x7fe1d81078a0 2024-05-12T11:11:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1c77fe640 1 -- 172.21.15.86:0/1073162060 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1d0031c90 con 0x7fe1d81078a0 2024-05-12T11:11:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1c77fe640 1 -- 172.21.15.86:0/1073162060 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d003b400 con 0x7fe1d81078a0 2024-05-12T11:11:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.756+0000 7fe1dc859640 1 -- 172.21.15.86:0/1073162060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d8198500 con 0x7fe1d81078a0 2024-05-12T11:11:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.759+0000 7fe1c77fe640 1 -- 172.21.15.86:0/1073162060 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fe1d0004680 con 0x7fe1d81078a0 2024-05-12T11:11:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.760+0000 7fe1df571740 1 Processor -- start 2024-05-12T11:11:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.760+0000 7fe1c77fe640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe1c00b2a90 0x7fe1c00b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.760+0000 7fe1d5d9b640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe1c00b2a90 0x7fe1c00b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.760+0000 7fe1c77fe640 1 -- 172.21.15.86:0/1073162060 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe1d002e030 con 0x7fe1d81078a0 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.760+0000 7fe1df571740 1 -- start start 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.760+0000 7fe1df571740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34ce10 0x560e3d34d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.760+0000 7fe1df571740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d3603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.760+0000 7fe1df571740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d362cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1df571740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560e3d2b25d0 con 0x560e3d360900 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1df571740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560e3d26b890 con 0x560e3d34d730 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1df571740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560e3d2ae590 con 0x560e3d34ce10 2024-05-12T11:11:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d5d9b640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe1c00b2a90 0x7fe1c00b4f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1d806abb0 tx=0x7fe1cc00b410 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d362cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d362cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46124/0 (socket says 172.21.15.86:46124) 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/3728847170 learned_addr learned my addr 172.21.15.86:0/3728847170 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d659c640 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34ce10 0x560e3d34d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d5d9b640 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d3603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/3728847170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34ce10 msgr2=0x560e3d34d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34ce10 0x560e3d34d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/3728847170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 msgr2=0x560e3d3603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d3603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/3728847170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3cfc4210 con 0x560e3d360900 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d5d9b640 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d3603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d362cf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00ca730 tx=0x7fe1d00ca660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33626bf537b28d79 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.761+0000 7fe1c4ff9640 1 -- 172.21.15.86:0/3728847170 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00ca2b0 con 0x560e3d360900 2024-05-12T11:11:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.762+0000 7fe1c4ff9640 1 -- 172.21.15.86:0/3728847170 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1d0036030 con 0x560e3d360900 2024-05-12T11:11:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.762+0000 7fe1c4ff9640 1 -- 172.21.15.86:0/3728847170 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00ed0b0 con 0x560e3d360900 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.762+0000 7fe1df571740 1 -- 172.21.15.86:0/3728847170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 msgr2=0x560e3d362cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.762+0000 7fe1df571740 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d362cf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00ca730 tx=0x7fe1d00ca660 comp rx=0 tx=0).stop 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 -- 172.21.15.86:0/3728847170 shutdown_connections 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d362cf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d3603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 --2- 172.21.15.86:0/3728847170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34ce10 0x560e3d34d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 -- 172.21.15.86:0/3728847170 >> 172.21.15.86:0/3728847170 conn(0x560e3d349420 msgr2=0x560e3d349800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 -- 172.21.15.86:0/3728847170 shutdown_connections 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 -- 172.21.15.86:0/3728847170 wait complete. 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 -- start start 2024-05-12T11:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 Processor -- start 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.763+0000 7fe1df571740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34ce10 0x560e3d35d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1df571740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d35dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1df571740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d35e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1df571740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560e3d3632f0 con 0x560e3d360900 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1df571740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560e3d26f370 con 0x560e3d34ce10 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1df571740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560e3d363470 con 0x560e3d34d730 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d5d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d35dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d35e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d35e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46136/0 (socket says 172.21.15.86:46136) 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d5d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d35dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.86:60450/0 (socket says 172.21.15.86:60450) 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/3506079980 learned_addr learned my addr 172.21.15.86:0/3506079980 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d659c640 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34ce10 0x560e3d35d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1df571740 10 client.0 _ll_register_callbacks cb 0x560e3cfc3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/3506079980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 msgr2=0x560e3d35dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d35dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/3506079980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34ce10 msgr2=0x560e3d35d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34ce10 0x560e3d35d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/3506079980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3d090620 con 0x560e3d360900 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d35e2b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0101100 tx=0x7fe1d00c6c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddb899b38e42ffb server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.764+0000 7fe1bdffb640 1 -- 172.21.15.86:0/3506079980 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00ca2b0 con 0x560e3d360900 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.765+0000 7fe1bdffb640 1 -- 172.21.15.86:0/3506079980 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe1d00c9a00 con 0x560e3d360900 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.765+0000 7fe1df571740 1 -- 172.21.15.86:0/3506079980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d0036030 con 0x560e3d360900 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.765+0000 7fe1bdffb640 1 -- 172.21.15.86:0/3506079980 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1d00a4e60 con 0x560e3d360900 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.765+0000 7fe1df571740 10 client.15681 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.765+0000 7fe1df571740 1 -- 172.21.15.86:0/3506079980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560e3d3632f0 con 0x560e3d360900 2024-05-12T11:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.765+0000 7fe1bdffb640 1 -- 172.21.15.86:0/3506079980 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1d0036030 con 0x560e3d360900 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.766+0000 7fe1bdffb640 1 -- 172.21.15.86:0/3506079980 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe1d0103030 con 0x560e3d360900 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.766+0000 7fe1df571740 10 client.15681 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.766+0000 7fe1df571740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.766+0000 7fe1df571740 20 client.15681 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.766+0000 7fe1df571740 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560e3d3703f0 0x560e3d372800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.766+0000 7fe1df571740 4 client.15681 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.766+0000 7fe1df571740 1 -- 172.21.15.86:0/3506079980 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e3d2c01e0 con 0x560e3d3703f0 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.766+0000 7fe1d659c640 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560e3d3703f0 0x560e3d372800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.767+0000 7fe1d659c640 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560e3d3703f0 0x560e3d372800 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bde5d2897f2e0839 server_cookie=3d166af22135c38f in_seq=0 out_seq=0 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.767+0000 7fe1bdffb640 10 client.15681 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.767+0000 7fe1bdffb640 1 -- 172.21.15.86:0/3506079980 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560e3d2c01e0 con 0x560e3d3703f0 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.767+0000 7fe1bdffb640 10 client.15681 handle_command_reply: tid=0 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.767+0000 7fe1df571740 1 client.15681 shutdown 2024-05-12T11:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 -- 172.21.15.86:0/3506079980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 msgr2=0x560e3d35e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d35e2b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0101100 tx=0x7fe1d00c6c40 comp rx=0 tx=0).stop 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 -- 172.21.15.86:0/3506079980 shutdown_connections 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560e3d3703f0 0x560e3d372800 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1bdffb640 0 client.15681 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d360900 0x560e3d35e2b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d35dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 --2- 172.21.15.86:0/3506079980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34ce10 0x560e3d35d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 -- 172.21.15.86:0/3506079980 >> 172.21.15.86:0/3506079980 conn(0x560e3d349420 msgr2=0x560e3d34f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 -- 172.21.15.86:0/3506079980 shutdown_connections 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 1 -- 172.21.15.86:0/3506079980 wait complete. 2024-05-12T11:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.768+0000 7fe1df571740 20 client.15681 trim_cache size 0 max 16384 2024-05-12T11:11:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1df571740 1 Processor -- start 2024-05-12T11:11:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1df571740 1 -- start start 2024-05-12T11:11:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1df571740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d34ce10 0x560e3d378110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1df571740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d378650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1df571740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d360900 0x560e3d35f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1df571740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ac2f0 con 0x560e3d34ce10 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1df571740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ade30 con 0x560e3d360900 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1df571740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ac9c0 con 0x560e3d34d730 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d34ce10 0x560e3d378110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d34ce10 0x560e3d378110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46148/0 (socket says 172.21.15.86:46148) 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d659c640 1 -- 172.21.15.86:0/1803393415 learned_addr learned my addr 172.21.15.86:0/1803393415 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d5d9b640 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d378650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d360900 0x560e3d35f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d659c640 1 -- 172.21.15.86:0/1803393415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 msgr2=0x560e3d378650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d659c640 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d378650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d659c640 1 -- 172.21.15.86:0/1803393415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d360900 msgr2=0x560e3d35f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d659c640 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d360900 0x560e3d35f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d659c640 1 -- 172.21.15.86:0/1803393415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3d34e480 con 0x560e3d34ce10 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.797+0000 7fe1d5d9b640 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d378650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.798+0000 7fe1d659c640 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d34ce10 0x560e3d378110 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800bc50 tx=0x7fe1c800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23be6ef447d3967e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.798+0000 7fe1bffff640 1 -- 172.21.15.86:0/1803393415 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8005020 con 0x560e3d34ce10 2024-05-12T11:11:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.798+0000 7fe1bffff640 1 -- 172.21.15.86:0/1803393415 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c8024030 con 0x560e3d34ce10 2024-05-12T11:11:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.798+0000 7fe1bffff640 1 -- 172.21.15.86:0/1803393415 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80203c0 con 0x560e3d34ce10 2024-05-12T11:11:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 -- 172.21.15.86:0/1803393415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d34ce10 msgr2=0x560e3d378110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d34ce10 0x560e3d378110 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800bc50 tx=0x7fe1c800b390 comp rx=0 tx=0).stop 2024-05-12T11:11:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 -- 172.21.15.86:0/1803393415 shutdown_connections 2024-05-12T11:11:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d360900 0x560e3d35f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d34d730 0x560e3d378650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 --2- 172.21.15.86:0/1803393415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d34ce10 0x560e3d378110 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 -- 172.21.15.86:0/1803393415 >> 172.21.15.86:0/1803393415 conn(0x560e3d349420 msgr2=0x560e3d3443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 -- 172.21.15.86:0/1803393415 shutdown_connections 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 -- 172.21.15.86:0/1803393415 wait complete. 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.799+0000 7fe1df571740 1 -- start start 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1df571740 1 Processor -- start 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1df571740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d364320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1df571740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d360900 0x560e3d364860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1df571740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d3703f0 0x560e3d364da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1df571740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ad760 con 0x560e3d3703f0 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1df571740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ad090 con 0x560e3d34d730 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1df571740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81aa2d0 con 0x560e3d360900 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1df571740 10 client.0 _ll_register_callbacks cb 0x7fe1c8004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d3703f0 0x560e3d364da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d3703f0 0x560e3d364da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46162/0 (socket says 172.21.15.86:46162) 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/168676044 learned_addr learned my addr 172.21.15.86:0/168676044 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d5d9b640 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d360900 0x560e3d364860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d659c640 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d364320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/168676044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d360900 msgr2=0x560e3d364860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d360900 0x560e3d364860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/168676044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 msgr2=0x560e3d364320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d364320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.800+0000 7fe1d6d9d640 1 -- 172.21.15.86:0/168676044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3d3d9f10 con 0x560e3d3703f0 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1d6d9d640 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d3703f0 0x560e3d364da0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe1d01034d0 tx=0x7fe1d0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89a4d2cd21b208e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1bdffb640 1 -- 172.21.15.86:0/168676044 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00e8020 con 0x560e3d3703f0 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1bdffb640 1 -- 172.21.15.86:0/168676044 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe1d00c9c10 con 0x560e3d3703f0 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1df571740 1 -- 172.21.15.86:0/168676044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1c8024030 con 0x560e3d3703f0 2024-05-12T11:11:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1bdffb640 1 -- 172.21.15.86:0/168676044 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1d00c9f10 con 0x560e3d3703f0 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1df571740 10 client.15687 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1df571740 1 -- 172.21.15.86:0/168676044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560e3d3d9f10 con 0x560e3d3703f0 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.801+0000 7fe1bdffb640 1 -- 172.21.15.86:0/168676044 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c8024030 con 0x560e3d3703f0 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.802+0000 7fe1bdffb640 1 -- 172.21.15.86:0/168676044 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe1d0103040 con 0x560e3d3703f0 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.802+0000 7fe1df571740 10 client.15687 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.802+0000 7fe1df571740 10 client.15687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.802+0000 7fe1df571740 20 client.15687 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.802+0000 7fe1df571740 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560e3d3db570 0x560e3d3dd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.802+0000 7fe1df571740 4 client.15687 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.802+0000 7fe1df571740 1 -- 172.21.15.86:0/168676044 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e3d2ba050 con 0x560e3d3db570 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.803+0000 7fe1d659c640 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560e3d3db570 0x560e3d3dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.803+0000 7fe1d659c640 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560e3d3db570 0x560e3d3dd960 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1dc76773a7f4a9 server_cookie=8de8282ed1b0d9e in_seq=0 out_seq=0 2024-05-12T11:11:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.803+0000 7fe1bdffb640 10 client.15687 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1bdffb640 1 -- 172.21.15.86:0/168676044 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e3d2ba050 con 0x560e3d3db570 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1bdffb640 10 client.15687 handle_command_reply: tid=0 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 client.15687 shutdown 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 -- 172.21.15.86:0/168676044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d3703f0 msgr2=0x560e3d364da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d3703f0 0x560e3d364da0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe1d01034d0 tx=0x7fe1d0005ef0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 -- 172.21.15.86:0/168676044 shutdown_connections 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x560e3d3db570 0x560e3d3dd960 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e3d3703f0 0x560e3d364da0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1bdffb640 0 client.15687 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e3d360900 0x560e3d364860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 --2- 172.21.15.86:0/168676044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e3d34d730 0x560e3d364320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 -- 172.21.15.86:0/168676044 >> 172.21.15.86:0/168676044 conn(0x560e3d349420 msgr2=0x560e3d347cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 -- 172.21.15.86:0/168676044 shutdown_connections 2024-05-12T11:11:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 1 -- 172.21.15.86:0/168676044 wait complete. 2024-05-12T11:11:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.807+0000 7fe1df571740 20 client.15687 trim_cache size 0 max 16384 2024-05-12T11:11:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:11:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:11:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:11:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:11:25.802 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 -- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe1c00b2a90 msgr2=0x7fe1c00b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.802 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe1c00b2a90 0x7fe1c00b4f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1d806abb0 tx=0x7fe1cc00b410 comp rx=0 tx=0).stop 2024-05-12T11:11:25.802 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 -- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81078a0 msgr2=0x7fe1d81a4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:25.802 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81078a0 0x7fe1d81a4f60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0005cc0 tx=0x7fe1d0003c20 comp rx=0 tx=0).stop 2024-05-12T11:11:25.802 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 -- 172.21.15.86:0/1073162060 shutdown_connections 2024-05-12T11:11:25.802 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe1c00b2a90 0x7fe1c00b4f50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1d81078a0 0x7fe1d81a4f60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d81022a0 0x7fe1d819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 --2- 172.21.15.86:0/1073162060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d81018e0 0x7fe1d8199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 -- 172.21.15.86:0/1073162060 >> 172.21.15.86:0/1073162060 conn(0x7fe1d8078a30 msgr2=0x7fe1d81043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 -- 172.21.15.86:0/1073162060 shutdown_connections 2024-05-12T11:11:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:25.808+0000 7fe1dc859640 1 -- 172.21.15.86:0/1073162060 wait complete. 2024-05-12T11:11:27.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:27 smithi086 ceph-mon[30110]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 13 op/s 2024-05-12T11:11:27.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:27 smithi172 ceph-mon[34517]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 13 op/s 2024-05-12T11:11:27.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:27 smithi176 ceph-mon[34357]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 13 op/s 2024-05-12T11:11:29.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:29 smithi086 ceph-mon[30110]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:11:29.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:29 smithi172 ceph-mon[34517]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:11:29.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:29 smithi176 ceph-mon[34357]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:11:30.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:30 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:11:30.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:30 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:11:30.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:30 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:11:30.746 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:11:31.074 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:11:31.169 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:31 smithi086 ceph-mon[30110]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:11:31.170 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:31 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:11:31.170 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:31 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:11:31.170 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:31 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:11:31.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:31 smithi172 ceph-mon[34517]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:11:31.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:31 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:11:31.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:31 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:11:31.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:31 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:11:31.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:31 smithi176 ceph-mon[34357]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:11:31.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:31 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:11:31.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:31 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:11:31.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:31 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:11:33.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 -- 172.21.15.86:0/4143650078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 msgr2=0x7f4bf810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:33.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4143650078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 0x7f4bf810f250 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000b0a0 tx=0x7f4bf000b3b0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 -- 172.21.15.86:0/4143650078 shutdown_connections 2024-05-12T11:11:33.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4143650078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 0x7f4bf810f250 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4143650078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bf81084a0 0x7f4bf8108880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4143650078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf8102400 0x7f4bf8102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 -- 172.21.15.86:0/4143650078 >> 172.21.15.86:0/4143650078 conn(0x7f4bf8078440 msgr2=0x7f4bf8078850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:33.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 -- 172.21.15.86:0/4143650078 shutdown_connections 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 -- 172.21.15.86:0/4143650078 wait complete. 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.169+0000 7f4bfd829700 1 Processor -- start 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bfd829700 1 -- start start 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bfd829700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf8102400 0x7f4bf81040a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bfd829700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 0x7f4bf81045e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bfd829700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bf81084a0 0x7f4bf8104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bfd829700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf81125e0 con 0x7f4bf8102dc0 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bfd829700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf8112460 con 0x7f4bf81084a0 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bfd829700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf8112760 con 0x7f4bf8102400 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf67fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 0x7f4bf81045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf67fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 0x7f4bf81045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50762/0 (socket says 172.21.15.86:50762) 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf67fc700 1 -- 172.21.15.86:0/4163983733 learned_addr learned my addr 172.21.15.86:0/4163983733 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf77fe700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bf81084a0 0x7f4bf8104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf6ffd700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf8102400 0x7f4bf81040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf67fc700 1 -- 172.21.15.86:0/4163983733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf8102400 msgr2=0x7f4bf81040a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf67fc700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf8102400 0x7f4bf81040a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf67fc700 1 -- 172.21.15.86:0/4163983733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bf81084a0 msgr2=0x7f4bf8104b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf67fc700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bf81084a0 0x7f4bf8104b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf67fc700 1 -- 172.21.15.86:0/4163983733 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf81a8010 con 0x7f4bf8102dc0 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.170+0000 7f4bf6ffd700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf8102400 0x7f4bf81040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.171+0000 7f4bf67fc700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 0x7f4bf81045e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00b530 tx=0x7f4bec00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.171+0000 7f4bfc827700 1 -- 172.21.15.86:0/4163983733 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec015020 con 0x7f4bf8102dc0 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.171+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf81a8300 con 0x7f4bf8102dc0 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.171+0000 7f4bfc827700 1 -- 172.21.15.86:0/4163983733 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bec011ce0 con 0x7f4bf8102dc0 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.171+0000 7f4bfc827700 1 -- 172.21.15.86:0/4163983733 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec010e40 con 0x7f4bf8102dc0 2024-05-12T11:11:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.171+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf81a8840 con 0x7f4bf8102dc0 2024-05-12T11:11:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.172+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf806a190 con 0x7f4bf8102dc0 2024-05-12T11:11:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.173+0000 7f4bfc827700 1 -- 172.21.15.86:0/4163983733 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4bec018020 con 0x7f4bf8102dc0 2024-05-12T11:11:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.174+0000 7f4bfc827700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4be00b29f0 0x7f4be00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.174+0000 7f4bf6ffd700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4be00b29f0 0x7f4be00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.174+0000 7f4bfc827700 1 -- 172.21.15.86:0/4163983733 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4bec0e1d40 con 0x7f4bf8102dc0 2024-05-12T11:11:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.175+0000 7f4bf6ffd700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4be00b29f0 0x7f4be00b4eb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be8005dc0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:33.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.181+0000 7f4bfc827700 1 -- 172.21.15.86:0/4163983733 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4bec01f020 con 0x7f4bf8102dc0 2024-05-12T11:11:33.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.436+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bf81a8b00 con 0x7f4bf8102dc0 2024-05-12T11:11:33.428 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:33 smithi086 ceph-mon[30110]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:33.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.437+0000 7f4bfc827700 1 -- 172.21.15.86:0/4163983733 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7f4bec0a9830 con 0x7f4bf8102dc0 2024-05-12T11:11:33.429 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:11:33.429 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4be00b29f0 msgr2=0x7f4be00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4be00b29f0 0x7f4be00b4eb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be8005dc0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 msgr2=0x7f4bf81045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 0x7f4bf81045e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00b530 tx=0x7f4bec00b840 comp rx=0 tx=0).stop 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 shutdown_connections 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bf81084a0 0x7f4bf8104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bf8102400 0x7f4bf81040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4be00b29f0 0x7f4be00b4eb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 --2- 172.21.15.86:0/4163983733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bf8102dc0 0x7f4bf81045e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:33.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 >> 172.21.15.86:0/4163983733 conn(0x7f4bf8078440 msgr2=0x7f4bf806bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:33.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.439+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 shutdown_connections 2024-05-12T11:11:33.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:33.440+0000 7f4bfd829700 1 -- 172.21.15.86:0/4163983733 wait complete. 2024-05-12T11:11:33.432 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:11:33.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:33 smithi172 ceph-mon[34517]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:33.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:33 smithi176 ceph-mon[34357]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:34.157 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --set-id 5ef77ac4 --release --await' 2024-05-12T11:11:34.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24466 quiesce db --set-id 5ef77ac4 --release --await 2024-05-12T11:11:34.237 INFO:tasks.workunit.client.0.smithi086.stderr:Updating files: 92% (11356/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-12T11:11:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:11:34.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:34 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/4163983733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:11:34.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:34 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/4163983733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:11:34.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:34 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/4163983733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:11:34.803 INFO:tasks.workunit.client.0.smithi086.stderr:Note: switching to 'f1ec882358465db8f363a3865fa83f099183688a'. 2024-05-12T11:11:34.803 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-05-12T11:11:34.803 INFO:tasks.workunit.client.0.smithi086.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-12T11:11:34.803 INFO:tasks.workunit.client.0.smithi086.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-12T11:11:34.803 INFO:tasks.workunit.client.0.smithi086.stderr:state without impacting any branches by switching back to a branch. 2024-05-12T11:11:34.803 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-05-12T11:11:34.803 INFO:tasks.workunit.client.0.smithi086.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-12T11:11:34.803 INFO:tasks.workunit.client.0.smithi086.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr: git switch -c 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr:Or undo this operation with: 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr: git switch - 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-05-12T11:11:34.804 INFO:tasks.workunit.client.0.smithi086.stderr:HEAD is now at f1ec8823584 mds: don't clear `AUTHPIN_FROZEN` until `FROZEN` in rename_prep 2024-05-12T11:11:34.809 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-12T11:11:34.907 INFO:tasks.workunit.client.0.smithi086.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-12T11:11:34.909 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T11:11:34.909 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-12T11:11:35.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:35 smithi086 ceph-mon[30110]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:35.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:35 smithi172 ceph-mon[34517]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:35.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:35 smithi176 ceph-mon[34357]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:36.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 -- 172.21.15.86:0/2186578587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8109540 msgr2=0x7fbcc8109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2186578587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8109540 0x7fbcc8109920 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40099c0 tx=0x7fbcc4009cd0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 -- 172.21.15.86:0/2186578587 shutdown_connections 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2186578587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcc8103f20 0x7fbcc8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2186578587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8109540 0x7fbcc8109920 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2186578587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcc8103560 0x7fbcc81039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 -- 172.21.15.86:0/2186578587 >> 172.21.15.86:0/2186578587 conn(0x7fbcc807a660 msgr2=0x7fbcc807aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 -- 172.21.15.86:0/2186578587 shutdown_connections 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 -- 172.21.15.86:0/2186578587 wait complete. 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 Processor -- start 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.538+0000 7fbcd0710700 1 -- start start 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcd0710700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8103560 0x7fbcc819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcd0710700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcc8103f20 0x7fbcc819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcd0710700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcc8109540 0x7fbcc81999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcd0710700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81136a0 con 0x7fbcc8103560 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcd0710700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8113520 con 0x7fbcc8109540 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcd0710700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8113820 con 0x7fbcc8103f20 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8103560 0x7fbcc819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8103560 0x7fbcc819f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50794/0 (socket says 172.21.15.86:50794) 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 -- 172.21.15.86:0/2835011073 learned_addr learned my addr 172.21.15.86:0/2835011073 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbccdcab700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcc8103f20 0x7fbcc819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbccecad700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcc8109540 0x7fbcc81999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 -- 172.21.15.86:0/2835011073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcc8103f20 msgr2=0x7fbcc819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcc8103f20 0x7fbcc819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 -- 172.21.15.86:0/2835011073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcc8109540 msgr2=0x7fbcc81999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcc8109540 0x7fbcc81999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 -- 172.21.15.86:0/2835011073 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc819a120 con 0x7fbcc8103560 2024-05-12T11:11:36.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8103560 0x7fbcc819f7b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40098e0 tx=0x7fbcc40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcbf7fe700 1 -- 172.21.15.86:0/2835011073 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4027070 con 0x7fbcc8103560 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcbf7fe700 1 -- 172.21.15.86:0/2835011073 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc4003f20 con 0x7fbcc8103560 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcd0710700 1 -- 172.21.15.86:0/2835011073 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc819a3b0 con 0x7fbcc8103560 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.539+0000 7fbcbf7fe700 1 -- 172.21.15.86:0/2835011073 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4022ca0 con 0x7fbcc8103560 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.540+0000 7fbcd0710700 1 -- 172.21.15.86:0/2835011073 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc81a6680 con 0x7fbcc8103560 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.542+0000 7fbcbf7fe700 1 -- 172.21.15.86:0/2835011073 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fbcc402a070 con 0x7fbcc8103560 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.543+0000 7fbcbf7fe700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbcb40b29f0 0x7fbcb40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.543+0000 7fbccdcab700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbcb40b29f0 0x7fbcb40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.543+0000 7fbcbf7fe700 1 -- 172.21.15.86:0/2835011073 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fbcc40e34e0 con 0x7fbcc8103560 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.543+0000 7fbccdcab700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbcb40b29f0 0x7fbcb40b4eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbcc807acd0 tx=0x7fbcb8009190 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.543+0000 7fbcdafa3b80 1 Processor -- start 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.543+0000 7fbcdafa3b80 1 -- start start 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936204ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x5599361feef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x55993620b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559936150a40 con 0x5599362047c0 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599360b5ea0 con 0x5599361ff430 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55993614ca00 con 0x5599361fea70 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936204ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936204ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50804/0 (socket says 172.21.15.86:50804) 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 -- 172.21.15.86:0/1839051002 learned_addr learned my addr 172.21.15.86:0/1839051002 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbccdcab700 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x5599361feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbccecad700 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x55993620b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.573 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "epoch": 29, 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "leader": 24466, 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "set_version": 8, 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "sets": { 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "5ef77ac4": { 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "version": 8, 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "age_ref": 0.0, 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "state": { 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RELEASED", 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "timeout": 60.0, 2024-05-12T11:11:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: "expiration": 86.0, 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: "members": { 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: "file:/": { 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: "excluded": false, 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: "state": { 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RELEASED", 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:11:36.575 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 -- 172.21.15.86:0/1839051002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 msgr2=0x5599361feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x5599361feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 -- 172.21.15.86:0/1839051002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 msgr2=0x55993620b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x55993620b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 -- 172.21.15.86:0/1839051002 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993609d9d0 con 0x5599362047c0 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbccecad700 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x55993620b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936204ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40aa550 tx=0x7fbcc4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc797daaa6a683c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcbcff9700 1 -- 172.21.15.86:0/1839051002 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40aaf50 con 0x5599362047c0 2024-05-12T11:11:36.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcbcff9700 1 -- 172.21.15.86:0/1839051002 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc40aa850 con 0x5599362047c0 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.544+0000 7fbcbcff9700 1 -- 172.21.15.86:0/1839051002 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40aaab0 con 0x5599362047c0 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/1839051002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 msgr2=0x559936204ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936204ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40aa550 tx=0x7fbcc4009310 comp rx=0 tx=0).stop 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/1839051002 shutdown_connections 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x55993620b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936204ba0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/1839051002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x5599361feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/1839051002 >> 172.21.15.86:0/1839051002 conn(0x55993612ac70 msgr2=0x5599361f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/1839051002 shutdown_connections 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/1839051002 wait complete. 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.545+0000 7fbcdafa3b80 1 -- start start 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcdafa3b80 1 Processor -- start 2024-05-12T11:11:36.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x55993620b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x559936208500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936208a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5599362051e0 con 0x5599362047c0 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559936109fd0 con 0x5599361ff430 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55993620bac0 con 0x5599361fea70 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcdafa3b80 10 client.0 _ll_register_callbacks cb 0x5599360e46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936208a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936208a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50808/0 (socket says 172.21.15.86:50808) 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 -- 172.21.15.86:0/688986180 learned_addr learned my addr 172.21.15.86:0/688986180 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccdcab700 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x559936208500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x55993620b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 -- 172.21.15.86:0/688986180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 msgr2=0x55993620b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x55993620b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 -- 172.21.15.86:0/688986180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 msgr2=0x559936208500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x559936208500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 -- 172.21.15.86:0/688986180 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559936107860 con 0x5599362047c0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbccecad700 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936208a40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009f60 tx=0x7fbcc0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c50f2a29b8fead1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.546+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/688986180 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0019020 con 0x5599362047c0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/688986180 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fbcc0007710 con 0x5599362047c0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/688986180 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc40aa850 con 0x5599362047c0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/688986180 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbcc0004bb0 con 0x5599362047c0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 10 client.15705 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/688986180 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559936215fa0 con 0x5599362047c0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/688986180 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc40aa850 con 0x5599362047c0 2024-05-12T11:11:36.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/688986180 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fbcc00052f0 con 0x5599362047c0 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 10 client.15705 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 10 client.15705 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 20 client.15705 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x559936218680 0x55993621aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 4 client.15705 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/688986180 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55993615e420 con 0x559936218680 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.547+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x559936218680 0x55993621aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.548+0000 7fbcb1ffb700 10 client.15705 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.548+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x559936218680 0x55993621aa70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa2d538a62f4175 server_cookie=6701176fd55086a1 in_seq=0 out_seq=0 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/688986180 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55993615e420 con 0x559936218680 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcb1ffb700 10 client.15705 handle_command_reply: tid=0 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 client.15705 shutdown 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/688986180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 msgr2=0x559936208a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936208a40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009f60 tx=0x7fbcc0009f90 comp rx=0 tx=0).stop 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/688986180 shutdown_connections 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x559936218680 0x55993621aa70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936208a40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcb1ffb700 0 client.15705 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x55993620b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/688986180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x559936208500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/688986180 >> 172.21.15.86:0/688986180 conn(0x55993612ac70 msgr2=0x559936203b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/688986180 shutdown_connections 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/688986180 wait complete. 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.549+0000 7fbcdafa3b80 20 client.15705 trim_cache size 0 max 16384 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.568+0000 7fbcdafa3b80 1 Processor -- start 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.568+0000 7fbcdafa3b80 1 -- start start 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x5599361fe0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x559936214900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936211060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81adc50 con 0x5599362047c0 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81af790 con 0x5599361ff430 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81ae320 con 0x5599361fea70 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936211060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936211060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50820/0 (socket says 172.21.15.86:50820) 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 -- 172.21.15.86:0/4184051158 learned_addr learned my addr 172.21.15.86:0/4184051158 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x5599361fe0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccdcab700 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x559936214900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 -- 172.21.15.86:0/4184051158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 msgr2=0x5599361fe0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x5599361fe0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 -- 172.21.15.86:0/4184051158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 msgr2=0x559936214900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x559936214900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 -- 172.21.15.86:0/4184051158 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993620ada0 con 0x5599362047c0 2024-05-12T11:11:36.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbccecad700 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936211060 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0003b50 tx=0x7fbcc0009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e503fa253fd237 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcb3fff700 1 -- 172.21.15.86:0/4184051158 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0019070 con 0x5599362047c0 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcb3fff700 1 -- 172.21.15.86:0/4184051158 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc0007bc0 con 0x5599362047c0 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.569+0000 7fbcb3fff700 1 -- 172.21.15.86:0/4184051158 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0005260 con 0x5599362047c0 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/4184051158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 msgr2=0x559936211060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936211060 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0003b50 tx=0x7fbcc0009600 comp rx=0 tx=0).stop 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/4184051158 shutdown_connections 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599362047c0 0x559936211060 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x5599361fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/4184051158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599361ff430 0x559936214900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/4184051158 >> 172.21.15.86:0/4184051158 conn(0x55993612ac70 msgr2=0x55993620a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/4184051158 shutdown_connections 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/4184051158 wait complete. 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 -- start start 2024-05-12T11:11:36.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.570+0000 7fbcdafa3b80 1 Processor -- start 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x559936202a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599361ff430 0x559936202f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcdafa3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599362047c0 0x559936286f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81af0c0 con 0x5599361ff430 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81ae9f0 con 0x5599362047c0 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcdafa3b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81abbf0 con 0x5599361fea70 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599361ff430 0x559936202f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcdafa3b80 10 client.0 _ll_register_callbacks cb 0x5599360e46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599361ff430 0x559936202f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50822/0 (socket says 172.21.15.86:50822) 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 -- 172.21.15.86:0/641390204 learned_addr learned my addr 172.21.15.86:0/641390204 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x559936202a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccecad700 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599362047c0 0x559936286f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 -- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 msgr2=0x559936202a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:36.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x559936202a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 -- 172.21.15.86:0/641390204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599362047c0 msgr2=0x559936286f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599362047c0 0x559936286f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 -- 172.21.15.86:0/641390204 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599362874b0 con 0x5599361ff430 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x559936202a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbccdcab700 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599361ff430 0x559936202f60 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x5599361ffaf0 tx=0x7fbcb8004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec166d6db882059 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/641390204 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8027070 con 0x5599361ff430 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/641390204 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fbcb8015af0 con 0x5599361ff430 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.571+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/641390204 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc0007bc0 con 0x5599361ff430 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/641390204 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbcb801b040 con 0x5599361ff430 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcdafa3b80 10 client.15711 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/641390204 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559936288700 con 0x5599361ff430 2024-05-12T11:11:36.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/641390204 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc0007bc0 con 0x5599361ff430 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/641390204 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fbcb8035430 con 0x5599361ff430 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcdafa3b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcdafa3b80 10 client.15711 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcdafa3b80 20 client.15711 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x559936288e20 0x55993628b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcdafa3b80 4 client.15711 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5ef77ac4", "release": true, "await": true}] 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/641390204 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5ef77ac4", "release": true, "await": true}) -- 0x5599361584c0 con 0x559936288e20 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.572+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x559936288e20 0x55993628b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.573+0000 7fbcce4ac700 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x559936288e20 0x55993628b240 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=290a87bb40809a73 server_cookie=1202fc6f3c0a5adc in_seq=0 out_seq=0 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.573+0000 7fbcb1ffb700 10 client.15711 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcb1ffb700 1 -- 172.21.15.86:0/641390204 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5599361584c0 con 0x559936288e20 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcb1ffb700 10 client.15711 handle_command_reply: tid=0 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 client.15711 shutdown 2024-05-12T11:11:36.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/641390204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599361ff430 msgr2=0x559936202f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599361ff430 0x559936202f60 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x5599361ffaf0 tx=0x7fbcb8004860 comp rx=0 tx=0).stop 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/641390204 shutdown_connections 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x559936288e20 0x55993628b240 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599362047c0 0x559936286f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5599361fea70 0x559936202a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcb1ffb700 0 client.15711 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 --2- 172.21.15.86:0/641390204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5599361ff430 0x559936202f60 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/641390204 >> 172.21.15.86:0/641390204 conn(0x55993612ac70 msgr2=0x55993620a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/641390204 shutdown_connections 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 1 -- 172.21.15.86:0/641390204 wait complete. 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.575+0000 7fbcdafa3b80 20 client.15711 trim_cache size 0 max 16384 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 -- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbcb40b29f0 msgr2=0x7fbcb40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbcb40b29f0 0x7fbcb40b4eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbcc807acd0 tx=0x7fbcb8009190 comp rx=0 tx=0).stop 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 -- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8103560 msgr2=0x7fbcc819f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8103560 0x7fbcc819f7b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40098e0 tx=0x7fbcc40057c0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 -- 172.21.15.86:0/2835011073 shutdown_connections 2024-05-12T11:11:36.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcc8109540 0x7fbcc81999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fbcb40b29f0 0x7fbcb40b4eb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc8103560 0x7fbcc819f7b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 --2- 172.21.15.86:0/2835011073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcc8103f20 0x7fbcc819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:36.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 -- 172.21.15.86:0/2835011073 >> 172.21.15.86:0/2835011073 conn(0x7fbcc807a660 msgr2=0x7fbcc8102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:36.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 -- 172.21.15.86:0/2835011073 shutdown_connections 2024-05-12T11:11:36.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:11:36.576+0000 7fbcd0710700 1 -- 172.21.15.86:0/2835011073 wait complete. 2024-05-12T11:11:36.911 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-12T11:11:36.972 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-12T11:11:37.011 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T11:11:37.013 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T11:11:37.013 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-12T11:11:37.052 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T11:11:37.055 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T11:11:37.055 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-12T11:11:37.071 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-05-12T11:11:37.073 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-05-12T11:11:37.073 DEBUG:teuthology.orchestra.run.smithi086:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1ec882358465db8f363a3865fa83f099183688a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-05-12T11:11:37.133 INFO:tasks.workunit.client.0.smithi086.stdout:test large (16MB) dio write 2024-05-12T11:11:37.134 INFO:tasks.workunit.client.0.smithi086.stderr:+ echo 'test large (16MB) dio write' 2024-05-12T11:11:37.134 INFO:tasks.workunit.client.0.smithi086.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-05-12T11:11:37.213 INFO:tasks.workunit.client.0.smithi086.stderr:1+0 records in 2024-05-12T11:11:37.214 INFO:tasks.workunit.client.0.smithi086.stderr:1+0 records out 2024-05-12T11:11:37.214 INFO:tasks.workunit.client.0.smithi086.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0781927 s, 215 MB/s 2024-05-12T11:11:37.214 INFO:tasks.workunit.client.0.smithi086.stderr:+ echo OK 2024-05-12T11:11:37.215 INFO:tasks.workunit.client.0.smithi086.stdout:OK 2024-05-12T11:11:37.215 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T11:11:37.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T11:11:37.290 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-05-12T11:11:37.291 DEBUG:teuthology.orchestra.run.smithi086:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1ec882358465db8f363a3865fa83f099183688a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-05-12T11:11:37.446 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:37 smithi086 ceph-mon[30110]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:11:37.473 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5ef77ac4', seconds elapsed: 38.8 2024-05-12T11:11:37.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:37 smithi172 ceph-mon[34517]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:11:37.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:37 smithi176 ceph-mon[34357]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-12T11:11:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- 172.21.15.86:0/2790254905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 msgr2=0x7fe88810e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 --2- 172.21.15.86:0/2790254905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 0x7fe88810e760 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe880009930 tx=0x7fe88002a420 comp rx=0 tx=0).stop 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- 172.21.15.86:0/2790254905 shutdown_connections 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 --2- 172.21.15.86:0/2790254905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 0x7fe88810e760 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 --2- 172.21.15.86:0/2790254905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8881018e0 0x7fe888101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 --2- 172.21.15.86:0/2790254905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8881078a0 0x7fe888107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- 172.21.15.86:0/2790254905 >> 172.21.15.86:0/2790254905 conn(0x7fe888078a30 msgr2=0x7fe888078e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- 172.21.15.86:0/2790254905 shutdown_connections 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- 172.21.15.86:0/2790254905 wait complete. 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 Processor -- start 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- start start 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8881018e0 0x7fe8881980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 0x7fe8881985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8881078a0 0x7fe88819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe888111b60 con 0x7fe8881022a0 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881119e0 con 0x7fe8881018e0 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.903+0000 7fe88eada640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe888111ce0 con 0x7fe8881078a0 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 0x7fe8881985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 0x7fe8881985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50842/0 (socket says 172.21.15.86:50842) 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 -- 172.21.15.86:0/498175114 learned_addr learned my addr 172.21.15.86:0/498175114 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe88d077640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8881078a0 0x7fe88819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe88c876640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8881018e0 0x7fe8881980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 -- 172.21.15.86:0/498175114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8881078a0 msgr2=0x7fe88819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8881078a0 0x7fe88819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 -- 172.21.15.86:0/498175114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8881018e0 msgr2=0x7fe8881980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8881018e0 0x7fe8881980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 -- 172.21.15.86:0/498175114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88819d040 con 0x7fe8881022a0 2024-05-12T11:11:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe88d077640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8881078a0 0x7fe88819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87ffff640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 0x7fe8881985e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe87800e9f0 tx=0x7fe87800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87dffb640 1 -- 172.21.15.86:0/498175114 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87800cd80 con 0x7fe8881022a0 2024-05-12T11:11:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87dffb640 1 -- 172.21.15.86:0/498175114 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8780054d0 con 0x7fe8881022a0 2024-05-12T11:11:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe88eada640 1 -- 172.21.15.86:0/498175114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88819d330 con 0x7fe8881022a0 2024-05-12T11:11:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.904+0000 7fe87dffb640 1 -- 172.21.15.86:0/498175114 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878010690 con 0x7fe8881022a0 2024-05-12T11:11:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.905+0000 7fe88eada640 1 -- 172.21.15.86:0/498175114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8881a4bc0 con 0x7fe8881022a0 2024-05-12T11:11:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe87dffb640 1 -- 172.21.15.86:0/498175114 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fe878004e90 con 0x7fe8881022a0 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe8917f9740 1 Processor -- start 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe8917f9740 1 -- start start 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d0d70 0x5611fa6d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d1690 0x5611fa6dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6e06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe8917f9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5611fa6365d0 con 0x5611fa6d0d70 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe8917f9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5611fa5ef890 con 0x5611fa6de300 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe8917f9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5611fa632590 con 0x5611fa6d1690 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.907+0000 7fe88d077640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d0d70 0x5611fa6d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d0d70 0x5611fa6d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50850/0 (socket says 172.21.15.86:50850) 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 -- 172.21.15.86:0/2505866595 learned_addr learned my addr 172.21.15.86:0/2505866595 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88c876640 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d1690 0x5611fa6dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 -- 172.21.15.86:0/2505866595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d1690 msgr2=0x5611fa6dddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d1690 0x5611fa6dddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe87dffb640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe8700b2a10 0x7fe8700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 -- 172.21.15.86:0/2505866595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 msgr2=0x5611fa6e06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe87ffff640 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6e06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6e06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 -- 172.21.15.86:0/2505866595 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fa348210 con 0x5611fa6d0d70 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88c876640 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d1690 0x5611fa6dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe87ffff640 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6e06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe87dffb640 1 -- 172.21.15.86:0/498175114 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe8780e2a10 con 0x7fe8881022a0 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe8700b2a10 0x7fe8700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe88d077640 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d0d70 0x5611fa6d1150 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe880009230 tx=0x7fe8800314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d89a56d597336e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.908+0000 7fe86effd640 1 -- 172.21.15.86:0/2505866595 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88004c070 con 0x5611fa6d0d70 2024-05-12T11:11:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe86effd640 1 -- 172.21.15.86:0/2505866595 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8800055d0 con 0x5611fa6d0d70 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe86effd640 1 -- 172.21.15.86:0/2505866595 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880040070 con 0x5611fa6d0d70 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 -- 172.21.15.86:0/2505866595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d0d70 msgr2=0x5611fa6d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe88d077640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe8700b2a10 0x7fe8700b4ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe880006010 tx=0x7fe88004c000 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d0d70 0x5611fa6d1150 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe880009230 tx=0x7fe8800314a0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 -- 172.21.15.86:0/2505866595 shutdown_connections 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6e06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d1690 0x5611fa6dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 --2- 172.21.15.86:0/2505866595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d0d70 0x5611fa6d1150 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 -- 172.21.15.86:0/2505866595 >> 172.21.15.86:0/2505866595 conn(0x5611fa6cd420 msgr2=0x5611fa6cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 -- 172.21.15.86:0/2505866595 shutdown_connections 2024-05-12T11:11:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.909+0000 7fe8917f9740 1 -- 172.21.15.86:0/2505866595 wait complete. 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 1 -- start start 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 1 Processor -- start 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6db7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6dbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5611fa6e0f30 con 0x5611fa6d1690 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5611fa5f3370 con 0x5611fa6de300 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5611fa6e10b0 con 0x5611fa6d0d70 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe8917f9740 10 client.0 _ll_register_callbacks cb 0x5611fa347a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe87ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6db7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe87ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6db7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50866/0 (socket says 172.21.15.86:50866) 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe87ffff640 1 -- 172.21.15.86:0/885232348 learned_addr learned my addr 172.21.15.86:0/885232348 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.910+0000 7fe88c876640 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe88d077640 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6dbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe87ffff640 1 -- 172.21.15.86:0/885232348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 msgr2=0x5611fa6db2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe87ffff640 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6db2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe87ffff640 1 -- 172.21.15.86:0/885232348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 msgr2=0x5611fa6dbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe87ffff640 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6dbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe87ffff640 1 -- 172.21.15.86:0/885232348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611fa414620 con 0x5611fa6d1690 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe87ffff640 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6db7e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c6a0 tx=0x7fe8780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe4f15d17b3bd84 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe867fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe867fff640 1 -- 172.21.15.86:0/885232348 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878005180 con 0x5611fa6d1690 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe867fff640 1 -- 172.21.15.86:0/885232348 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe8780b26c0 con 0x5611fa6d1690 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 1 -- 172.21.15.86:0/885232348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8800055d0 con 0x5611fa6d1690 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe867fff640 1 -- 172.21.15.86:0/885232348 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe8780a9800 con 0x5611fa6d1690 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 10 client.15723 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 1 -- 172.21.15.86:0/885232348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5611fa6ecec0 con 0x5611fa6d1690 2024-05-12T11:11:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe867fff640 1 -- 172.21.15.86:0/885232348 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8800055d0 con 0x5611fa6d1690 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe867fff640 1 -- 172.21.15.86:0/885232348 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe8780a5660 con 0x5611fa6d1690 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 10 client.15723 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 20 client.15723 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5611fa6ee380 0x5611fa6f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 4 client.15723 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.911+0000 7fe8917f9740 1 -- 172.21.15.86:0/885232348 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611fa6441e0 con 0x5611fa6ee380 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.912+0000 7fe88c876640 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5611fa6ee380 0x5611fa6f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.912+0000 7fe867fff640 10 client.15723 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.912+0000 7fe88c876640 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5611fa6ee380 0x5611fa6f0770 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92c8beb2a79ed934 server_cookie=c7cf50d5584dba03 in_seq=0 out_seq=0 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe867fff640 1 -- 172.21.15.86:0/885232348 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5611fa6441e0 con 0x5611fa6ee380 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe867fff640 10 client.15723 handle_command_reply: tid=0 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 client.15723 shutdown 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 -- 172.21.15.86:0/885232348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 msgr2=0x5611fa6db7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6db7e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c6a0 tx=0x7fe8780048f0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 -- 172.21.15.86:0/885232348 shutdown_connections 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5611fa6ee380 0x5611fa6f0770 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6de300 0x5611fa6dbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6db7e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe867fff640 0 client.15723 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 --2- 172.21.15.86:0/885232348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6db2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 -- 172.21.15.86:0/885232348 >> 172.21.15.86:0/885232348 conn(0x5611fa6cd420 msgr2=0x5611fa6d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 -- 172.21.15.86:0/885232348 shutdown_connections 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 1 -- 172.21.15.86:0/885232348 wait complete. 2024-05-12T11:11:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.913+0000 7fe8917f9740 20 client.15723 trim_cache size 0 max 16384 2024-05-12T11:11:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe8917f9740 1 Processor -- start 2024-05-12T11:11:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe8917f9740 1 -- start start 2024-05-12T11:11:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d1690 0x5611fa6dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6de300 0x5611fa6f6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe8917f9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881ac3e0 con 0x5611fa6de300 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe8917f9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881adf20 con 0x5611fa6d1690 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe8917f9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881acab0 con 0x5611fa6d0d70 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88d077640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6de300 0x5611fa6f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6dbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.86:58728/0 (socket says 172.21.15.86:58728) 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 -- 172.21.15.86:0/2102559944 learned_addr learned my addr 172.21.15.86:0/2102559944 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 -- 172.21.15.86:0/2102559944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d1690 msgr2=0x5611fa6dd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 --2- 172.21.15.86:0/2102559944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d1690 0x5611fa6dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 -- 172.21.15.86:0/2102559944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6de300 msgr2=0x5611fa6f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 --2- 172.21.15.86:0/2102559944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6de300 0x5611fa6f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 -- 172.21.15.86:0/2102559944 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fa6e0a60 con 0x5611fa6d0d70 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.929+0000 7fe88c876640 1 --2- 172.21.15.86:0/2102559944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6dbb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe884000f80 tx=0x7fe884015af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfa3c02d70b04b8a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe86e7fc640 1 -- 172.21.15.86:0/2102559944 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840153d0 con 0x5611fa6d0d70 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe86e7fc640 1 -- 172.21.15.86:0/2102559944 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe884022070 con 0x5611fa6d0d70 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe86e7fc640 1 -- 172.21.15.86:0/2102559944 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88401dac0 con 0x5611fa6d0d70 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 -- 172.21.15.86:0/2102559944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 msgr2=0x5611fa6dbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 --2- 172.21.15.86:0/2102559944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6dbb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe884000f80 tx=0x7fe884015af0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 -- 172.21.15.86:0/2102559944 shutdown_connections 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 --2- 172.21.15.86:0/2102559944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6de300 0x5611fa6f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 --2- 172.21.15.86:0/2102559944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d1690 0x5611fa6dd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 --2- 172.21.15.86:0/2102559944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6d0d70 0x5611fa6dbb60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 -- 172.21.15.86:0/2102559944 >> 172.21.15.86:0/2102559944 conn(0x5611fa6cd420 msgr2=0x5611fa6dcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 -- 172.21.15.86:0/2102559944 shutdown_connections 2024-05-12T11:11:38.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.930+0000 7fe8917f9740 1 -- 172.21.15.86:0/2102559944 wait complete. 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 1 -- start start 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 1 Processor -- start 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d0d70 0x5611fa6d83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6de300 0x5611fa6d8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881ad850 con 0x5611fa6d1690 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881ad180 con 0x5611fa6d0d70 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881aa3c0 con 0x5611fa6de300 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe8917f9740 10 client.0 _ll_register_callbacks cb 0x7fe878009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe87ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe87ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6d88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50884/0 (socket says 172.21.15.86:50884) 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe87ffff640 1 -- 172.21.15.86:0/3454941439 learned_addr learned my addr 172.21.15.86:0/3454941439 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe88d077640 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6de300 0x5611fa6d8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe88c876640 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d0d70 0x5611fa6d83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe87ffff640 1 -- 172.21.15.86:0/3454941439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6de300 msgr2=0x5611fa6d8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe87ffff640 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6de300 0x5611fa6d8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe87ffff640 1 -- 172.21.15.86:0/3454941439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d0d70 msgr2=0x5611fa6d83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe87ffff640 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d0d70 0x5611fa6d83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.931+0000 7fe87ffff640 1 -- 172.21.15.86:0/3454941439 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611fa757de0 con 0x5611fa6d1690 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe87ffff640 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6d88e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe8780a5a20 tx=0x7fe878005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5b0894f1b7169c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe867fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe867fff640 1 -- 172.21.15.86:0/3454941439 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878005180 con 0x5611fa6d1690 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe867fff640 1 -- 172.21.15.86:0/3454941439 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fe8780a8f50 con 0x5611fa6d1690 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 1 -- 172.21.15.86:0/3454941439 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe884022070 con 0x5611fa6d1690 2024-05-12T11:11:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe867fff640 1 -- 172.21.15.86:0/3454941439 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe8780a5bb0 con 0x5611fa6d1690 2024-05-12T11:11:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 10 client.15729 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 1 -- 172.21.15.86:0/3454941439 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5611fa7590d0 con 0x5611fa6d1690 2024-05-12T11:11:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe867fff640 1 -- 172.21.15.86:0/3454941439 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe884022070 con 0x5611fa6d1690 2024-05-12T11:11:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe867fff640 1 -- 172.21.15.86:0/3454941439 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe8780af230 con 0x5611fa6d1690 2024-05-12T11:11:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 10 client.15729 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:11:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 20 client.15729 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5611fa7596c0 0x5611fa75bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 4 client.15729 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:11:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.932+0000 7fe8917f9740 1 -- 172.21.15.86:0/3454941439 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5611fa63e050 con 0x5611fa7596c0 2024-05-12T11:11:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.933+0000 7fe88c876640 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5611fa7596c0 0x5611fa75bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.933+0000 7fe867fff640 10 client.15729 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.933+0000 7fe88c876640 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5611fa7596c0 0x5611fa75bae0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5405130ee2398c1e server_cookie=8bde35a123af3e8d in_seq=0 out_seq=0 2024-05-12T11:11:38.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.946+0000 7fe867fff640 1 -- 172.21.15.86:0/3454941439 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5611fa63e050 con 0x5611fa7596c0 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.946+0000 7fe867fff640 10 client.15729 handle_command_reply: tid=0 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.946+0000 7fe8917f9740 1 client.15729 shutdown 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 -- 172.21.15.86:0/3454941439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 msgr2=0x5611fa6d88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6d88e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe8780a5a20 tx=0x7fe878005b40 comp rx=0 tx=0).stop 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 -- 172.21.15.86:0/3454941439 shutdown_connections 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5611fa7596c0 0x5611fa75bae0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611fa6de300 0x5611fa6d8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611fa6d1690 0x5611fa6d88e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe867fff640 0 client.15729 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 --2- 172.21.15.86:0/3454941439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611fa6d0d70 0x5611fa6d83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 -- 172.21.15.86:0/3454941439 >> 172.21.15.86:0/3454941439 conn(0x5611fa6cd420 msgr2=0x5611fa6dd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 -- 172.21.15.86:0/3454941439 shutdown_connections 2024-05-12T11:11:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 1 -- 172.21.15.86:0/3454941439 wait complete. 2024-05-12T11:11:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe8917f9740 20 client.15729 trim_cache size 0 max 16384 2024-05-12T11:11:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:11:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:11:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:11:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 -- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe8700b2a10 msgr2=0x7fe8700b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe8700b2a10 0x7fe8700b4ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe880006010 tx=0x7fe88004c000 comp rx=0 tx=0).stop 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 -- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 msgr2=0x7fe8881985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 0x7fe8881985e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe87800e9f0 tx=0x7fe87800edf0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 -- 172.21.15.86:0/498175114 shutdown_connections 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fe8700b2a10 0x7fe8700b4ed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8881078a0 0x7fe88819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8881022a0 0x7fe8881985e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 --2- 172.21.15.86:0/498175114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8881018e0 0x7fe8881980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.947+0000 7fe88eada640 1 -- 172.21.15.86:0/498175114 >> 172.21.15.86:0/498175114 conn(0x7fe888078a30 msgr2=0x7fe8881044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.948+0000 7fe88eada640 1 -- 172.21.15.86:0/498175114 shutdown_connections 2024-05-12T11:11:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:38.948+0000 7fe88eada640 1 -- 172.21.15.86:0/498175114 wait complete. 2024-05-12T11:11:39.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:39 smithi086 ceph-mon[30110]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:39.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:39 smithi172 ceph-mon[34517]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:39.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:39 smithi176 ceph-mon[34357]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-12T11:11:41.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:41 smithi086 ceph-mon[30110]: pgmap v71: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 771 op/s 2024-05-12T11:11:41.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:41 smithi172 ceph-mon[34517]: pgmap v71: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 771 op/s 2024-05-12T11:11:41.516 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:41 smithi176 ceph-mon[34357]: pgmap v71: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 771 op/s 2024-05-12T11:11:43.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:43 smithi086 ceph-mon[30110]: pgmap v72: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 766 op/s 2024-05-12T11:11:43.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:43 smithi172 ceph-mon[34517]: pgmap v72: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 766 op/s 2024-05-12T11:11:43.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:43 smithi176 ceph-mon[34357]: pgmap v72: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 766 op/s 2024-05-12T11:11:45.462 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:45 smithi086 ceph-mon[30110]: pgmap v73: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 766 op/s 2024-05-12T11:11:45.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:45 smithi172 ceph-mon[34517]: pgmap v73: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 766 op/s 2024-05-12T11:11:45.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:45 smithi176 ceph-mon[34357]: pgmap v73: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 766 op/s 2024-05-12T11:11:46.991 INFO:tasks.workunit.client.0.smithi086.stdout:.......... 2024-05-12T11:11:46.992 INFO:tasks.workunit.client.0.smithi086.stdout:do_o_direct_reads: SUCCESS 2024-05-12T11:11:46.994 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T11:11:46.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T11:11:47.064 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-05-12T11:11:47.064 DEBUG:teuthology.orchestra.run.smithi086:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1ec882358465db8f363a3865fa83f099183688a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-05-12T11:11:47.129 INFO:tasks.workunit.client.0.smithi086.stdout:test read from hole 2024-05-12T11:11:47.129 INFO:tasks.workunit.client.0.smithi086.stderr:+ echo 'test read from hole' 2024-05-12T11:11:47.129 INFO:tasks.workunit.client.0.smithi086.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-05-12T11:11:47.131 INFO:tasks.workunit.client.0.smithi086.stderr:0+0 records in 2024-05-12T11:11:47.131 INFO:tasks.workunit.client.0.smithi086.stderr:0+0 records out 2024-05-12T11:11:47.131 INFO:tasks.workunit.client.0.smithi086.stderr:0 bytes copied, 3.3526e-05 s, 0.0 kB/s 2024-05-12T11:11:47.131 INFO:tasks.workunit.client.0.smithi086.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-05-12T11:11:47.133 INFO:tasks.workunit.client.0.smithi086.stderr:2+0 records in 2024-05-12T11:11:47.133 INFO:tasks.workunit.client.0.smithi086.stderr:2+0 records out 2024-05-12T11:11:47.133 INFO:tasks.workunit.client.0.smithi086.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00146216 s, 700 kB/s 2024-05-12T11:11:47.133 INFO:tasks.workunit.client.0.smithi086.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-05-12T11:11:47.134 INFO:tasks.workunit.client.0.smithi086.stderr:2+0 records in 2024-05-12T11:11:47.134 INFO:tasks.workunit.client.0.smithi086.stderr:2+0 records out 2024-05-12T11:11:47.134 INFO:tasks.workunit.client.0.smithi086.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.9188e-05 s, 26.1 MB/s 2024-05-12T11:11:47.134 INFO:tasks.workunit.client.0.smithi086.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-05-12T11:11:47.134 INFO:tasks.workunit.client.0.smithi086.stdout:other thing 2024-05-12T11:11:47.134 INFO:tasks.workunit.client.0.smithi086.stderr:+ echo 'other thing' 2024-05-12T11:11:47.135 INFO:tasks.workunit.client.0.smithi086.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-05-12T11:11:47.135 INFO:tasks.workunit.client.0.smithi086.stderr:1+0 records in 2024-05-12T11:11:47.135 INFO:tasks.workunit.client.0.smithi086.stderr:1+0 records out 2024-05-12T11:11:47.135 INFO:tasks.workunit.client.0.smithi086.stderr:500 bytes copied, 3.8231e-05 s, 13.1 MB/s 2024-05-12T11:11:47.135 INFO:tasks.workunit.client.0.smithi086.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-05-12T11:11:47.143 INFO:tasks.workunit.client.0.smithi086.stderr:0+1 records in 2024-05-12T11:11:47.144 INFO:tasks.workunit.client.0.smithi086.stderr:0+1 records out 2024-05-12T11:11:47.144 INFO:tasks.workunit.client.0.smithi086.stderr:500 bytes copied, 0.00541047 s, 92.4 kB/s 2024-05-12T11:11:47.144 INFO:tasks.workunit.client.0.smithi086.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-05-12T11:11:47.149 INFO:tasks.workunit.client.0.smithi086.stderr:0+1 records in 2024-05-12T11:11:47.150 INFO:tasks.workunit.client.0.smithi086.stderr:0+1 records out 2024-05-12T11:11:47.150 INFO:tasks.workunit.client.0.smithi086.stderr:500 bytes copied, 0.00542787 s, 92.1 kB/s 2024-05-12T11:11:47.150 INFO:tasks.workunit.client.0.smithi086.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-05-12T11:11:47.150 INFO:tasks.workunit.client.0.smithi086.stdout:OK 2024-05-12T11:11:47.151 INFO:tasks.workunit.client.0.smithi086.stderr:+ echo OK 2024-05-12T11:11:47.152 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T11:11:47.152 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T11:11:47.237 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-05-12T11:11:47.237 DEBUG:teuthology.orchestra.run.smithi086:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1ec882358465db8f363a3865fa83f099183688a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-05-12T11:11:47.316 INFO:tasks.workunit.client.0.smithi086.stdout:writing first 3 bytes of 10k file 2024-05-12T11:11:47.316 INFO:tasks.workunit.client.0.smithi086.stdout:reading O_DIRECT 2024-05-12T11:11:47.316 INFO:tasks.workunit.client.0.smithi086.stdout:got 10000 2024-05-12T11:11:47.317 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T11:11:47.317 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T11:11:47.395 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:47 smithi086 ceph-mon[30110]: pgmap v74: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 2.21k op/s 2024-05-12T11:11:47.407 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-05-12T11:11:47.407 DEBUG:teuthology.orchestra.run.smithi086:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1ec882358465db8f363a3865fa83f099183688a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-05-12T11:11:47.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:47 smithi172 ceph-mon[34517]: pgmap v74: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 2.21k op/s 2024-05-12T11:11:47.522 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:47 smithi176 ceph-mon[34357]: pgmap v74: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 2.21k op/s 2024-05-12T11:11:48.671 INFO:tasks.workunit.client.0.smithi086.stdout:writing pattern 2024-05-12T11:11:48.671 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-05-12T11:11:48.671 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-05-12T11:11:48.671 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-05-12T11:11:48.672 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-05-12T11:11:48.673 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-05-12T11:11:48.674 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-05-12T11:11:48.675 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-05-12T11:11:48.676 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-05-12T11:11:48.677 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-05-12T11:11:48.678 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-05-12T11:11:48.679 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-05-12T11:11:48.679 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-05-12T11:11:48.679 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-05-12T11:11:48.679 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-05-12T11:11:48.689 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-05-12T11:11:48.690 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-05-12T11:11:48.691 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-05-12T11:11:48.692 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-05-12T11:11:48.693 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-05-12T11:11:48.694 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-05-12T11:11:48.695 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-05-12T11:11:48.696 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-05-12T11:11:48.700 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-05-12T11:11:48.700 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-05-12T11:11:48.700 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-05-12T11:11:48.700 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-05-12T11:11:48.700 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-05-12T11:11:48.700 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-05-12T11:11:48.701 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-05-12T11:11:48.702 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-05-12T11:11:48.703 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-05-12T11:11:48.704 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-05-12T11:11:48.705 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-05-12T11:11:48.706 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-05-12T11:11:48.711 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-05-12T11:11:48.711 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-05-12T11:11:48.711 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-05-12T11:11:48.711 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-05-12T11:11:48.711 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-05-12T11:11:48.712 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-05-12T11:11:48.713 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-05-12T11:11:48.714 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-05-12T11:11:48.715 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-05-12T11:11:48.716 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-05-12T11:11:48.717 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-05-12T11:11:48.731 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-05-12T11:11:48.731 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-05-12T11:11:48.731 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-05-12T11:11:48.731 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-05-12T11:11:48.731 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-05-12T11:11:48.731 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-05-12T11:11:48.732 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-05-12T11:11:48.733 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-05-12T11:11:48.734 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-05-12T11:11:48.735 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-05-12T11:11:48.736 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-05-12T11:11:48.737 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-05-12T11:11:48.738 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-05-12T11:11:48.738 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-05-12T11:11:48.738 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-05-12T11:11:48.738 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-05-12T11:11:48.745 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-05-12T11:11:48.746 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-05-12T11:11:48.747 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-05-12T11:11:48.748 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-05-12T11:11:48.749 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-05-12T11:11:48.750 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-05-12T11:11:48.751 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-05-12T11:11:48.751 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-05-12T11:11:48.751 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-05-12T11:11:48.751 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-05-12T11:11:48.751 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-05-12T11:11:48.755 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-05-12T11:11:48.755 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-05-12T11:11:48.756 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-05-12T11:11:48.757 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-05-12T11:11:48.758 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-05-12T11:11:48.759 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-05-12T11:11:48.760 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-05-12T11:11:48.761 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-05-12T11:11:48.761 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-05-12T11:11:48.761 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-05-12T11:11:48.761 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-05-12T11:11:48.761 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-05-12T11:11:48.761 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-05-12T11:11:48.761 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-05-12T11:11:48.761 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-05-12T11:11:48.762 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-05-12T11:11:48.767 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-05-12T11:11:48.768 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-05-12T11:11:48.769 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-05-12T11:11:48.770 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-05-12T11:11:48.771 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-05-12T11:11:48.772 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-05-12T11:11:48.773 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-05-12T11:11:48.783 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-05-12T11:11:48.783 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-05-12T11:11:48.783 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-05-12T11:11:48.784 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-05-12T11:11:48.785 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-05-12T11:11:48.786 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-05-12T11:11:48.787 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-05-12T11:11:48.788 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-05-12T11:11:48.789 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-05-12T11:11:48.789 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-05-12T11:11:48.789 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-05-12T11:11:48.789 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-05-12T11:11:48.789 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-05-12T11:11:48.789 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-05-12T11:11:48.789 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-05-12T11:11:48.789 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-05-12T11:11:48.798 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-05-12T11:11:48.798 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-05-12T11:11:48.798 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-05-12T11:11:48.798 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-05-12T11:11:48.799 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-05-12T11:11:48.800 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-05-12T11:11:48.801 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-05-12T11:11:48.802 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-05-12T11:11:48.803 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-05-12T11:11:48.804 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-05-12T11:11:48.804 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-05-12T11:11:48.804 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-05-12T11:11:48.804 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-05-12T11:11:48.804 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-05-12T11:11:48.807 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-05-12T11:11:48.808 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-05-12T11:11:48.809 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-05-12T11:11:48.810 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-05-12T11:11:48.811 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-05-12T11:11:48.812 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-05-12T11:11:48.813 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-05-12T11:11:48.821 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-05-12T11:11:48.822 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-05-12T11:11:48.823 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-05-12T11:11:48.824 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-05-12T11:11:48.825 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-05-12T11:11:48.826 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-05-12T11:11:48.841 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-05-12T11:11:48.842 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-05-12T11:11:48.843 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-05-12T11:11:48.844 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-05-12T11:11:48.845 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-05-12T11:11:48.846 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-05-12T11:11:48.847 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-05-12T11:11:48.856 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-05-12T11:11:48.857 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-05-12T11:11:48.858 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-05-12T11:11:48.859 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-05-12T11:11:48.860 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-05-12T11:11:48.861 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-05-12T11:11:48.862 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-05-12T11:11:48.863 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-05-12T11:11:48.864 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-05-12T11:11:48.864 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-05-12T11:11:48.864 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-05-12T11:11:48.864 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-05-12T11:11:48.864 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-05-12T11:11:48.864 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-05-12T11:11:48.864 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-05-12T11:11:48.865 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-05-12T11:11:48.866 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-05-12T11:11:48.867 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-05-12T11:11:48.868 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-05-12T11:11:48.869 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-05-12T11:11:48.870 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-05-12T11:11:48.870 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-05-12T11:11:48.870 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-05-12T11:11:48.870 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-05-12T11:11:48.870 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-05-12T11:11:48.870 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-05-12T11:11:48.870 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-05-12T11:11:48.878 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-05-12T11:11:48.878 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-05-12T11:11:48.878 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-05-12T11:11:48.879 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-05-12T11:11:48.880 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-05-12T11:11:48.881 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-05-12T11:11:48.882 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-05-12T11:11:48.883 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-05-12T11:11:48.884 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-05-12T11:11:48.884 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-05-12T11:11:48.884 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-05-12T11:11:48.884 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-05-12T11:11:48.884 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-05-12T11:11:48.884 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-05-12T11:11:48.884 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-05-12T11:11:48.884 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-05-12T11:11:48.885 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-05-12T11:11:48.885 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-05-12T11:11:48.885 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-05-12T11:11:48.885 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-05-12T11:11:48.897 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-05-12T11:11:48.898 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-05-12T11:11:48.899 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-05-12T11:11:48.900 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-05-12T11:11:48.901 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-05-12T11:11:48.902 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-05-12T11:11:48.903 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-05-12T11:11:48.904 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-05-12T11:11:48.909 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-05-12T11:11:48.910 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-05-12T11:11:48.911 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-05-12T11:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-05-12T11:11:48.913 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-05-12T11:11:48.914 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-05-12T11:11:48.915 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-05-12T11:11:48.915 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-05-12T11:11:48.915 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-05-12T11:11:48.915 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-05-12T11:11:48.915 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-05-12T11:11:48.915 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-05-12T11:11:48.915 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-05-12T11:11:48.917 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-05-12T11:11:48.917 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-05-12T11:11:48.918 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-05-12T11:11:48.919 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-05-12T11:11:48.920 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-05-12T11:11:48.921 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-05-12T11:11:48.922 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-05-12T11:11:48.923 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-05-12T11:11:48.933 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-05-12T11:11:48.933 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-05-12T11:11:48.933 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-05-12T11:11:48.934 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-05-12T11:11:48.935 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-05-12T11:11:48.936 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-05-12T11:11:48.937 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-05-12T11:11:48.938 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-05-12T11:11:48.939 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-05-12T11:11:48.940 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-05-12T11:11:48.954 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-05-12T11:11:48.954 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-05-12T11:11:48.954 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-05-12T11:11:48.954 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-05-12T11:11:48.954 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-05-12T11:11:48.954 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-05-12T11:11:48.955 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-05-12T11:11:48.955 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-05-12T11:11:48.958 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-05-12T11:11:48.958 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-05-12T11:11:48.958 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-05-12T11:11:48.958 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-05-12T11:11:48.958 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-05-12T11:11:48.958 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-05-12T11:11:48.959 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-05-12T11:11:48.960 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-05-12T11:11:48.961 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-05-12T11:11:48.962 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-05-12T11:11:48.963 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-05-12T11:11:48.964 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-05-12T11:11:48.964 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-05-12T11:11:48.964 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-05-12T11:11:48.964 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-05-12T11:11:48.964 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-05-12T11:11:48.965 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-05-12T11:11:48.966 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-05-12T11:11:48.967 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-05-12T11:11:48.967 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-05-12T11:11:48.967 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-05-12T11:11:48.967 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-05-12T11:11:48.967 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-05-12T11:11:48.967 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-05-12T11:11:48.967 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-05-12T11:11:48.967 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-05-12T11:11:48.968 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-05-12T11:11:48.968 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-05-12T11:11:48.968 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-05-12T11:11:48.968 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-05-12T11:11:48.968 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-05-12T11:11:48.968 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-05-12T11:11:48.968 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-05-12T11:11:48.968 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-05-12T11:11:48.969 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-05-12T11:11:48.970 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-05-12T11:11:48.971 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-05-12T11:11:48.971 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-05-12T11:11:48.971 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-05-12T11:11:48.971 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-05-12T11:11:48.971 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-05-12T11:11:48.971 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-05-12T11:11:48.971 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-05-12T11:11:48.971 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-05-12T11:11:48.972 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-05-12T11:11:48.973 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-05-12T11:11:48.973 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-05-12T11:11:48.973 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-05-12T11:11:48.973 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-05-12T11:11:48.973 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-05-12T11:11:48.973 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-05-12T11:11:48.974 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-05-12T11:11:48.975 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-05-12T11:11:48.976 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-05-12T11:11:48.977 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-05-12T11:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-05-12T11:11:48.979 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-05-12T11:11:48.980 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-05-12T11:11:48.980 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-05-12T11:11:48.980 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-05-12T11:11:48.988 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-05-12T11:11:48.988 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-05-12T11:11:48.988 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-05-12T11:11:48.989 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-05-12T11:11:48.990 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-05-12T11:11:48.991 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-05-12T11:11:48.992 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-05-12T11:11:48.993 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-05-12T11:11:48.994 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-05-12T11:11:48.994 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-05-12T11:11:48.994 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-05-12T11:11:48.994 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-05-12T11:11:48.994 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-05-12T11:11:48.994 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-05-12T11:11:48.994 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-05-12T11:11:49.007 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-05-12T11:11:49.007 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-05-12T11:11:49.007 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-05-12T11:11:49.007 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-05-12T11:11:49.007 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-05-12T11:11:49.008 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-05-12T11:11:49.009 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-05-12T11:11:49.010 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-05-12T11:11:49.011 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-05-12T11:11:49.012 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-05-12T11:11:49.013 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-05-12T11:11:49.013 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-05-12T11:11:49.013 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-05-12T11:11:49.013 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-05-12T11:11:49.013 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-05-12T11:11:49.013 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-05-12T11:11:49.013 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-05-12T11:11:49.013 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-05-12T11:11:49.015 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-05-12T11:11:49.015 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-05-12T11:11:49.015 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-05-12T11:11:49.015 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-05-12T11:11:49.016 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-05-12T11:11:49.017 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-05-12T11:11:49.018 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-05-12T11:11:49.019 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-05-12T11:11:49.020 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-05-12T11:11:49.021 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-05-12T11:11:49.024 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-05-12T11:11:49.024 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-05-12T11:11:49.024 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-05-12T11:11:49.024 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-05-12T11:11:49.024 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-05-12T11:11:49.024 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-05-12T11:11:49.025 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-05-12T11:11:49.026 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-05-12T11:11:49.027 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-05-12T11:11:49.028 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-05-12T11:11:49.029 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-05-12T11:11:49.030 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-05-12T11:11:49.031 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-05-12T11:11:49.031 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-05-12T11:11:49.031 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-05-12T11:11:49.031 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-05-12T11:11:49.031 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-05-12T11:11:49.031 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-05-12T11:11:49.043 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-05-12T11:11:49.043 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-05-12T11:11:49.043 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-05-12T11:11:49.044 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-05-12T11:11:49.044 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-05-12T11:11:49.044 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-05-12T11:11:49.044 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-05-12T11:11:49.044 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-05-12T11:11:49.044 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-05-12T11:11:49.044 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-05-12T11:11:49.044 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-05-12T11:11:49.045 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-05-12T11:11:49.045 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-05-12T11:11:49.045 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-05-12T11:11:49.045 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-05-12T11:11:49.045 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-05-12T11:11:49.045 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-05-12T11:11:49.045 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-05-12T11:11:49.045 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-05-12T11:11:49.046 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-05-12T11:11:49.046 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-05-12T11:11:49.046 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-05-12T11:11:49.046 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-05-12T11:11:49.046 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-05-12T11:11:49.046 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-05-12T11:11:49.047 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-05-12T11:11:49.048 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-05-12T11:11:49.048 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-05-12T11:11:49.048 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-05-12T11:11:49.048 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-05-12T11:11:49.048 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-05-12T11:11:49.048 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-05-12T11:11:49.048 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-05-12T11:11:49.049 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-05-12T11:11:49.050 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-05-12T11:11:49.050 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-05-12T11:11:49.050 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-05-12T11:11:49.050 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-05-12T11:11:49.050 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-05-12T11:11:49.050 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-05-12T11:11:49.050 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-05-12T11:11:49.051 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-05-12T11:11:49.051 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-05-12T11:11:49.051 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-05-12T11:11:49.051 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-05-12T11:11:49.051 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-05-12T11:11:49.051 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-05-12T11:11:49.051 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-05-12T11:11:49.051 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-05-12T11:11:49.052 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-05-12T11:11:49.053 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-05-12T11:11:49.053 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-05-12T11:11:49.053 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-05-12T11:11:49.053 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-05-12T11:11:49.053 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-05-12T11:11:49.053 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-05-12T11:11:49.053 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-05-12T11:11:49.053 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-05-12T11:11:49.054 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-05-12T11:11:49.064 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-05-12T11:11:49.064 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-05-12T11:11:49.064 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-05-12T11:11:49.065 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-05-12T11:11:49.065 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-05-12T11:11:49.065 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-05-12T11:11:49.065 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-05-12T11:11:49.065 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-05-12T11:11:49.065 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-05-12T11:11:49.066 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-05-12T11:11:49.066 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-05-12T11:11:49.066 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-05-12T11:11:49.066 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-05-12T11:11:49.066 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-05-12T11:11:49.066 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-05-12T11:11:49.066 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-05-12T11:11:49.067 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-05-12T11:11:49.067 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-05-12T11:11:49.067 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-05-12T11:11:49.067 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-05-12T11:11:49.067 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-05-12T11:11:49.068 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-05-12T11:11:49.068 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-05-12T11:11:49.068 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-05-12T11:11:49.068 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-05-12T11:11:49.068 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-05-12T11:11:49.068 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-05-12T11:11:49.068 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-05-12T11:11:49.068 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-05-12T11:11:49.069 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-05-12T11:11:49.069 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-05-12T11:11:49.069 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-05-12T11:11:49.069 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-05-12T11:11:49.069 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-05-12T11:11:49.069 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-05-12T11:11:49.069 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-05-12T11:11:49.070 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-05-12T11:11:49.070 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-05-12T11:11:49.070 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-05-12T11:11:49.070 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-05-12T11:11:49.070 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-05-12T11:11:49.070 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-05-12T11:11:49.071 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-05-12T11:11:49.071 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-05-12T11:11:49.071 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-05-12T11:11:49.071 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-05-12T11:11:49.071 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-05-12T11:11:49.071 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-05-12T11:11:49.071 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-05-12T11:11:49.072 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-05-12T11:11:49.072 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-05-12T11:11:49.072 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-05-12T11:11:49.072 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-05-12T11:11:49.072 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-05-12T11:11:49.072 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-05-12T11:11:49.072 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-05-12T11:11:49.072 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-05-12T11:11:49.073 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-05-12T11:11:49.073 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-05-12T11:11:49.073 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-05-12T11:11:49.073 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-05-12T11:11:49.073 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-05-12T11:11:49.073 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-05-12T11:11:49.073 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-05-12T11:11:49.074 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-05-12T11:11:49.074 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-05-12T11:11:49.074 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-05-12T11:11:49.074 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-05-12T11:11:49.074 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-05-12T11:11:49.074 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-05-12T11:11:49.074 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-05-12T11:11:49.075 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-05-12T11:11:49.075 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-05-12T11:11:49.075 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-05-12T11:11:49.075 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-05-12T11:11:49.075 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-05-12T11:11:49.075 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-05-12T11:11:49.075 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-05-12T11:11:49.075 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-05-12T11:11:49.076 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-05-12T11:11:49.076 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-05-12T11:11:49.076 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-05-12T11:11:49.077 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-05-12T11:11:49.077 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-05-12T11:11:49.077 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-05-12T11:11:49.077 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-05-12T11:11:49.077 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-05-12T11:11:49.077 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-05-12T11:11:49.077 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-05-12T11:11:49.077 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-05-12T11:11:49.078 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-05-12T11:11:49.078 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-05-12T11:11:49.078 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-05-12T11:11:49.078 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-05-12T11:11:49.078 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-05-12T11:11:49.078 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-05-12T11:11:49.078 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-05-12T11:11:49.079 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-05-12T11:11:49.079 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-05-12T11:11:49.079 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-05-12T11:11:49.079 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-05-12T11:11:49.079 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-05-12T11:11:49.079 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-05-12T11:11:49.079 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-05-12T11:11:49.079 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-05-12T11:11:49.080 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-05-12T11:11:49.081 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-05-12T11:11:49.082 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-05-12T11:11:49.082 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-05-12T11:11:49.082 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-05-12T11:11:49.082 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-05-12T11:11:49.082 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-05-12T11:11:49.082 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-05-12T11:11:49.082 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-05-12T11:11:49.083 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-05-12T11:11:49.084 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-05-12T11:11:49.084 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-05-12T11:11:49.084 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-05-12T11:11:49.084 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-05-12T11:11:49.084 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-05-12T11:11:49.084 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-05-12T11:11:49.084 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-05-12T11:11:49.084 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-05-12T11:11:49.085 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-05-12T11:11:49.086 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-05-12T11:11:49.086 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-05-12T11:11:49.086 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-05-12T11:11:49.086 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-05-12T11:11:49.249 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-05-12T11:11:49.249 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-05-12T11:11:49.249 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-05-12T11:11:49.249 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-05-12T11:11:49.249 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-05-12T11:11:49.249 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-05-12T11:11:49.249 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-05-12T11:11:49.249 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-05-12T11:11:49.250 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-05-12T11:11:49.251 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-05-12T11:11:49.252 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-05-12T11:11:49.253 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-05-12T11:11:49.254 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-05-12T11:11:49.255 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-05-12T11:11:49.255 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-05-12T11:11:49.255 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-05-12T11:11:49.255 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-05-12T11:11:49.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:49 smithi086 ceph-mon[30110]: pgmap v75: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 2.20k op/s 2024-05-12T11:11:49.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:49 smithi172 ceph-mon[34517]: pgmap v75: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 2.20k op/s 2024-05-12T11:11:49.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:49 smithi176 ceph-mon[34357]: pgmap v75: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 2.20k op/s 2024-05-12T11:11:49.937 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-05-12T11:11:49.938 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-05-12T11:11:49.939 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-05-12T11:11:49.940 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-05-12T11:11:49.941 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-05-12T11:11:49.942 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-05-12T11:11:49.943 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-05-12T11:11:49.944 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-05-12T11:11:49.945 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-05-12T11:11:49.945 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-05-12T11:11:49.945 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-05-12T11:11:50.449 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-05-12T11:11:50.450 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-05-12T11:11:50.450 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-05-12T11:11:50.450 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-05-12T11:11:50.450 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-05-12T11:11:50.450 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-05-12T11:11:50.450 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-05-12T11:11:50.451 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-05-12T11:11:50.452 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-05-12T11:11:50.453 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-05-12T11:11:50.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-05-12T11:11:50.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-05-12T11:11:50.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-05-12T11:11:50.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-05-12T11:11:50.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-05-12T11:11:50.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-05-12T11:11:50.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-05-12T11:11:50.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-05-12T11:11:50.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-05-12T11:11:50.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-05-12T11:11:50.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-05-12T11:11:50.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-05-12T11:11:50.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-05-12T11:11:50.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-05-12T11:11:50.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-05-12T11:11:50.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-05-12T11:11:50.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-05-12T11:11:50.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-05-12T11:11:50.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-05-12T11:11:50.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-05-12T11:11:50.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-05-12T11:11:50.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-05-12T11:11:50.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-05-12T11:11:50.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-05-12T11:11:50.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-05-12T11:11:50.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-05-12T11:11:50.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-05-12T11:11:50.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-05-12T11:11:50.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-05-12T11:11:50.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-05-12T11:11:50.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-05-12T11:11:50.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-05-12T11:11:50.813 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-05-12T11:11:50.814 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-05-12T11:11:50.815 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-05-12T11:11:50.816 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-05-12T11:11:50.817 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-05-12T11:11:50.818 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-05-12T11:11:50.819 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-05-12T11:11:50.819 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-05-12T11:11:50.819 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-05-12T11:11:50.819 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-05-12T11:11:51.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-05-12T11:11:51.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-05-12T11:11:51.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-05-12T11:11:51.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-05-12T11:11:51.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-05-12T11:11:51.454 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-05-12T11:11:51.455 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-05-12T11:11:51.456 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-05-12T11:11:51.457 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-05-12T11:11:51.458 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-05-12T11:11:51.459 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-05-12T11:11:51.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-05-12T11:11:51.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-05-12T11:11:51.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-05-12T11:11:51.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-05-12T11:11:51.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-05-12T11:11:51.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-05-12T11:11:51.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-05-12T11:11:51.460 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-05-12T11:11:51.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:51 smithi086 ceph-mon[30110]: pgmap v76: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.1 MiB/s wr, 3.06k op/s 2024-05-12T11:11:51.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:51 smithi172 ceph-mon[34517]: pgmap v76: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.1 MiB/s wr, 3.06k op/s 2024-05-12T11:11:51.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:51 smithi176 ceph-mon[34357]: pgmap v76: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.1 MiB/s wr, 3.06k op/s 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 -- 172.21.15.86:0/1318593256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 msgr2=0x7f4c90106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1318593256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 0x7f4c90106c80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009900 tx=0x7f4c8002a400 comp rx=0 tx=0).stop 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 -- 172.21.15.86:0/1318593256 shutdown_connections 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1318593256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c901029e0 0x7f4c9010e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1318593256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c90102040 0x7f4c901024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1318593256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 0x7f4c90106c80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 -- 172.21.15.86:0/1318593256 >> 172.21.15.86:0/1318593256 conn(0x7f4c90077dd0 msgr2=0x7f4c900ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 -- 172.21.15.86:0/1318593256 shutdown_connections 2024-05-12T11:11:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 -- 172.21.15.86:0/1318593256 wait complete. 2024-05-12T11:11:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.045+0000 7f4c951dd640 1 Processor -- start 2024-05-12T11:11:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c951dd640 1 -- start start 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c951dd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c90102040 0x7f4c90199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c951dd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c901029e0 0x7f4c90199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c951dd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 0x7f4c9019daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c951dd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c90111c50 con 0x7f4c901068a0 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c951dd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c90111ad0 con 0x7f4c90102040 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c951dd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c90111dd0 con 0x7f4c901029e0 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8f59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 0x7f4c9019daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c90102040 0x7f4c90199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8f59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 0x7f4c9019daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58706/0 (socket says 172.21.15.86:58706) 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c90102040 0x7f4c90199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.86:35098/0 (socket says 172.21.15.86:35098) 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8f59e640 1 -- 172.21.15.86:0/1144323788 learned_addr learned my addr 172.21.15.86:0/1144323788 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c901029e0 0x7f4c90199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8f59e640 1 -- 172.21.15.86:0/1144323788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c901029e0 msgr2=0x7f4c90199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8f59e640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c901029e0 0x7f4c90199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8f59e640 1 -- 172.21.15.86:0/1144323788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c90102040 msgr2=0x7f4c90199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8f59e640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c90102040 0x7f4c90199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.046+0000 7f4c8f59e640 1 -- 172.21.15.86:0/1144323788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9019e220 con 0x7f4c901068a0 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.047+0000 7f4c8f59e640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 0x7f4c9019daf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800eb10 tx=0x7f4c8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.047+0000 7f4c77fff640 1 -- 172.21.15.86:0/1144323788 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88004b20 con 0x7f4c901068a0 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.047+0000 7f4c951dd640 1 -- 172.21.15.86:0/1144323788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9019e510 con 0x7f4c901068a0 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.047+0000 7f4c77fff640 1 -- 172.21.15.86:0/1144323788 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c88004cc0 con 0x7f4c901068a0 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.047+0000 7f4c77fff640 1 -- 172.21.15.86:0/1144323788 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88010670 con 0x7f4c901068a0 2024-05-12T11:11:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.047+0000 7f4c951dd640 1 -- 172.21.15.86:0/1144323788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c901a5da0 con 0x7f4c901068a0 2024-05-12T11:11:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c77fff640 1 -- 172.21.15.86:0/1144323788 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4c88005020 con 0x7f4c901068a0 2024-05-12T11:11:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c97fd5740 1 Processor -- start 2024-05-12T11:11:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c97fd5740 1 -- start start 2024-05-12T11:11:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a91442f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 0x5563a91514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5563a90a95d0 con 0x5563a9143f10 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563a9062890 con 0x5563a9144830 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5563a90a5590 con 0x5563a914f0f0 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a91442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a91442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58714/0 (socket says 172.21.15.86:58714) 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8e59c640 1 -- 172.21.15.86:0/982878461 learned_addr learned my addr 172.21.15.86:0/982878461 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8e59c640 1 -- 172.21.15.86:0/982878461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 msgr2=0x5563a91514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 0x5563a91514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8e59c640 1 -- 172.21.15.86:0/982878461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 msgr2=0x5563a914ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c77fff640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4c780b2a10 0x7f4c780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8e59c640 1 -- 172.21.15.86:0/982878461 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563a8dbb210 con 0x5563a9143f10 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.050+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a91442f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4c84005bc0 tx=0x7f4c84013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b32f28aaf0146a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4c780b2a10 0x7f4c780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c77fff640 1 -- 172.21.15.86:0/1144323788 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4c880e2b00 con 0x7f4c901068a0 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c757fa640 1 -- 172.21.15.86:0/982878461 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8401c470 con 0x5563a9143f10 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c757fa640 1 -- 172.21.15.86:0/982878461 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c84017070 con 0x5563a9143f10 2024-05-12T11:11:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c757fa640 1 -- 172.21.15.86:0/982878461 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400f620 con 0x5563a9143f10 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c97fd5740 1 -- 172.21.15.86:0/982878461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 msgr2=0x5563a91442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4c780b2a10 0x7f4c780b4ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009230 tx=0x7f4c800058d0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.051+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a91442f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4c84005bc0 tx=0x7f4c84013830 comp rx=0 tx=0).stop 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 -- 172.21.15.86:0/982878461 shutdown_connections 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 0x5563a91514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/982878461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a91442f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 -- 172.21.15.86:0/982878461 >> 172.21.15.86:0/982878461 conn(0x5563a9140420 msgr2=0x5563a9140800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 -- 172.21.15.86:0/982878461 shutdown_connections 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 -- 172.21.15.86:0/982878461 wait complete. 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 -- start start 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 Processor -- start 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a914c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 0x5563a914cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5563a9151d20 con 0x5563a9143f10 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563a9066370 con 0x5563a9144830 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5563a9151ea0 con 0x5563a914f0f0 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c97fd5740 10 client.0 _ll_register_callbacks cb 0x5563a8dbaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.052+0000 7f4c8ed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a914c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8ed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a914c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58724/0 (socket says 172.21.15.86:58724) 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8ed9d640 1 -- 172.21.15.86:0/3107104069 learned_addr learned my addr 172.21.15.86:0/3107104069 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8f59e640 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 0x5563a914cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8e59c640 1 -- 172.21.15.86:0/3107104069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 msgr2=0x5563a914cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 0x5563a914cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8e59c640 1 -- 172.21.15.86:0/3107104069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 msgr2=0x5563a914c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a914c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8e59c640 1 -- 172.21.15.86:0/3107104069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563a8e87620 con 0x5563a9144830 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a914c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914c590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c84010d60 tx=0x7f4c84010bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7ebed17e489a161 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c72ff5640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c72ff5640 1 -- 172.21.15.86:0/3107104069 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84005c70 con 0x5563a9144830 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c97fd5740 1 -- 172.21.15.86:0/3107104069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c84017070 con 0x5563a9144830 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.053+0000 7f4c72ff5640 1 -- 172.21.15.86:0/3107104069 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4c8401c470 con 0x5563a9144830 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c72ff5640 1 -- 172.21.15.86:0/3107104069 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c8401c670 con 0x5563a9144830 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c97fd5740 10 client.25133 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c97fd5740 1 -- 172.21.15.86:0/3107104069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563a915dbb0 con 0x5563a9144830 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c72ff5640 1 -- 172.21.15.86:0/3107104069 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c84017070 con 0x5563a9144830 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c72ff5640 1 -- 172.21.15.86:0/3107104069 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4c8402e940 con 0x5563a9144830 2024-05-12T11:11:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c97fd5740 10 client.25133 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c97fd5740 10 client.25133 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c97fd5740 20 client.25133 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5563a915efc0 0x5563a91613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c97fd5740 4 client.25133 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c97fd5740 1 -- 172.21.15.86:0/3107104069 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563a90b71e0 con 0x5563a915efc0 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.054+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5563a915efc0 0x5563a91613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.055+0000 7f4c72ff5640 10 client.25133 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.055+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5563a915efc0 0x5563a91613b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b945c2cec0dd0812 server_cookie=6030b51c3ac35901 in_seq=0 out_seq=0 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.055+0000 7f4c72ff5640 1 -- 172.21.15.86:0/3107104069 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5563a90b71e0 con 0x5563a915efc0 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.055+0000 7f4c72ff5640 10 client.25133 handle_command_reply: tid=0 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.055+0000 7f4c97fd5740 1 client.25133 shutdown 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.055+0000 7f4c97fd5740 1 -- 172.21.15.86:0/3107104069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 msgr2=0x5563a914c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914c590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c84010d60 tx=0x7f4c84010bc0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 -- 172.21.15.86:0/3107104069 shutdown_connections 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5563a915efc0 0x5563a91613b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a914f0f0 0x5563a914cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c72ff5640 0 client.25133 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a914c590 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/3107104069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9143f10 0x5563a914c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 -- 172.21.15.86:0/3107104069 >> 172.21.15.86:0/3107104069 conn(0x5563a9140420 msgr2=0x5563a91461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 -- 172.21.15.86:0/3107104069 shutdown_connections 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 1 -- 172.21.15.86:0/3107104069 wait complete. 2024-05-12T11:11:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.056+0000 7f4c97fd5740 20 client.25133 trim_cache size 0 max 16384 2024-05-12T11:11:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c97fd5740 1 Processor -- start 2024-05-12T11:11:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c97fd5740 1 -- start start 2024-05-12T11:11:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 0x5563a914c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9144830 0x5563a9166a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a914f0f0 0x5563a9166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c901ae720 con 0x5563a9144830 2024-05-12T11:11:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c901b0260 con 0x5563a914f0f0 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c901aedf0 con 0x5563a9143f10 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9144830 0x5563a9166a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8ed9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 0x5563a914c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9144830 0x5563a9166a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58728/0 (socket says 172.21.15.86:58728) 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a914f0f0 0x5563a9166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 -- 172.21.15.86:0/1848997380 learned_addr learned my addr 172.21.15.86:0/1848997380 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 -- 172.21.15.86:0/1848997380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 msgr2=0x5563a914c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/1848997380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 0x5563a914c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 -- 172.21.15.86:0/1848997380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a914f0f0 msgr2=0x5563a9166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/1848997380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a914f0f0 0x5563a9166fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 -- 172.21.15.86:0/1848997380 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563a9147c20 con 0x5563a9144830 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8f59e640 1 --2- 172.21.15.86:0/1848997380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a914f0f0 0x5563a9166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:11:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.072+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/1848997380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9144830 0x5563a9166a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4c840108d0 tx=0x7f4c84010b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173640ba78ce7edf server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c74ff9640 1 -- 172.21.15.86:0/1848997380 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84010d90 con 0x5563a9144830 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c74ff9640 1 -- 172.21.15.86:0/1848997380 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c84033070 con 0x5563a9144830 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c74ff9640 1 -- 172.21.15.86:0/1848997380 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84005040 con 0x5563a9144830 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 -- 172.21.15.86:0/1848997380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9144830 msgr2=0x5563a9166a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/1848997380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9144830 0x5563a9166a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4c840108d0 tx=0x7f4c84010b20 comp rx=0 tx=0).stop 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 -- 172.21.15.86:0/1848997380 shutdown_connections 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/1848997380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a914f0f0 0x5563a9166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/1848997380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a9144830 0x5563a9166a60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/1848997380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 0x5563a914c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 -- 172.21.15.86:0/1848997380 >> 172.21.15.86:0/1848997380 conn(0x5563a9140420 msgr2=0x5563a914c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 -- 172.21.15.86:0/1848997380 shutdown_connections 2024-05-12T11:11:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.073+0000 7f4c97fd5740 1 -- 172.21.15.86:0/1848997380 wait complete. 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 1 -- start start 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 1 Processor -- start 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 0x5563a9157310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a91526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a914f0f0 0x5563a9152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c901afb90 con 0x5563a914f0f0 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c901af4c0 con 0x5563a9144830 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c901ac700 con 0x5563a9143f10 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c97fd5740 10 client.0 _ll_register_callbacks cb 0x7f4c880093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a914f0f0 0x5563a9152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a914f0f0 0x5563a9152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58734/0 (socket says 172.21.15.86:58734) 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 -- 172.21.15.86:0/2689131408 learned_addr learned my addr 172.21.15.86:0/2689131408 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 0x5563a9157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8e59c640 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a91526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 -- 172.21.15.86:0/2689131408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 msgr2=0x5563a9157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 0x5563a9157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 -- 172.21.15.86:0/2689131408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 msgr2=0x5563a91526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:11:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a91526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 -- 172.21.15.86:0/2689131408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563a9153130 con 0x5563a914f0f0 2024-05-12T11:11:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c8f59e640 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a914f0f0 0x5563a9152bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c880e0850 tx=0x7f4c88005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4f4710144accac server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:11:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.074+0000 7f4c72ff5640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:11:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c72ff5640 1 -- 172.21.15.86:0/2689131408 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c880c9060 con 0x5563a914f0f0 2024-05-12T11:11:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c72ff5640 1 -- 172.21.15.86:0/2689131408 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4c880b27b0 con 0x5563a914f0f0 2024-05-12T11:11:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 1 -- 172.21.15.86:0/2689131408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c84033070 con 0x5563a914f0f0 2024-05-12T11:11:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c72ff5640 1 -- 172.21.15.86:0/2689131408 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c880a98f0 con 0x5563a914f0f0 2024-05-12T11:11:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 10 client.15747 fetch_fsmap learned FSMap version 29 2024-05-12T11:11:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 1 -- 172.21.15.86:0/2689131408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563a91c9350 con 0x5563a914f0f0 2024-05-12T11:11:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c72ff5640 1 -- 172.21.15.86:0/2689131408 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c84033070 con 0x5563a914f0f0 2024-05-12T11:11:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c72ff5640 1 -- 172.21.15.86:0/2689131408 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4c880a5750 con 0x5563a914f0f0 2024-05-12T11:11:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 10 client.15747 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:11:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:11:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 20 client.15747 populate_metadata read hostname 'smithi086' 2024-05-12T11:11:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5563a91c9ad0 0x5563a91cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:11:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 4 client.15747 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:11:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.075+0000 7f4c97fd5740 1 -- 172.21.15.86:0/2689131408 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5563a90b1050 con 0x5563a91c9ad0 2024-05-12T11:11:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.076+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5563a91c9ad0 0x5563a91cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:11:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.076+0000 7f4c72ff5640 10 client.15747 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.076+0000 7f4c8ed9d640 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5563a91c9ad0 0x5563a91cbef0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da2a97f15c13f095 server_cookie=f4761432167b3958 in_seq=0 out_seq=0 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c72ff5640 1 -- 172.21.15.86:0/2689131408 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5563a90b1050 con 0x5563a91c9ad0 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c72ff5640 10 client.15747 handle_command_reply: tid=0 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 client.15747 shutdown 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 -- 172.21.15.86:0/2689131408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a914f0f0 msgr2=0x5563a9152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a914f0f0 0x5563a9152bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c880e0850 tx=0x7f4c88005610 comp rx=0 tx=0).stop 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 -- 172.21.15.86:0/2689131408 shutdown_connections 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5563a91c9ad0 0x5563a91cbef0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563a914f0f0 0x5563a9152bf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c72ff5640 0 client.15747 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563a9144830 0x5563a91526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 --2- 172.21.15.86:0/2689131408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5563a9143f10 0x5563a9157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 -- 172.21.15.86:0/2689131408 >> 172.21.15.86:0/2689131408 conn(0x5563a9140420 msgr2=0x5563a914a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 -- 172.21.15.86:0/2689131408 shutdown_connections 2024-05-12T11:11:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 1 -- 172.21.15.86:0/2689131408 wait complete. 2024-05-12T11:11:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.098+0000 7f4c97fd5740 20 client.15747 trim_cache size 0 max 16384 2024-05-12T11:11:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:11:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:11:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:11:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:11:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 -- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4c780b2a10 msgr2=0x7f4c780b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4c780b2a10 0x7f4c780b4ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009230 tx=0x7f4c800058d0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 -- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 msgr2=0x7f4c9019daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 0x7f4c9019daf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800eb10 tx=0x7f4c8800c2d0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 -- 172.21.15.86:0/1144323788 shutdown_connections 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4c780b2a10 0x7f4c780b4ed0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c901068a0 0x7f4c9019daf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c901029e0 0x7f4c90199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 --2- 172.21.15.86:0/1144323788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c90102040 0x7f4c90199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 -- 172.21.15.86:0/1144323788 >> 172.21.15.86:0/1144323788 conn(0x7f4c90077dd0 msgr2=0x7f4c900ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 -- 172.21.15.86:0/1144323788 shutdown_connections 2024-05-12T11:11:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:11:52.099+0000 7f4c951dd640 1 -- 172.21.15.86:0/1144323788 wait complete. 2024-05-12T11:11:52.121 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-05-12T11:11:52.122 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-05-12T11:11:52.122 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-05-12T11:11:52.122 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-05-12T11:11:52.122 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-05-12T11:11:52.122 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-05-12T11:11:52.122 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-05-12T11:11:52.122 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-05-12T11:11:52.123 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-05-12T11:11:52.123 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-05-12T11:11:52.123 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-05-12T11:11:52.123 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-05-12T11:11:52.124 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-05-12T11:11:52.125 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-05-12T11:11:52.126 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-05-12T11:11:52.127 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-05-12T11:11:52.127 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-05-12T11:11:52.127 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-05-12T11:11:52.127 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-05-12T11:11:52.127 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-05-12T11:11:52.127 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-05-12T11:11:52.127 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-05-12T11:11:52.128 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-05-12T11:11:52.129 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-05-12T11:11:52.130 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-05-12T11:11:52.130 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-05-12T11:11:52.130 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-05-12T11:11:52.130 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-05-12T11:11:52.465 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-05-12T11:11:52.465 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-05-12T11:11:52.465 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-05-12T11:11:52.465 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-05-12T11:11:52.465 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-05-12T11:11:52.466 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-05-12T11:11:52.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-05-12T11:11:52.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-05-12T11:11:52.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-05-12T11:11:52.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-05-12T11:11:52.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-05-12T11:11:52.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-05-12T11:11:52.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-05-12T11:11:52.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-05-12T11:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-05-12T11:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-05-12T11:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-05-12T11:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-05-12T11:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-05-12T11:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-05-12T11:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-05-12T11:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-05-12T11:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-05-12T11:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-05-12T11:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-05-12T11:11:52.850 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-05-12T11:11:52.851 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-05-12T11:11:52.852 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-05-12T11:11:52.852 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-05-12T11:11:52.852 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-05-12T11:11:52.852 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-05-12T11:11:52.852 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-05-12T11:11:53.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:53 smithi086 ceph-mon[30110]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 751 KiB/s wr, 2.29k op/s 2024-05-12T11:11:53.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-05-12T11:11:53.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-05-12T11:11:53.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-05-12T11:11:53.467 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-05-12T11:11:53.468 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-05-12T11:11:53.469 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-05-12T11:11:53.470 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-05-12T11:11:53.471 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-05-12T11:11:53.472 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-05-12T11:11:53.473 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-05-12T11:11:53.473 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-05-12T11:11:53.473 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-05-12T11:11:53.473 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-05-12T11:11:53.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:53 smithi172 ceph-mon[34517]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 751 KiB/s wr, 2.29k op/s 2024-05-12T11:11:53.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:53 smithi176 ceph-mon[34357]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 751 KiB/s wr, 2.29k op/s 2024-05-12T11:11:54.010 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-05-12T11:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-05-12T11:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-05-12T11:11:54.013 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-05-12T11:11:54.014 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-05-12T11:11:54.015 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-05-12T11:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-05-12T11:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-05-12T11:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-05-12T11:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-05-12T11:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-05-12T11:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-05-12T11:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-05-12T11:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-05-12T11:11:54.389 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-05-12T11:11:54.390 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-05-12T11:11:54.391 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-05-12T11:11:54.392 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-05-12T11:11:54.393 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-05-12T11:11:54.394 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-05-12T11:11:54.885 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-05-12T11:11:54.886 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-05-12T11:11:54.887 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-05-12T11:11:54.888 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-05-12T11:11:54.889 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-05-12T11:11:54.890 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-05-12T11:11:54.891 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-05-12T11:11:54.891 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-05-12T11:11:54.891 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-05-12T11:11:54.891 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-05-12T11:11:54.891 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-05-12T11:11:54.891 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-05-12T11:11:54.891 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-05-12T11:11:54.891 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-05-12T11:11:55.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:55 smithi086 ceph-mon[30110]: pgmap v78: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 751 KiB/s wr, 2.29k op/s 2024-05-12T11:11:55.473 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:55 smithi172 ceph-mon[34517]: pgmap v78: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 751 KiB/s wr, 2.29k op/s 2024-05-12T11:11:55.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:55 smithi176 ceph-mon[34357]: pgmap v78: 97 pgs: 97 active+clean; 158 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 751 KiB/s wr, 2.29k op/s 2024-05-12T11:11:55.561 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-05-12T11:11:55.561 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-05-12T11:11:55.561 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-05-12T11:11:55.561 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-05-12T11:11:55.562 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-05-12T11:11:55.563 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-05-12T11:11:55.564 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-05-12T11:11:55.565 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-05-12T11:11:55.566 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-05-12T11:11:55.567 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-05-12T11:11:55.567 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-05-12T11:11:55.567 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-05-12T11:11:56.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-05-12T11:11:56.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-05-12T11:11:56.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-05-12T11:11:56.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-05-12T11:11:56.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-05-12T11:11:56.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-05-12T11:11:56.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-05-12T11:11:56.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-05-12T11:11:56.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-05-12T11:11:56.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-05-12T11:11:56.030 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-05-12T11:11:56.031 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-05-12T11:11:56.032 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-05-12T11:11:56.033 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-05-12T11:11:56.033 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-05-12T11:11:56.033 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-05-12T11:11:56.033 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-05-12T11:11:56.033 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-05-12T11:11:56.033 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-05-12T11:11:56.033 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-05-12T11:11:56.034 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-05-12T11:11:56.034 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-05-12T11:11:56.034 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-05-12T11:11:56.034 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-05-12T11:11:56.034 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-05-12T11:11:56.034 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-05-12T11:11:56.034 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-05-12T11:11:56.034 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-05-12T11:11:56.420 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-05-12T11:11:56.421 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-05-12T11:11:56.422 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-05-12T11:11:56.423 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-05-12T11:11:56.424 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-05-12T11:11:56.425 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-05-12T11:11:56.426 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-05-12T11:11:56.426 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-05-12T11:11:56.426 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-05-12T11:11:56.426 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-05-12T11:11:56.426 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-05-12T11:11:56.969 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-05-12T11:11:56.970 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-05-12T11:11:56.971 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-05-12T11:11:56.972 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-05-12T11:11:56.973 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-05-12T11:11:56.974 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-05-12T11:11:56.975 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-05-12T11:11:56.975 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-05-12T11:11:56.975 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-05-12T11:11:56.975 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-05-12T11:11:56.975 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-05-12T11:11:56.975 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-05-12T11:11:56.975 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-05-12T11:11:56.975 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-05-12T11:11:57.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:57 smithi086 ceph-mon[30110]: pgmap v79: 97 pgs: 97 active+clean; 139 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 1.4 MiB/s wr, 2.51k op/s 2024-05-12T11:11:57.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:57 smithi172 ceph-mon[34517]: pgmap v79: 97 pgs: 97 active+clean; 139 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 1.4 MiB/s wr, 2.51k op/s 2024-05-12T11:11:57.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:57 smithi176 ceph-mon[34357]: pgmap v79: 97 pgs: 97 active+clean; 139 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 1.4 MiB/s wr, 2.51k op/s 2024-05-12T11:11:57.672 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-05-12T11:11:57.672 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-05-12T11:11:57.672 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-05-12T11:11:57.672 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-05-12T11:11:57.672 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-05-12T11:11:57.672 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-05-12T11:11:57.672 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-05-12T11:11:57.673 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-05-12T11:11:57.674 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-05-12T11:11:57.675 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-05-12T11:11:57.676 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-05-12T11:11:57.677 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-05-12T11:11:57.678 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-05-12T11:11:57.678 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-05-12T11:11:57.678 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-05-12T11:11:57.678 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-05-12T11:11:57.678 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-05-12T11:11:57.678 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-05-12T11:11:58.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-05-12T11:11:58.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-05-12T11:11:58.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-05-12T11:11:58.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-05-12T11:11:58.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-05-12T11:11:58.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-05-12T11:11:58.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-05-12T11:11:58.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-05-12T11:11:58.026 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-05-12T11:11:58.027 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-05-12T11:11:58.028 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-05-12T11:11:58.029 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-05-12T11:11:58.365 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-05-12T11:11:58.366 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-05-12T11:11:58.367 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-05-12T11:11:58.368 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-05-12T11:11:58.369 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-05-12T11:11:58.370 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-05-12T11:11:58.371 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-05-12T11:11:59.001 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-05-12T11:11:59.001 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-05-12T11:11:59.001 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-05-12T11:11:59.001 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-05-12T11:11:59.002 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-05-12T11:11:59.003 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-05-12T11:11:59.004 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-05-12T11:11:59.005 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-05-12T11:11:59.006 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-05-12T11:11:59.007 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-05-12T11:11:59.007 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-05-12T11:11:59.007 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-05-12T11:11:59.007 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-05-12T11:11:59.007 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-05-12T11:11:59.007 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-05-12T11:11:59.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:11:59 smithi086 ceph-mon[30110]: pgmap v80: 97 pgs: 97 active+clean; 139 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 1.4 MiB/s wr, 1.07k op/s 2024-05-12T11:11:59.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:11:59 smithi172 ceph-mon[34517]: pgmap v80: 97 pgs: 97 active+clean; 139 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 1.4 MiB/s wr, 1.07k op/s 2024-05-12T11:11:59.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:11:59 smithi176 ceph-mon[34357]: pgmap v80: 97 pgs: 97 active+clean; 139 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 1.4 MiB/s wr, 1.07k op/s 2024-05-12T11:11:59.657 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-05-12T11:11:59.657 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-05-12T11:11:59.657 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-05-12T11:11:59.657 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-05-12T11:11:59.657 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-05-12T11:11:59.657 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-05-12T11:11:59.657 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-05-12T11:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-05-12T11:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-05-12T11:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-05-12T11:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-05-12T11:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-05-12T11:11:59.663 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-05-12T11:12:00.016 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-05-12T11:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-05-12T11:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-05-12T11:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-05-12T11:12:00.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-05-12T11:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-05-12T11:12:00.442 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-05-12T11:12:00.442 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-05-12T11:12:00.443 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-05-12T11:12:00.444 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-05-12T11:12:00.445 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-05-12T11:12:00.446 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-05-12T11:12:00.447 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-05-12T11:12:00.448 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-05-12T11:12:01.095 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-05-12T11:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-05-12T11:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-05-12T11:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-05-12T11:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-05-12T11:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-05-12T11:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-05-12T11:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-05-12T11:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-05-12T11:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-05-12T11:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-05-12T11:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-05-12T11:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-05-12T11:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-05-12T11:12:01.463 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:01 smithi086 ceph-mon[30110]: pgmap v81: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 2.0 MiB/s wr, 1.28k op/s 2024-05-12T11:12:01.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:01 smithi172 ceph-mon[34517]: pgmap v81: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 2.0 MiB/s wr, 1.28k op/s 2024-05-12T11:12:01.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:01 smithi176 ceph-mon[34357]: pgmap v81: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 2.0 MiB/s wr, 1.28k op/s 2024-05-12T11:12:01.642 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-05-12T11:12:01.642 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-05-12T11:12:01.642 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-05-12T11:12:01.643 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-05-12T11:12:01.644 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-05-12T11:12:01.645 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-05-12T11:12:01.646 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-05-12T11:12:01.647 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-05-12T11:12:01.648 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-05-12T11:12:01.648 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-05-12T11:12:01.648 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-05-12T11:12:01.648 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-05-12T11:12:01.648 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-05-12T11:12:01.648 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-05-12T11:12:01.648 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-05-12T11:12:01.648 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-05-12T11:12:02.020 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-05-12T11:12:02.021 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-05-12T11:12:02.022 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-05-12T11:12:02.023 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-05-12T11:12:02.024 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-05-12T11:12:02.025 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-05-12T11:12:02.538 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-05-12T11:12:02.539 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-05-12T11:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-05-12T11:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-05-12T11:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-05-12T11:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-05-12T11:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-05-12T11:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-05-12T11:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-05-12T11:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-05-12T11:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-05-12T11:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-05-12T11:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-05-12T11:12:03.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:03 smithi172 ceph-mon[34517]: pgmap v82: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 426 op/s 2024-05-12T11:12:03.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:03 smithi176 ceph-mon[34357]: pgmap v82: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 426 op/s 2024-05-12T11:12:03.685 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-05-12T11:12:03.685 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-05-12T11:12:03.685 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-05-12T11:12:03.685 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-05-12T11:12:03.685 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-05-12T11:12:03.685 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-05-12T11:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-05-12T11:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-05-12T11:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-05-12T11:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-05-12T11:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-05-12T11:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-05-12T11:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-05-12T11:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-05-12T11:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-05-12T11:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-05-12T11:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-05-12T11:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-05-12T11:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-05-12T11:12:03.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:03 smithi086 ceph-mon[30110]: pgmap v82: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 426 op/s 2024-05-12T11:12:04.070 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-05-12T11:12:04.070 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-05-12T11:12:04.070 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-05-12T11:12:04.070 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-05-12T11:12:04.071 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-05-12T11:12:04.072 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-05-12T11:12:04.073 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-05-12T11:12:04.074 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-05-12T11:12:04.075 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-05-12T11:12:04.075 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-05-12T11:12:04.075 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-05-12T11:12:04.075 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-05-12T11:12:04.075 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-05-12T11:12:04.075 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-05-12T11:12:04.075 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-05-12T11:12:04.076 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-05-12T11:12:04.077 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-05-12T11:12:04.137 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-05-12T11:12:04.138 INFO:tasks.workunit.client.0.smithi086.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-05-12T11:12:04.139 INFO:tasks.workunit.client.0.smithi086.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-05-12T11:12:04.139 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T11:12:04.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T11:12:04.167 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-05-12T11:12:04.167 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-12T11:12:04.448 DEBUG:teuthology.parallel:result is None 2024-05-12T11:12:04.449 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-12T11:12:04.480 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-12T11:12:04.481 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-12T11:12:04.492 INFO:tasks.quiescer:joining Quiescers 2024-05-12T11:12:04.492 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-12T11:12:04.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:12:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:12:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 -- 172.21.15.86:0/2278477347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd40103360 msgr2=0x7fdd4010f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 --2- 172.21.15.86:0/2278477347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd40103360 0x7fdd4010f870 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009cd0 tx=0x7fdd3802a8e0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 -- 172.21.15.86:0/2278477347 shutdown_connections 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 --2- 172.21.15.86:0/2278477347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd40103360 0x7fdd4010f870 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 --2- 172.21.15.86:0/2278477347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd401029a0 0x7fdd40102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 --2- 172.21.15.86:0/2278477347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd401089b0 0x7fdd40108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 -- 172.21.15.86:0/2278477347 >> 172.21.15.86:0/2278477347 conn(0x7fdd400fe470 msgr2=0x7fdd40100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 -- 172.21.15.86:0/2278477347 shutdown_connections 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.188+0000 7fdd47d24640 1 -- 172.21.15.86:0/2278477347 wait complete. 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd47d24640 1 Processor -- start 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd47d24640 1 -- start start 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd47d24640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd401029a0 0x7fdd40199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd47d24640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd40103360 0x7fdd40199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd47d24640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd401089b0 0x7fdd4019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd47d24640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdd40112c70 con 0x7fdd401089b0 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd47d24640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd40112af0 con 0x7fdd40103360 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd47d24640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd40112df0 con 0x7fdd401029a0 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd462c1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd401089b0 0x7fdd4019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd462c1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd401089b0 0x7fdd4019d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39624/0 (socket says 172.21.15.86:39624) 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd462c1640 1 -- 172.21.15.86:0/1250610695 learned_addr learned my addr 172.21.15.86:0/1250610695 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd45ac0640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd401029a0 0x7fdd40199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd40103360 0x7fdd40199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd462c1640 1 -- 172.21.15.86:0/1250610695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd401029a0 msgr2=0x7fdd40199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd462c1640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd401029a0 0x7fdd40199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd462c1640 1 -- 172.21.15.86:0/1250610695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd40103360 msgr2=0x7fdd40199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.189+0000 7fdd462c1640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd40103360 0x7fdd40199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.190+0000 7fdd462c1640 1 -- 172.21.15.86:0/1250610695 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4019e100 con 0x7fdd401089b0 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.190+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd40103360 0x7fdd40199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:12:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.190+0000 7fdd462c1640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd401089b0 0x7fdd4019d9d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdd38005cc0 tx=0x7fdd38003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.190+0000 7fdd36ffd640 1 -- 172.21.15.86:0/1250610695 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38004450 con 0x7fdd401089b0 2024-05-12T11:12:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.190+0000 7fdd36ffd640 1 -- 172.21.15.86:0/1250610695 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd38031c90 con 0x7fdd401089b0 2024-05-12T11:12:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.190+0000 7fdd47d24640 1 -- 172.21.15.86:0/1250610695 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4019e390 con 0x7fdd401089b0 2024-05-12T11:12:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.190+0000 7fdd36ffd640 1 -- 172.21.15.86:0/1250610695 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3803b400 con 0x7fdd401089b0 2024-05-12T11:12:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.190+0000 7fdd47d24640 1 -- 172.21.15.86:0/1250610695 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd401a5c80 con 0x7fdd401089b0 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.192+0000 7fdd36ffd640 1 -- 172.21.15.86:0/1250610695 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fdd38004680 con 0x7fdd401089b0 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd4aa41740 1 Processor -- start 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd4aa41740 1 -- start start 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 0x5577bfb6fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb700f0 0x5577bfb724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5577bfaca5d0 con 0x5577bfb64f10 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5577bfa83890 con 0x5577bfb65830 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5577bfac6590 con 0x5577bfb700f0 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd452bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd452bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb652f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39628/0 (socket says 172.21.15.86:39628) 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd452bf640 1 -- 172.21.15.86:0/1632623223 learned_addr learned my addr 172.21.15.86:0/1632623223 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd45ac0640 1 --2- 172.21.15.86:0/1632623223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 0x5577bfb6fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd36ffd640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fdd2c0b2a10 0x7fdd2c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd452bf640 1 -- 172.21.15.86:0/1632623223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb700f0 msgr2=0x5577bfb724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1632623223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb700f0 0x5577bfb724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd452bf640 1 -- 172.21.15.86:0/1632623223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 msgr2=0x5577bfb6fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1632623223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 0x5577bfb6fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.193+0000 7fdd452bf640 1 -- 172.21.15.86:0/1632623223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577bf7dc210 con 0x5577bfb64f10 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.194+0000 7fdd462c1640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fdd2c0b2a10 0x7fdd2c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.194+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1632623223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb652f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdd30005d00 tx=0x7fdd300106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d3854a0e5ab089 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.194+0000 7fdd36ffd640 1 -- 172.21.15.86:0/1250610695 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fdd3802e030 con 0x7fdd401089b0 2024-05-12T11:12:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.194+0000 7fdd2bfff640 1 -- 172.21.15.86:0/1632623223 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30016070 con 0x5577bfb64f10 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.194+0000 7fdd2bfff640 1 -- 172.21.15.86:0/1632623223 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd300128d0 con 0x5577bfb64f10 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.194+0000 7fdd2bfff640 1 -- 172.21.15.86:0/1632623223 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300116e0 con 0x5577bfb64f10 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1632623223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 msgr2=0x5577bfb652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd462c1640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fdd2c0b2a10 0x7fdd2c0b4ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd38101410 tx=0x7fdd380973e0 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1632623223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb652f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdd30005d00 tx=0x7fdd300106e0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1632623223 shutdown_connections 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1632623223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb700f0 0x5577bfb724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1632623223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 0x5577bfb6fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1632623223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb652f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1632623223 >> 172.21.15.86:0/1632623223 conn(0x5577bfb61420 msgr2=0x5577bfb61800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1632623223 shutdown_connections 2024-05-12T11:12:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1632623223 wait complete. 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 -- start start 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.195+0000 7fdd4aa41740 1 Processor -- start 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 0x5577bfb6d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb700f0 0x5577bfb6dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5577bfb72d20 con 0x5577bfb64f10 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5577bfa87370 con 0x5577bfb700f0 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5577bfb72ea0 con 0x5577bfb65830 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd4aa41740 10 client.0 _ll_register_callbacks cb 0x5577bf7dba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39642/0 (socket says 172.21.15.86:39642) 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 -- 172.21.15.86:0/4137767073 learned_addr learned my addr 172.21.15.86:0/4137767073 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd45ac0640 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 0x5577bfb6d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 -- 172.21.15.86:0/4137767073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 msgr2=0x5577bfb6d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 0x5577bfb6d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 -- 172.21.15.86:0/4137767073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb700f0 msgr2=0x5577bfb6dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb700f0 0x5577bfb6dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 -- 172.21.15.86:0/4137767073 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577bf8a8620 con 0x5577bfb64f10 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd452bf640 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d030 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009ad0 tx=0x7fdd30009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe79e95df1d5afc server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd297fa640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd297fa640 1 -- 172.21.15.86:0/4137767073 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30016070 con 0x5577bfb64f10 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd297fa640 1 -- 172.21.15.86:0/4137767073 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fdd30012c80 con 0x5577bfb64f10 2024-05-12T11:12:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.196+0000 7fdd4aa41740 1 -- 172.21.15.86:0/4137767073 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd300128d0 con 0x5577bfb64f10 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd297fa640 1 -- 172.21.15.86:0/4137767073 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd30005040 con 0x5577bfb64f10 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd4aa41740 10 client.15759 fetch_fsmap learned FSMap version 29 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd4aa41740 1 -- 172.21.15.86:0/4137767073 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577bfb7ebe0 con 0x5577bfb64f10 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd297fa640 1 -- 172.21.15.86:0/4137767073 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd300128d0 con 0x5577bfb64f10 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd297fa640 1 -- 172.21.15.86:0/4137767073 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fdd30031480 con 0x5577bfb64f10 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd4aa41740 10 client.15759 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd4aa41740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd4aa41740 20 client.15759 populate_metadata read hostname 'smithi086' 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5577bfb80050 0x5577bfb82440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd4aa41740 4 client.15759 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd4aa41740 1 -- 172.21.15.86:0/4137767073 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577bfad81e0 con 0x5577bfb80050 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.197+0000 7fdd45ac0640 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5577bfb80050 0x5577bfb82440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.198+0000 7fdd45ac0640 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5577bfb80050 0x5577bfb82440 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1d075a512793adf server_cookie=8a1047203d1c4869 in_seq=0 out_seq=0 2024-05-12T11:12:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.198+0000 7fdd297fa640 10 client.15759 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.198+0000 7fdd297fa640 1 -- 172.21.15.86:0/4137767073 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5577bfad81e0 con 0x5577bfb80050 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.198+0000 7fdd297fa640 10 client.15759 handle_command_reply: tid=0 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.198+0000 7fdd4aa41740 1 client.15759 shutdown 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 -- 172.21.15.86:0/4137767073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 msgr2=0x5577bfb6d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d030 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009ad0 tx=0x7fdd30009430 comp rx=0 tx=0).stop 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 -- 172.21.15.86:0/4137767073 shutdown_connections 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5577bfb80050 0x5577bfb82440 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb700f0 0x5577bfb6dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 0x5577bfb6d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/4137767073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d030 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd297fa640 0 client.15759 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 -- 172.21.15.86:0/4137767073 >> 172.21.15.86:0/4137767073 conn(0x5577bfb61420 msgr2=0x5577bfb671a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 -- 172.21.15.86:0/4137767073 shutdown_connections 2024-05-12T11:12:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 1 -- 172.21.15.86:0/4137767073 wait complete. 2024-05-12T11:12:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.199+0000 7fdd4aa41740 20 client.15759 trim_cache size 0 max 16384 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd4aa41740 1 Processor -- start 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd4aa41740 1 -- start start 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 0x5577bfb87a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb700f0 0x5577bfb87f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdd401ae530 con 0x5577bfb64f10 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd401b0070 con 0x5577bfb65830 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd401aec00 con 0x5577bfb700f0 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39658/0 (socket says 172.21.15.86:39658) 2024-05-12T11:12:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 -- 172.21.15.86:0/2255944525 learned_addr learned my addr 172.21.15.86:0/2255944525 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 -- 172.21.15.86:0/2255944525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb700f0 msgr2=0x5577bfb87f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 --2- 172.21.15.86:0/2255944525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb700f0 0x5577bfb87f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 -- 172.21.15.86:0/2255944525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 msgr2=0x5577bfb87a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 --2- 172.21.15.86:0/2255944525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 0x5577bfb87a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 -- 172.21.15.86:0/2255944525 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577bfb827b0 con 0x5577bfb64f10 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.214+0000 7fdd452bf640 1 --2- 172.21.15.86:0/2255944525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d8d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009310 tx=0x7fdd30009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20232285c4d2ef5a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd2b7fe640 1 -- 172.21.15.86:0/2255944525 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30016070 con 0x5577bfb64f10 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd2b7fe640 1 -- 172.21.15.86:0/2255944525 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd30036020 con 0x5577bfb64f10 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd2b7fe640 1 -- 172.21.15.86:0/2255944525 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300127b0 con 0x5577bfb64f10 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 -- 172.21.15.86:0/2255944525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 msgr2=0x5577bfb6d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/2255944525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d8d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009310 tx=0x7fdd30009530 comp rx=0 tx=0).stop 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 -- 172.21.15.86:0/2255944525 shutdown_connections 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/2255944525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb700f0 0x5577bfb87f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/2255944525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb65830 0x5577bfb87a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/2255944525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb64f10 0x5577bfb6d8d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 -- 172.21.15.86:0/2255944525 >> 172.21.15.86:0/2255944525 conn(0x5577bfb61420 msgr2=0x5577bfb6f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 -- 172.21.15.86:0/2255944525 shutdown_connections 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 -- 172.21.15.86:0/2255944525 wait complete. 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.215+0000 7fdd4aa41740 1 -- start start 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd4aa41740 1 Processor -- start 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb64f10 0x5577bfb6a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 0x5577bfb6ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd4aa41740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb700f0 0x5577bfb69480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdd401af9a0 con 0x5577bfb700f0 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd401af2d0 con 0x5577bfb64f10 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd4aa41740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd401ac510 con 0x5577bfb65830 2024-05-12T11:12:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd4aa41740 10 client.0 _ll_register_callbacks cb 0x7fdd3c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb700f0 0x5577bfb69480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb700f0 0x5577bfb69480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39674/0 (socket says 172.21.15.86:39674) 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 -- 172.21.15.86:0/1952814349 learned_addr learned my addr 172.21.15.86:0/1952814349 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb64f10 0x5577bfb6a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd45ac0640 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 0x5577bfb6ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 -- 172.21.15.86:0/1952814349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 msgr2=0x5577bfb6ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 0x5577bfb6ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 -- 172.21.15.86:0/1952814349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb64f10 msgr2=0x5577bfb6a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb64f10 0x5577bfb6a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 -- 172.21.15.86:0/1952814349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577bfb69cb0 con 0x5577bfb700f0 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd452bf640 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb700f0 0x5577bfb69480 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdd300092e0 tx=0x7fdd30010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c634987d353f66ee server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.216+0000 7fdd297fa640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:12:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd297fa640 1 -- 172.21.15.86:0/1952814349 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30016070 con 0x5577bfb700f0 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd297fa640 1 -- 172.21.15.86:0/1952814349 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fdd300127b0 con 0x5577bfb700f0 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1952814349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd30036020 con 0x5577bfb700f0 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd297fa640 1 -- 172.21.15.86:0/1952814349 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd30031bf0 con 0x5577bfb700f0 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 10 client.15765 fetch_fsmap learned FSMap version 29 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1952814349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577bfbef210 con 0x5577bfb700f0 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd297fa640 1 -- 172.21.15.86:0/1952814349 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd30036020 con 0x5577bfb700f0 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd297fa640 1 -- 172.21.15.86:0/1952814349 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fdd30004920 con 0x5577bfb700f0 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 10 client.15765 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 20 client.15765 populate_metadata read hostname 'smithi086' 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5577bfbef7d0 0x5577bfbf1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 4 client.15765 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1952814349 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5577bfad2050 con 0x5577bfbef7d0 2024-05-12T11:12:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.217+0000 7fdd45ac0640 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5577bfbef7d0 0x5577bfbf1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.218+0000 7fdd45ac0640 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5577bfbef7d0 0x5577bfbf1bf0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b2259b4ec08b2 server_cookie=ca4afa21d7af13d2 in_seq=0 out_seq=0 2024-05-12T11:12:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.218+0000 7fdd297fa640 10 client.15765 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:12:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd297fa640 1 -- 172.21.15.86:0/1952814349 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5577bfad2050 con 0x5577bfbef7d0 2024-05-12T11:12:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd297fa640 10 client.15765 handle_command_reply: tid=0 2024-05-12T11:12:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 client.15765 shutdown 2024-05-12T11:12:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1952814349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb700f0 msgr2=0x5577bfb69480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb700f0 0x5577bfb69480 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdd300092e0 tx=0x7fdd30010f60 comp rx=0 tx=0).stop 2024-05-12T11:12:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1952814349 shutdown_connections 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x5577bfbef7d0 0x5577bfbf1bf0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577bfb700f0 0x5577bfb69480 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577bfb65830 0x5577bfb6ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 --2- 172.21.15.86:0/1952814349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577bfb64f10 0x5577bfb6a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd297fa640 0 client.15765 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1952814349 >> 172.21.15.86:0/1952814349 conn(0x5577bfb61420 msgr2=0x5577bfb5fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1952814349 shutdown_connections 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 1 -- 172.21.15.86:0/1952814349 wait complete. 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd4aa41740 20 client.15765 trim_cache size 0 max 16384 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-05-12T11:12:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-05-12T11:12:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-05-12T11:12:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-05-12T11:12:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 -- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fdd2c0b2a10 msgr2=0x7fdd2c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fdd2c0b2a10 0x7fdd2c0b4ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd38101410 tx=0x7fdd380973e0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 -- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd401089b0 msgr2=0x7fdd4019d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd401089b0 0x7fdd4019d9d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdd38005cc0 tx=0x7fdd38003c20 comp rx=0 tx=0).stop 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 -- 172.21.15.86:0/1250610695 shutdown_connections 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fdd2c0b2a10 0x7fdd2c0b4ed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd401089b0 0x7fdd4019d9d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd40103360 0x7fdd40199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 --2- 172.21.15.86:0/1250610695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd401029a0 0x7fdd40199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 -- 172.21.15.86:0/1250610695 >> 172.21.15.86:0/1250610695 conn(0x7fdd400fe470 msgr2=0x7fdd400feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 -- 172.21.15.86:0/1250610695 shutdown_connections 2024-05-12T11:12:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-05-12T11:12:05.265+0000 7fdd47d24640 1 -- 172.21.15.86:0/1250610695 wait complete. 2024-05-12T11:12:05.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:05 smithi172 ceph-mon[34517]: pgmap v83: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 426 op/s 2024-05-12T11:12:05.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:05 smithi176 ceph-mon[34357]: pgmap v83: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 426 op/s 2024-05-12T11:12:05.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:05 smithi086 ceph-mon[30110]: pgmap v83: 97 pgs: 97 active+clean; 87 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 426 op/s 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 -- 172.21.15.86:0/2271703847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 msgr2=0x7f07c0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 --2- 172.21.15.86:0/2271703847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 0x7f07c0110330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f07b800b0a0 tx=0x7f07b800b3b0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 -- 172.21.15.86:0/2271703847 shutdown_connections 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 --2- 172.21.15.86:0/2271703847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 0x7f07c0110330 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 --2- 172.21.15.86:0/2271703847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c0109530 0x7f07c0109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 --2- 172.21.15.86:0/2271703847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c006bbd0 0x7f07c006c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 -- 172.21.15.86:0/2271703847 >> 172.21.15.86:0/2271703847 conn(0x7f07c0079340 msgr2=0x7f07c0079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 -- 172.21.15.86:0/2271703847 shutdown_connections 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.699+0000 7f07c8134700 1 -- 172.21.15.86:0/2271703847 wait complete. 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c8134700 1 Processor -- start 2024-05-12T11:12:06.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c8134700 1 -- start start 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c8134700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c006bbd0 0x7f07c01024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c8134700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 0x7f07c01029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c8134700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c0109530 0x7f07c0102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c8134700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f07c0113710 con 0x7f07c006c590 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c8134700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07c0113590 con 0x7f07c0109530 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c8134700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f07c0113890 con 0x7f07c006bbd0 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.700+0000 7f07c56cf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 0x7f07c01029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c5ed0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c006bbd0 0x7f07c01024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c56cf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 0x7f07c01029e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39698/0 (socket says 172.21.15.86:39698) 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c56cf700 1 -- 172.21.15.86:0/3576971081 learned_addr learned my addr 172.21.15.86:0/3576971081 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c66d1700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c0109530 0x7f07c0102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c56cf700 1 -- 172.21.15.86:0/3576971081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c006bbd0 msgr2=0x7f07c01024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c56cf700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c006bbd0 0x7f07c01024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c56cf700 1 -- 172.21.15.86:0/3576971081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c0109530 msgr2=0x7f07c0102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c56cf700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c0109530 0x7f07c0102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c56cf700 1 -- 172.21.15.86:0/3576971081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c01a81d0 con 0x7f07c006c590 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c5ed0700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c006bbd0 0x7f07c01024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c66d1700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c0109530 0x7f07c0102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07c56cf700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 0x7f07c01029e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00b530 tx=0x7f07bc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.701+0000 7f07b6ffd700 1 -- 172.21.15.86:0/3576971081 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc015020 con 0x7f07c006c590 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.702+0000 7f07b6ffd700 1 -- 172.21.15.86:0/3576971081 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07bc011ce0 con 0x7f07c006c590 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.702+0000 7f07b6ffd700 1 -- 172.21.15.86:0/3576971081 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc010dd0 con 0x7f07c006c590 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.702+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c01a84c0 con 0x7f07c006c590 2024-05-12T11:12:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.702+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c01a89b0 con 0x7f07c006c590 2024-05-12T11:12:06.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.703+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c0104bd0 con 0x7f07c006c590 2024-05-12T11:12:06.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.704+0000 7f07b6ffd700 1 -- 172.21.15.86:0/3576971081 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f07bc018020 con 0x7f07c006c590 2024-05-12T11:12:06.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.705+0000 7f07b6ffd700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f07ac0b2a70 0x7f07ac0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:06.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.705+0000 7f07c5ed0700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f07ac0b2a70 0x7f07ac0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:06.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.705+0000 7f07b6ffd700 1 -- 172.21.15.86:0/3576971081 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f07bc0e2150 con 0x7f07c006c590 2024-05-12T11:12:06.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.706+0000 7f07c5ed0700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f07ac0b2a70 0x7f07ac0b4f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009de0 tx=0x7f07b0009190 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:06.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.709+0000 7f07b6ffd700 1 -- 172.21.15.86:0/3576971081 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f07bc01f020 con 0x7f07c006c590 2024-05-12T11:12:06.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.956+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07c002e510 con 0x7f07c006c590 2024-05-12T11:12:06.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.956+0000 7f07b6ffd700 1 -- 172.21.15.86:0/3576971081 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7f07bc0a9be0 con 0x7f07c006c590 2024-05-12T11:12:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:12:06.950 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:12:06.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f07ac0b2a70 msgr2=0x7f07ac0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:06.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f07ac0b2a70 0x7f07ac0b4f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009de0 tx=0x7f07b0009190 comp rx=0 tx=0).stop 2024-05-12T11:12:06.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 msgr2=0x7f07c01029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:06.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 0x7f07c01029e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00b530 tx=0x7f07bc00b840 comp rx=0 tx=0).stop 2024-05-12T11:12:06.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 shutdown_connections 2024-05-12T11:12:06.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c0109530 0x7f07c0102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c006bbd0 0x7f07c01024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f07ac0b2a70 0x7f07ac0b4f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 --2- 172.21.15.86:0/3576971081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006c590 0x7f07c01029e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:06.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 >> 172.21.15.86:0/3576971081 conn(0x7f07c0079340 msgr2=0x7f07c01011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:06.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 shutdown_connections 2024-05-12T11:12:06.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:06.959+0000 7f07c8134700 1 -- 172.21.15.86:0/3576971081 wait complete. 2024-05-12T11:12:06.953 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:12:07.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:07 smithi172 ceph-mon[34517]: pgmap v84: 97 pgs: 97 active+clean; 184 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 175 MiB/s rd, 1.9 MiB/s wr, 618 op/s 2024-05-12T11:12:07.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:07 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3576971081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:12:07.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:07 smithi176 ceph-mon[34357]: pgmap v84: 97 pgs: 97 active+clean; 184 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 175 MiB/s rd, 1.9 MiB/s wr, 618 op/s 2024-05-12T11:12:07.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:07 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3576971081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:12:07.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:07 smithi086 ceph-mon[30110]: pgmap v84: 97 pgs: 97 active+clean; 184 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 175 MiB/s rd, 1.9 MiB/s wr, 618 op/s 2024-05-12T11:12:07.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:07 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3576971081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:12:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --cancel --all' 2024-05-12T11:12:07.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24466 quiesce db --cancel --all 2024-05-12T11:12:08.044 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:12:09.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:09 smithi172 ceph-mon[34517]: pgmap v85: 97 pgs: 97 active+clean; 184 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 MiB/s wr, 401 op/s 2024-05-12T11:12:09.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:09 smithi176 ceph-mon[34357]: pgmap v85: 97 pgs: 97 active+clean; 184 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 MiB/s wr, 401 op/s 2024-05-12T11:12:09.690 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:09 smithi086 ceph-mon[30110]: pgmap v85: 97 pgs: 97 active+clean; 184 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 MiB/s wr, 401 op/s 2024-05-12T11:12:10.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 -- 172.21.15.86:0/3353682445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8102b40 msgr2=0x7f82c8102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 --2- 172.21.15.86:0/3353682445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8102b40 0x7f82c8102fc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009990 tx=0x7f82b4009ca0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 -- 172.21.15.86:0/3353682445 shutdown_connections 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 --2- 172.21.15.86:0/3353682445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c8103500 0x7f82c810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 --2- 172.21.15.86:0/3353682445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c8107390 0x7f82c8107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 --2- 172.21.15.86:0/3353682445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8102b40 0x7f82c8102fc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 -- 172.21.15.86:0/3353682445 >> 172.21.15.86:0/3353682445 conn(0x7f82c80789a0 msgr2=0x7f82c80ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 -- 172.21.15.86:0/3353682445 shutdown_connections 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.078+0000 7f82cf108700 1 -- 172.21.15.86:0/3353682445 wait complete. 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cf108700 1 Processor -- start 2024-05-12T11:12:10.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cf108700 1 -- start start 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cf108700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c8102b40 0x7f82c819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cf108700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c8103500 0x7f82c819ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cf108700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8107390 0x7f82c8199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cf108700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81126c0 con 0x7f82c8107390 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cf108700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82c8112540 con 0x7f82c8103500 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cf108700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82c8112840 con 0x7f82c8102b40 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cd6a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8107390 0x7f82c8199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cd6a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8107390 0x7f82c8199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39708/0 (socket says 172.21.15.86:39708) 2024-05-12T11:12:10.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82cd6a5700 1 -- 172.21.15.86:0/798070460 learned_addr learned my addr 172.21.15.86:0/798070460 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82ccea4700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c8102b40 0x7f82c819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.079+0000 7f82c7fff700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c8103500 0x7f82c819ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82cd6a5700 1 -- 172.21.15.86:0/798070460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c8102b40 msgr2=0x7f82c819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c8102b40 0x7f82c819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82cd6a5700 1 -- 172.21.15.86:0/798070460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c8103500 msgr2=0x7f82c819ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c8103500 0x7f82c819ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82cd6a5700 1 -- 172.21.15.86:0/798070460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c819a2f0 con 0x7f82c8107390 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8107390 0x7f82c8199b50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f82c0007ee0 tx=0x7f82c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82c5ffb700 1 -- 172.21.15.86:0/798070460 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0004bb0 con 0x7f82c8107390 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82cf108700 1 -- 172.21.15.86:0/798070460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c819a5e0 con 0x7f82c8107390 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82c5ffb700 1 -- 172.21.15.86:0/798070460 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c0004d50 con 0x7f82c8107390 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82c5ffb700 1 -- 172.21.15.86:0/798070460 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0005920 con 0x7f82c8107390 2024-05-12T11:12:10.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.080+0000 7f82cf108700 1 -- 172.21.15.86:0/798070460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c80fdd10 con 0x7f82c8107390 2024-05-12T11:12:10.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.083+0000 7f82c5ffb700 1 -- 172.21.15.86:0/798070460 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f82c001a020 con 0x7f82c8107390 2024-05-12T11:12:10.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.084+0000 7f82c5ffb700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f82b80b6e00 0x7f82b80b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.084+0000 7f82ccea4700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f82b80b6e00 0x7f82b80b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.084+0000 7f82c5ffb700 1 -- 172.21.15.86:0/798070460 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f82c00e1c70 con 0x7f82c8107390 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.084+0000 7f82d999bb80 1 Processor -- start 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.084+0000 7f82ccea4700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f82b80b6e00 0x7f82b80b92c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009a10 tx=0x7f82bc009190 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.084+0000 7f82d999bb80 1 -- start start 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e15f10 0x55c9c6e162f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 0x55c9c6e11710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e12190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82d999bb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c9c6d638d0 con 0x55c9c6e15f10 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82d999bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c9c6d02830 con 0x55c9c6e11d30 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82d999bb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c9c6d5f890 con 0x55c9c6e16830 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e15f10 0x55c9c6e162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e15f10 0x55c9c6e162f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39724/0 (socket says 172.21.15.86:39724) 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 -- 172.21.15.86:0/1312037136 learned_addr learned my addr 172.21.15.86:0/1312037136 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82c7fff700 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 0x55c9c6e11710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e12190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 -- 172.21.15.86:0/1312037136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 msgr2=0x55c9c6e11710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 0x55c9c6e11710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 -- 172.21.15.86:0/1312037136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 msgr2=0x55c9c6e12190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e12190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 -- 172.21.15.86:0/1312037136 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c6cb0940 con 0x55c9c6e15f10 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82ccea4700 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e15f10 0x55c9c6e162f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00ea00 tx=0x7f82bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc93bd409cc2ce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82b2ffd700 1 -- 172.21.15.86:0/1312037136 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc01b040 con 0x55c9c6e15f10 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82b2ffd700 1 -- 172.21.15.86:0/1312037136 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82bc024070 con 0x55c9c6e15f10 2024-05-12T11:12:10.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.085+0000 7f82b2ffd700 1 -- 172.21.15.86:0/1312037136 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc013760 con 0x55c9c6e15f10 2024-05-12T11:12:10.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 -- 172.21.15.86:0/1312037136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e15f10 msgr2=0x55c9c6e162f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e15f10 0x55c9c6e162f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00ea00 tx=0x7f82bc011000 comp rx=0 tx=0).stop 2024-05-12T11:12:10.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 -- 172.21.15.86:0/1312037136 shutdown_connections 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e12190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e15f10 0x55c9c6e162f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 --2- 172.21.15.86:0/1312037136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 0x55c9c6e11710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 -- 172.21.15.86:0/1312037136 >> 172.21.15.86:0/1312037136 conn(0x55c9c6d3d170 msgr2=0x55c9c6e0bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 -- 172.21.15.86:0/1312037136 shutdown_connections 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.086+0000 7f82d999bb80 1 -- 172.21.15.86:0/1312037136 wait complete. 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 1 -- start start 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 1 Processor -- start 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e1ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c9c6e1e400 con 0x55c9c6e16830 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c9c6cc9ca0 con 0x55c9c6e11d30 2024-05-12T11:12:10.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c9c6e1e580 con 0x55c9c6e15f10 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82d999bb80 10 client.0 _ll_register_callbacks cb 0x55c9c6cfb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82cd6a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e1ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82cd6a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e1ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39730/0 (socket says 172.21.15.86:39730) 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82cd6a5700 1 -- 172.21.15.86:0/2268299877 learned_addr learned my addr 172.21.15.86:0/2268299877 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82ccea4700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.087+0000 7f82c7fff700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82cd6a5700 1 -- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e15f10 msgr2=0x55c9c6e1a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82cd6a5700 1 -- 172.21.15.86:0/2268299877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 msgr2=0x55c9c6e1d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82cd6a5700 1 -- 172.21.15.86:0/2268299877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c6cff700 con 0x55c9c6e16830 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82ccea4700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82c7fff700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:12:10.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e1ae70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f82c00df420 tx=0x7f82c00a8790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e727ce3e3022d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82a7fff700 1 -- 172.21.15.86:0/2268299877 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c00a9650 con 0x55c9c6e16830 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82a7fff700 1 -- 172.21.15.86:0/2268299877 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f82c00a93c0 con 0x55c9c6e16830 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82d999bb80 1 -- 172.21.15.86:0/2268299877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82bc024070 con 0x55c9c6e16830 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82a7fff700 1 -- 172.21.15.86:0/2268299877 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f82c00a8f50 con 0x55c9c6e16830 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82d999bb80 10 client.15783 fetch_fsmap learned FSMap version 29 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82d999bb80 1 -- 172.21.15.86:0/2268299877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c9c6e28bc0 con 0x55c9c6e16830 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82a7fff700 1 -- 172.21.15.86:0/2268299877 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82bc024070 con 0x55c9c6e16830 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82a7fff700 1 -- 172.21.15.86:0/2268299877 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f82c00a8240 con 0x55c9c6e16830 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82d999bb80 10 client.15783 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82d999bb80 10 client.15783 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82d999bb80 20 client.15783 populate_metadata read hostname 'smithi086' 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.088+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55c9c6e2b200 0x55c9c6e2d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.089+0000 7f82d999bb80 4 client.15783 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.089+0000 7f82d999bb80 1 -- 172.21.15.86:0/2268299877 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9c6ddd6c0 con 0x55c9c6e2b200 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.089+0000 7f82ccea4700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55c9c6e2b200 0x55c9c6e2d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.089+0000 7f82a7fff700 10 client.15783 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.089+0000 7f82ccea4700 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55c9c6e2b200 0x55c9c6e2d5f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dae99e185371ad9f server_cookie=645bc3077754e5db in_seq=0 out_seq=0 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82a7fff700 1 -- 172.21.15.86:0/2268299877 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c9c6ddd6c0 con 0x55c9c6e2b200 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82a7fff700 10 client.15783 handle_command_reply: tid=0 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 client.15783 shutdown 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 -- 172.21.15.86:0/2268299877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 msgr2=0x55c9c6e1ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e1ae70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f82c00df420 tx=0x7f82c00a8790 comp rx=0 tx=0).stop 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 -- 172.21.15.86:0/2268299877 shutdown_connections 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55c9c6e2b200 0x55c9c6e2d5f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e1ae70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2268299877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82a7fff700 0 client.15783 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:12:10.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 -- 172.21.15.86:0/2268299877 >> 172.21.15.86:0/2268299877 conn(0x55c9c6d3d170 msgr2=0x55c9c6e0ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:10.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 -- 172.21.15.86:0/2268299877 shutdown_connections 2024-05-12T11:12:10.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 1 -- 172.21.15.86:0/2268299877 wait complete. 2024-05-12T11:12:10.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.090+0000 7f82d999bb80 20 client.15783 trim_cache size 0 max 16384 2024-05-12T11:12:10.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82d999bb80 1 Processor -- start 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82d999bb80 1 -- start start 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 0x55c9c6e32e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82d999bb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81abc90 con 0x55c9c6e11d30 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82d999bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81ad7d0 con 0x55c9c6e15f10 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82d999bb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81ac360 con 0x55c9c6e16830 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39746/0 (socket says 172.21.15.86:39746) 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 -- 172.21.15.86:0/1899081199 learned_addr learned my addr 172.21.15.86:0/1899081199 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 0x55c9c6e32e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82c7fff700 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 -- 172.21.15.86:0/1899081199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 msgr2=0x55c9c6e32e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 0x55c9c6e32e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 -- 172.21.15.86:0/1899081199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 msgr2=0x55c9c6e1c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 -- 172.21.15.86:0/1899081199 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c6e06eb0 con 0x55c9c6e11d30 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82c7fff700 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82ccea4700 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1a230 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00edc0 tx=0x7f82bc015e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985a1808a459f56c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.110+0000 7f82b27fc700 1 -- 172.21.15.86:0/1899081199 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc038070 con 0x55c9c6e11d30 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82b27fc700 1 -- 172.21.15.86:0/1899081199 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82bc024040 con 0x55c9c6e11d30 2024-05-12T11:12:10.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82b27fc700 1 -- 172.21.15.86:0/1899081199 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc033960 con 0x55c9c6e11d30 2024-05-12T11:12:10.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 -- 172.21.15.86:0/1899081199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e11d30 msgr2=0x55c9c6e1a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1a230 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00edc0 tx=0x7f82bc015e10 comp rx=0 tx=0).stop 2024-05-12T11:12:10.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 -- 172.21.15.86:0/1899081199 shutdown_connections 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e16830 0x55c9c6e32e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e11d30 0x55c9c6e1a230 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 --2- 172.21.15.86:0/1899081199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e1c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 -- 172.21.15.86:0/1899081199 >> 172.21.15.86:0/1899081199 conn(0x55c9c6d3d170 msgr2=0x55c9c6e1bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 -- 172.21.15.86:0/1899081199 shutdown_connections 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 -- 172.21.15.86:0/1899081199 wait complete. 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.111+0000 7f82d999bb80 1 -- start start 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82d999bb80 1 Processor -- start 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e11d30 0x55c9c6e207e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e20d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82d999bb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e21260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82d999bb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81ad100 con 0x55c9c6e16830 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82d999bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81aca30 con 0x55c9c6e15f10 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82d999bb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81a9c30 con 0x55c9c6e11d30 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82d999bb80 10 client.0 _ll_register_callbacks cb 0x55c9c6cfb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82cd6a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e21260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82cd6a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e21260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39754/0 (socket says 172.21.15.86:39754) 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82cd6a5700 1 -- 172.21.15.86:0/2100473197 learned_addr learned my addr 172.21.15.86:0/2100473197 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82c7fff700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e20d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82ccea4700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e11d30 0x55c9c6e207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82cd6a5700 1 -- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e11d30 msgr2=0x55c9c6e207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e11d30 0x55c9c6e207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82cd6a5700 1 -- 172.21.15.86:0/2100473197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 msgr2=0x55c9c6e20d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e20d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82cd6a5700 1 -- 172.21.15.86:0/2100473197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c6e15b60 con 0x55c9c6e16830 2024-05-12T11:12:10.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82ccea4700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e11d30 0x55c9c6e207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.112+0000 7f82c7fff700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e20d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82cd6a5700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e21260 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f82c000d700 tx=0x7f82c0005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d7ee50375ed367 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82a7fff700 1 -- 172.21.15.86:0/2100473197 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c00ad300 con 0x55c9c6e16830 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82a7fff700 1 -- 172.21.15.86:0/2100473197 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f82c00dfdf0 con 0x55c9c6e16830 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 1 -- 172.21.15.86:0/2100473197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82bc024040 con 0x55c9c6e16830 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82a7fff700 1 -- 172.21.15.86:0/2100473197 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f82c00b1db0 con 0x55c9c6e16830 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 10 client.15789 fetch_fsmap learned FSMap version 29 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 1 -- 172.21.15.86:0/2100473197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c9c6e96c30 con 0x55c9c6e16830 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82a7fff700 1 -- 172.21.15.86:0/2100473197 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82bc024040 con 0x55c9c6e16830 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82a7fff700 1 -- 172.21.15.86:0/2100473197 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f82c00a7c20 con 0x55c9c6e16830 2024-05-12T11:12:10.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 10 client.15789 fetch_fsmap finished waiting for FSMap version 29 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 10 client.15789 resolve_mds: validated gid 24466 aka daemon mds.i 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 20 client.15789 populate_metadata read hostname 'smithi086' 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55c9c6e97130 0x55c9c6e99550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 4 client.15789 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.113+0000 7f82d999bb80 1 -- 172.21.15.86:0/2100473197 --> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55c9c6e0c4b0 con 0x55c9c6e97130 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.114+0000 7f82ccea4700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55c9c6e97130 0x55c9c6e99550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.114+0000 7f82a7fff700 10 client.15789 ms_handle_connect on v2:172.21.15.176:6838/410261641 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.114+0000 7f82ccea4700 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55c9c6e97130 0x55c9c6e99550 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94792c24ecccf7 server_cookie=8166ebaf125cfddd in_seq=0 out_seq=0 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.114+0000 7f82a7fff700 1 -- 172.21.15.86:0/2100473197 <== mds.0 v2:172.21.15.176:6838/410261641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x55c9c6e0c4b0 con 0x55c9c6e97130 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.114+0000 7f82a7fff700 10 client.15789 handle_command_reply: tid=0 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.114+0000 7f82d999bb80 1 client.15789 shutdown 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 -- 172.21.15.86:0/2100473197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 msgr2=0x55c9c6e21260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e21260 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f82c000d700 tx=0x7f82c0005310 comp rx=0 tx=0).stop 2024-05-12T11:12:10.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 -- 172.21.15.86:0/2100473197 shutdown_connections 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:6838/410261641,v1:172.21.15.176:6839/410261641] conn(0x55c9c6e97130 0x55c9c6e99550 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9c6e16830 0x55c9c6e21260 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82a7fff700 0 client.15789 ms_handle_reset on v2:172.21.15.176:6838/410261641 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9c6e11d30 0x55c9c6e207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 --2- 172.21.15.86:0/2100473197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9c6e15f10 0x55c9c6e20d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 -- 172.21.15.86:0/2100473197 >> 172.21.15.86:0/2100473197 conn(0x55c9c6d3d170 msgr2=0x55c9c6e153e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 -- 172.21.15.86:0/2100473197 shutdown_connections 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 1 -- 172.21.15.86:0/2100473197 wait complete. 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.115+0000 7f82d999bb80 20 client.15789 trim_cache size 0 max 16384 2024-05-12T11:12:10.114 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:12:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "epoch": 29, 2024-05-12T11:12:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "leader": 24466, 2024-05-12T11:12:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "set_version": 8, 2024-05-12T11:12:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "sets": {} 2024-05-12T11:12:10.115 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:12:10.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 -- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f82b80b6e00 msgr2=0x7f82b80b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f82b80b6e00 0x7f82b80b92c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009a10 tx=0x7f82bc009190 comp rx=0 tx=0).stop 2024-05-12T11:12:10.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 -- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8107390 msgr2=0x7f82c8199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:12:10.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8107390 0x7f82c8199b50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f82c0007ee0 tx=0x7f82c000d3b0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 -- 172.21.15.86:0/798070460 shutdown_connections 2024-05-12T11:12:10.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f82b80b6e00 0x7f82b80b92c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82c8107390 0x7f82c8199b50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82c8102b40 0x7f82c819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 --2- 172.21.15.86:0/798070460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c8103500 0x7f82c819ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:12:10.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 -- 172.21.15.86:0/798070460 >> 172.21.15.86:0/798070460 conn(0x7f82c80789a0 msgr2=0x7f82c8101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:12:10.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 -- 172.21.15.86:0/798070460 shutdown_connections 2024-05-12T11:12:10.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:12:10.116+0000 7f82cf108700 1 -- 172.21.15.86:0/798070460 wait complete. 2024-05-12T11:12:10.979 INFO:tasks.quiescer:done joining Quiescers 2024-05-12T11:12:10.979 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-12T11:12:10.989 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:12:10.998 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-12T11:12:11.007 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-05-12T11:12:11.007 INFO:teuthology.task.exec:Executing custom commands... 2024-05-12T11:12:11.007 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:12:11.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-05-12T11:12:11.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-05-12T11:12:11.474 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:11 smithi172 ceph-mon[34517]: pgmap v86: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 MiB/s wr, 453 op/s 2024-05-12T11:12:11.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:11 smithi176 ceph-mon[34357]: pgmap v86: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 MiB/s wr, 453 op/s 2024-05-12T11:12:11.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:11 smithi086 ceph-mon[30110]: pgmap v86: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 MiB/s wr, 453 op/s 2024-05-12T11:12:13.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:13 smithi176 ceph-mon[34357]: pgmap v87: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 652 KiB/s wr, 242 op/s 2024-05-12T11:12:13.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:13 smithi086 ceph-mon[30110]: pgmap v87: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 652 KiB/s wr, 242 op/s 2024-05-12T11:12:13.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:13 smithi172 ceph-mon[34517]: pgmap v87: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 652 KiB/s wr, 242 op/s 2024-05-12T11:12:15.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:15 smithi176 ceph-mon[34357]: pgmap v88: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 652 KiB/s wr, 242 op/s 2024-05-12T11:12:15.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:15 smithi086 ceph-mon[30110]: pgmap v88: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 652 KiB/s wr, 242 op/s 2024-05-12T11:12:15.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:15 smithi172 ceph-mon[34517]: pgmap v88: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 652 KiB/s wr, 242 op/s 2024-05-12T11:12:17.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:17 smithi176 ceph-mon[34357]: pgmap v89: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 653 KiB/s wr, 247 op/s 2024-05-12T11:12:17.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:17 smithi086 ceph-mon[30110]: pgmap v89: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 653 KiB/s wr, 247 op/s 2024-05-12T11:12:17.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:17 smithi172 ceph-mon[34517]: pgmap v89: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 653 KiB/s wr, 247 op/s 2024-05-12T11:12:19.464 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:19 smithi086 ceph-mon[30110]: pgmap v90: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 20 KiB/s wr, 55 op/s 2024-05-12T11:12:19.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:19 smithi176 ceph-mon[34357]: pgmap v90: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 20 KiB/s wr, 55 op/s 2024-05-12T11:12:19.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:19 smithi172 ceph-mon[34517]: pgmap v90: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 20 KiB/s wr, 55 op/s 2024-05-12T11:12:21.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:21 smithi176 ceph-mon[34357]: pgmap v91: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 60 op/s 2024-05-12T11:12:21.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:21 smithi086 ceph-mon[30110]: pgmap v91: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 60 op/s 2024-05-12T11:12:21.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:21 smithi172 ceph-mon[34517]: pgmap v91: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 60 op/s 2024-05-12T11:12:23.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:23 smithi176 ceph-mon[34357]: pgmap v92: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-12T11:12:23.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:23 smithi086 ceph-mon[30110]: pgmap v92: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-12T11:12:23.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:23 smithi172 ceph-mon[34517]: pgmap v92: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-12T11:12:25.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:25 smithi176 ceph-mon[34357]: pgmap v93: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-12T11:12:25.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:25 smithi086 ceph-mon[30110]: pgmap v93: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-12T11:12:25.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:25 smithi172 ceph-mon[34517]: pgmap v93: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-12T11:12:27.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:27 smithi176 ceph-mon[34357]: pgmap v94: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-12T11:12:27.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:27 smithi086 ceph-mon[30110]: pgmap v94: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-12T11:12:27.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:27 smithi172 ceph-mon[34517]: pgmap v94: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-12T11:12:29.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:29 smithi176 ceph-mon[34357]: pgmap v95: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 8 op/s 2024-05-12T11:12:29.527 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:29 smithi172 ceph-mon[34517]: pgmap v95: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 8 op/s 2024-05-12T11:12:29.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:29 smithi086 ceph-mon[30110]: pgmap v95: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 8 op/s 2024-05-12T11:12:31.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:31 smithi176 ceph-mon[34357]: pgmap v96: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 op/s 2024-05-12T11:12:31.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:31 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:12:31.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:31 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:12:31.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:31 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:12:31.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:31 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:12:31.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:31 smithi086 ceph-mon[30110]: pgmap v96: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 op/s 2024-05-12T11:12:31.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:31 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:12:31.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:31 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:12:31.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:31 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:12:31.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:31 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:12:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:31 smithi172 ceph-mon[34517]: pgmap v96: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 op/s 2024-05-12T11:12:31.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:31 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:12:31.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:31 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:12:31.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:31 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:12:31.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:31 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:12:33.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:33 smithi176 ceph-mon[34357]: pgmap v97: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:33.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:33 smithi086 ceph-mon[30110]: pgmap v97: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:33.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:33 smithi172 ceph-mon[34517]: pgmap v97: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:35.518 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:35 smithi176 ceph-mon[34357]: pgmap v98: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:35.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:35 smithi086 ceph-mon[30110]: pgmap v98: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:35 smithi172 ceph-mon[34517]: pgmap v98: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:37.516 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:37 smithi086 ceph-mon[30110]: pgmap v99: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:12:37.517 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:37 smithi176 ceph-mon[34357]: pgmap v99: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:12:37.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:37 smithi172 ceph-mon[34517]: pgmap v99: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:12:39.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:39 smithi086 ceph-mon[30110]: pgmap v100: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:39.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:39 smithi172 ceph-mon[34517]: pgmap v100: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:39.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:39 smithi176 ceph-mon[34357]: pgmap v100: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:41.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:41 smithi086 ceph-mon[30110]: pgmap v101: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:41.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:41 smithi172 ceph-mon[34517]: pgmap v101: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:41.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:41 smithi176 ceph-mon[34357]: pgmap v101: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:43.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:43 smithi086 ceph-mon[30110]: pgmap v102: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:43.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:43 smithi172 ceph-mon[34517]: pgmap v102: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:43.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:43 smithi176 ceph-mon[34357]: pgmap v102: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:45.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:45 smithi086 ceph-mon[30110]: pgmap v103: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:45.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:45 smithi172 ceph-mon[34517]: pgmap v103: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:45.767 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:45 smithi176 ceph-mon[34357]: pgmap v103: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:47.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:47 smithi086 ceph-mon[30110]: pgmap v104: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:47.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:47 smithi172 ceph-mon[34517]: pgmap v104: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:47.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:47 smithi176 ceph-mon[34357]: pgmap v104: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:49.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:49 smithi086 ceph-mon[30110]: pgmap v105: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:49.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:49 smithi172 ceph-mon[34517]: pgmap v105: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:49.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:49 smithi176 ceph-mon[34357]: pgmap v105: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:12:51.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:51 smithi086 ceph-mon[30110]: pgmap v106: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:51.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:51 smithi172 ceph-mon[34517]: pgmap v106: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:51.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:51 smithi176 ceph-mon[34357]: pgmap v106: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:12:53.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:53 smithi086 ceph-mon[30110]: pgmap v107: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:53.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:53 smithi172 ceph-mon[34517]: pgmap v107: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:53.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:53 smithi176 ceph-mon[34357]: pgmap v107: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:55.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:55 smithi086 ceph-mon[30110]: pgmap v108: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:55.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:55 smithi172 ceph-mon[34517]: pgmap v108: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:55.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:55 smithi176 ceph-mon[34357]: pgmap v108: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:57.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:57 smithi086 ceph-mon[30110]: pgmap v109: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:12:57.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:57 smithi172 ceph-mon[34517]: pgmap v109: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:12:57.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:57 smithi176 ceph-mon[34357]: pgmap v109: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:12:59.570 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:12:59 smithi176 ceph-mon[34357]: pgmap v110: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:59.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:12:59 smithi086 ceph-mon[30110]: pgmap v110: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:12:59.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:12:59 smithi172 ceph-mon[34517]: pgmap v110: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:01.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:01 smithi086 ceph-mon[30110]: pgmap v111: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:01.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:01 smithi172 ceph-mon[34517]: pgmap v111: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:01.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:01 smithi176 ceph-mon[34357]: pgmap v111: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:03.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:03 smithi086 ceph-mon[30110]: pgmap v112: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:03.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:03 smithi172 ceph-mon[34517]: pgmap v112: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:03.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:03 smithi176 ceph-mon[34357]: pgmap v112: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:05.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:05 smithi086 ceph-mon[30110]: pgmap v113: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:05.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:05 smithi172 ceph-mon[34517]: pgmap v113: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:05.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:05 smithi176 ceph-mon[34357]: pgmap v113: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:07.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:07 smithi086 ceph-mon[30110]: pgmap v114: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:07.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:07 smithi172 ceph-mon[34517]: pgmap v114: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:07.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:07 smithi176 ceph-mon[34357]: pgmap v114: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:09.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:09 smithi086 ceph-mon[30110]: pgmap v115: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:09.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:09 smithi172 ceph-mon[34517]: pgmap v115: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:09.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:09 smithi176 ceph-mon[34357]: pgmap v115: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:11.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:11 smithi086 ceph-mon[30110]: pgmap v116: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:11.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:11 smithi172 ceph-mon[34517]: pgmap v116: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:11.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:11 smithi176 ceph-mon[34357]: pgmap v116: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:13.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:13 smithi086 ceph-mon[30110]: pgmap v117: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:13.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:13 smithi172 ceph-mon[34517]: pgmap v117: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:13.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:13 smithi176 ceph-mon[34357]: pgmap v117: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:15.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:15 smithi086 ceph-mon[30110]: pgmap v118: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:15.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:15 smithi172 ceph-mon[34517]: pgmap v118: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:15.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:15 smithi176 ceph-mon[34357]: pgmap v118: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:13:17.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:17 smithi086 ceph-mon[30110]: pgmap v119: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:17.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:17 smithi172 ceph-mon[34517]: pgmap v119: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:17.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:17 smithi176 ceph-mon[34357]: pgmap v119: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:13:19.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:19 smithi086 ceph-mon[30110]: pgmap v120: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:13:19.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:19 smithi172 ceph-mon[34517]: pgmap v120: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:13:19.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:19 smithi176 ceph-mon[34357]: pgmap v120: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:13:21.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:21 smithi086 ceph-mon[30110]: pgmap v121: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:13:21.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:21 smithi172 ceph-mon[34517]: pgmap v121: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:13:21.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:21 smithi176 ceph-mon[34357]: pgmap v121: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:13:23.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:23 smithi086 ceph-mon[30110]: pgmap v122: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:23.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:23 smithi172 ceph-mon[34517]: pgmap v122: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:23.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:23 smithi176 ceph-mon[34357]: pgmap v122: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:25.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:25 smithi086 ceph-mon[30110]: pgmap v123: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:25.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:25 smithi172 ceph-mon[34517]: pgmap v123: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:25.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:25 smithi176 ceph-mon[34357]: pgmap v123: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:27.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:27 smithi086 ceph-mon[30110]: pgmap v124: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:13:27.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:27 smithi172 ceph-mon[34517]: pgmap v124: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:13:27.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:27 smithi176 ceph-mon[34357]: pgmap v124: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:13:29.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:29 smithi086 ceph-mon[30110]: pgmap v125: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:29.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:29 smithi172 ceph-mon[34517]: pgmap v125: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:29.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:29 smithi176 ceph-mon[34357]: pgmap v125: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:31.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:31 smithi086 ceph-mon[30110]: pgmap v126: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:31.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:31 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:13:31.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:31 smithi172 ceph-mon[34517]: pgmap v126: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:31.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:31 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:13:31.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:31 smithi176 ceph-mon[34357]: pgmap v126: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:31.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:31 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:13:32.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:32 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:13:32.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:32 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:13:32.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:32 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:13:32.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:32 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:13:32.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:32 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:13:32.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:32 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:13:32.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:32 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:13:32.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:32 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:13:32.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:32 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:13:33.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:33 smithi086 ceph-mon[30110]: pgmap v127: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:33.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:33 smithi172 ceph-mon[34517]: pgmap v127: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:33.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:33 smithi176 ceph-mon[34357]: pgmap v127: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:35.715 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:35 smithi086 ceph-mon[30110]: pgmap v128: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:35.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:35 smithi172 ceph-mon[34517]: pgmap v128: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:35.768 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:35 smithi176 ceph-mon[34357]: pgmap v128: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:36.714 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:36 smithi086 ceph-mon[30110]: pgmap v129: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:36.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:36 smithi172 ceph-mon[34517]: pgmap v129: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:36.769 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:36 smithi176 ceph-mon[34357]: pgmap v129: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:39.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:38 smithi086 ceph-mon[30110]: pgmap v130: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:39.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:38 smithi172 ceph-mon[34517]: pgmap v130: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:39.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:38 smithi176 ceph-mon[34357]: pgmap v130: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:41.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:40 smithi086 ceph-mon[30110]: pgmap v131: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:41.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:40 smithi172 ceph-mon[34517]: pgmap v131: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:41.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:40 smithi176 ceph-mon[34357]: pgmap v131: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:43.214 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:42 smithi086 ceph-mon[30110]: pgmap v132: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:43.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:42 smithi172 ceph-mon[34517]: pgmap v132: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:43.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:42 smithi176 ceph-mon[34357]: pgmap v132: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:45.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:44 smithi086 ceph-mon[30110]: pgmap v133: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:45.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:44 smithi172 ceph-mon[34517]: pgmap v133: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:45.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:44 smithi176 ceph-mon[34357]: pgmap v133: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:47.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:46 smithi086 ceph-mon[30110]: pgmap v134: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:47.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:46 smithi172 ceph-mon[34517]: pgmap v134: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:47.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:46 smithi176 ceph-mon[34357]: pgmap v134: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:49.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:48 smithi086 ceph-mon[30110]: pgmap v135: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:49.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:48 smithi172 ceph-mon[34517]: pgmap v135: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:49.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:48 smithi176 ceph-mon[34357]: pgmap v135: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:51.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:50 smithi086 ceph-mon[30110]: pgmap v136: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:51.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:50 smithi172 ceph-mon[34517]: pgmap v136: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:51.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:50 smithi176 ceph-mon[34357]: pgmap v136: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:53.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:52 smithi086 ceph-mon[30110]: pgmap v137: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:53.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:52 smithi172 ceph-mon[34517]: pgmap v137: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:53.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:52 smithi176 ceph-mon[34357]: pgmap v137: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:55.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:54 smithi086 ceph-mon[30110]: pgmap v138: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:55.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:54 smithi172 ceph-mon[34517]: pgmap v138: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:55.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:54 smithi176 ceph-mon[34357]: pgmap v138: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:57.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:56 smithi086 ceph-mon[30110]: pgmap v139: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:57.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:56 smithi172 ceph-mon[34517]: pgmap v139: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:57.268 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:56 smithi176 ceph-mon[34357]: pgmap v139: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:13:59.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:13:58 smithi086 ceph-mon[30110]: pgmap v140: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:59.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:13:58 smithi172 ceph-mon[34517]: pgmap v140: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:13:59.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:13:58 smithi176 ceph-mon[34357]: pgmap v140: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:01.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:00 smithi086 ceph-mon[30110]: pgmap v141: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:01.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:00 smithi172 ceph-mon[34517]: pgmap v141: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:01.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:00 smithi176 ceph-mon[34357]: pgmap v141: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:03.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:02 smithi086 ceph-mon[30110]: pgmap v142: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:03.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:02 smithi172 ceph-mon[34517]: pgmap v142: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:03.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:02 smithi176 ceph-mon[34357]: pgmap v142: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:05.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:04 smithi086 ceph-mon[30110]: pgmap v143: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:05.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:04 smithi172 ceph-mon[34517]: pgmap v143: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:05.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:04 smithi176 ceph-mon[34357]: pgmap v143: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:07.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:06 smithi086 ceph-mon[30110]: pgmap v144: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:07.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:06 smithi172 ceph-mon[34517]: pgmap v144: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:07.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:06 smithi176 ceph-mon[34357]: pgmap v144: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:09.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:08 smithi086 ceph-mon[30110]: pgmap v145: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:09.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:08 smithi172 ceph-mon[34517]: pgmap v145: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:09.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:08 smithi176 ceph-mon[34357]: pgmap v145: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:11.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:10 smithi086 ceph-mon[30110]: pgmap v146: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:11.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:10 smithi172 ceph-mon[34517]: pgmap v146: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:11.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:10 smithi176 ceph-mon[34357]: pgmap v146: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:13.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:12 smithi086 ceph-mon[30110]: pgmap v147: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:13.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:12 smithi172 ceph-mon[34517]: pgmap v147: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:13.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:12 smithi176 ceph-mon[34357]: pgmap v147: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:15.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:14 smithi086 ceph-mon[30110]: pgmap v148: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:15.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:14 smithi172 ceph-mon[34517]: pgmap v148: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:15.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:14 smithi176 ceph-mon[34357]: pgmap v148: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:14:17.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:16 smithi086 ceph-mon[30110]: pgmap v149: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:17.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:16 smithi172 ceph-mon[34517]: pgmap v149: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:17.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:16 smithi176 ceph-mon[34357]: pgmap v149: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:14:19.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:18 smithi086 ceph-mon[30110]: pgmap v150: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:14:19.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:18 smithi172 ceph-mon[34517]: pgmap v150: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:14:19.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:18 smithi176 ceph-mon[34357]: pgmap v150: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:14:21.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:20 smithi086 ceph-mon[30110]: pgmap v151: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:14:21.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:20 smithi172 ceph-mon[34517]: pgmap v151: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:14:21.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:20 smithi176 ceph-mon[34357]: pgmap v151: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:14:23.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:22 smithi086 ceph-mon[30110]: pgmap v152: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:23.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:22 smithi172 ceph-mon[34517]: pgmap v152: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:23.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:22 smithi176 ceph-mon[34357]: pgmap v152: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:25.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:24 smithi086 ceph-mon[30110]: pgmap v153: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:25.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:24 smithi172 ceph-mon[34517]: pgmap v153: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:25.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:24 smithi176 ceph-mon[34357]: pgmap v153: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:27.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:26 smithi086 ceph-mon[30110]: pgmap v154: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:14:27.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:26 smithi172 ceph-mon[34517]: pgmap v154: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:14:27.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:26 smithi176 ceph-mon[34357]: pgmap v154: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:14:29.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:28 smithi086 ceph-mon[30110]: pgmap v155: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:29.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:28 smithi172 ceph-mon[34517]: pgmap v155: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:29.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:28 smithi176 ceph-mon[34357]: pgmap v155: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:31.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:30 smithi086 ceph-mon[30110]: pgmap v156: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:31.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:30 smithi172 ceph-mon[34517]: pgmap v156: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:31.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:30 smithi176 ceph-mon[34357]: pgmap v156: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:33.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:32 smithi086 ceph-mon[30110]: pgmap v157: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:33.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:32 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:14:33.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:32 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:14:33.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:32 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:14:33.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:32 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:14:33.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:32 smithi172 ceph-mon[34517]: pgmap v157: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:33.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:32 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:14:33.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:32 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:14:33.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:32 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:14:33.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:32 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:14:33.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:32 smithi176 ceph-mon[34357]: pgmap v157: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:33.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:32 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:14:33.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:32 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:14:33.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:32 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:14:33.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:32 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:14:35.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:34 smithi086 ceph-mon[30110]: pgmap v158: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:35.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:34 smithi172 ceph-mon[34517]: pgmap v158: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:35.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:34 smithi176 ceph-mon[34357]: pgmap v158: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:37.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:36 smithi086 ceph-mon[30110]: pgmap v159: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:37.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:36 smithi172 ceph-mon[34517]: pgmap v159: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:37.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:36 smithi176 ceph-mon[34357]: pgmap v159: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:39.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:38 smithi086 ceph-mon[30110]: pgmap v160: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:39.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:38 smithi172 ceph-mon[34517]: pgmap v160: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:39.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:38 smithi176 ceph-mon[34357]: pgmap v160: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:41.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:40 smithi086 ceph-mon[30110]: pgmap v161: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:41.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:40 smithi172 ceph-mon[34517]: pgmap v161: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:41.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:40 smithi176 ceph-mon[34357]: pgmap v161: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:43.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:42 smithi086 ceph-mon[30110]: pgmap v162: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:43.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:42 smithi172 ceph-mon[34517]: pgmap v162: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:43.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:42 smithi176 ceph-mon[34357]: pgmap v162: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:45.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:44 smithi086 ceph-mon[30110]: pgmap v163: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:45.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:44 smithi172 ceph-mon[34517]: pgmap v163: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:45.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:44 smithi176 ceph-mon[34357]: pgmap v163: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:47.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:46 smithi086 ceph-mon[30110]: pgmap v164: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:47.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:46 smithi172 ceph-mon[34517]: pgmap v164: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:47.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:46 smithi176 ceph-mon[34357]: pgmap v164: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:49.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:48 smithi086 ceph-mon[30110]: pgmap v165: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:49.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:48 smithi172 ceph-mon[34517]: pgmap v165: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:49.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:48 smithi176 ceph-mon[34357]: pgmap v165: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:51.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:50 smithi086 ceph-mon[30110]: pgmap v166: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:51.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:50 smithi172 ceph-mon[34517]: pgmap v166: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:51.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:50 smithi176 ceph-mon[34357]: pgmap v166: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:53.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:52 smithi086 ceph-mon[30110]: pgmap v167: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:53.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:52 smithi172 ceph-mon[34517]: pgmap v167: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:53.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:52 smithi176 ceph-mon[34357]: pgmap v167: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:55.215 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:54 smithi086 ceph-mon[30110]: pgmap v168: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:55.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:54 smithi172 ceph-mon[34517]: pgmap v168: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:55.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:54 smithi176 ceph-mon[34357]: pgmap v168: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:57.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:56 smithi086 ceph-mon[30110]: pgmap v169: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:57.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:56 smithi172 ceph-mon[34517]: pgmap v169: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:57.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:56 smithi176 ceph-mon[34357]: pgmap v169: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:14:59.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:14:58 smithi086 ceph-mon[30110]: pgmap v170: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:59.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:14:58 smithi172 ceph-mon[34517]: pgmap v170: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:14:59.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:14:58 smithi176 ceph-mon[34357]: pgmap v170: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:01.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:00 smithi086 ceph-mon[30110]: pgmap v171: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:01.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:00 smithi172 ceph-mon[34517]: pgmap v171: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:01.269 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:00 smithi176 ceph-mon[34357]: pgmap v171: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:03.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:02 smithi086 ceph-mon[30110]: pgmap v172: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:03.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:02 smithi172 ceph-mon[34517]: pgmap v172: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:03.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:02 smithi176 ceph-mon[34357]: pgmap v172: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:05.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:04 smithi086 ceph-mon[30110]: pgmap v173: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:05.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:04 smithi172 ceph-mon[34517]: pgmap v173: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:05.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:04 smithi176 ceph-mon[34357]: pgmap v173: 97 pgs: 97 active+clean; 7.1 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:07.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:06 smithi086 ceph-mon[30110]: pgmap v174: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:07.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:06 smithi172 ceph-mon[34517]: pgmap v174: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:07.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:06 smithi176 ceph-mon[34357]: pgmap v174: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:09.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:08 smithi086 ceph-mon[30110]: pgmap v175: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:09.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:08 smithi172 ceph-mon[34517]: pgmap v175: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:09.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:08 smithi176 ceph-mon[34357]: pgmap v175: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:11.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:10 smithi086 ceph-mon[30110]: pgmap v176: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:11.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:10 smithi172 ceph-mon[34517]: pgmap v176: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:11.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:10 smithi176 ceph-mon[34357]: pgmap v176: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:13.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:12 smithi086 ceph-mon[30110]: pgmap v177: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:13.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:12 smithi172 ceph-mon[34517]: pgmap v177: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:13.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:12 smithi176 ceph-mon[34357]: pgmap v177: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:15.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:14 smithi086 ceph-mon[30110]: pgmap v178: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:15.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:14 smithi172 ceph-mon[34517]: pgmap v178: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:15.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:14 smithi176 ceph-mon[34357]: pgmap v178: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-05-12T11:15:17.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:16 smithi086 ceph-mon[30110]: pgmap v179: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:17.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:16 smithi172 ceph-mon[34517]: pgmap v179: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:17.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:16 smithi176 ceph-mon[34357]: pgmap v179: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-05-12T11:15:19.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:18 smithi086 ceph-mon[30110]: pgmap v180: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:15:19.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:18 smithi172 ceph-mon[34517]: pgmap v180: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:15:19.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:18 smithi176 ceph-mon[34357]: pgmap v180: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-12T11:15:21.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:20 smithi086 ceph-mon[30110]: pgmap v181: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:15:21.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:20 smithi172 ceph-mon[34517]: pgmap v181: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:15:21.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:20 smithi176 ceph-mon[34357]: pgmap v181: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-05-12T11:15:23.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:22 smithi086 ceph-mon[30110]: pgmap v182: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:23.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:22 smithi172 ceph-mon[34517]: pgmap v182: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:23.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:22 smithi176 ceph-mon[34357]: pgmap v182: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:25.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:24 smithi172 ceph-mon[34517]: pgmap v183: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:25.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:24 smithi176 ceph-mon[34357]: pgmap v183: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:25.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:24 smithi086 ceph-mon[30110]: pgmap v183: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:27.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:26 smithi172 ceph-mon[34517]: pgmap v184: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:15:27.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:26 smithi176 ceph-mon[34357]: pgmap v184: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:15:27.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:26 smithi086 ceph-mon[30110]: pgmap v184: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-05-12T11:15:29.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:28 smithi172 ceph-mon[34517]: pgmap v185: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:29.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:28 smithi176 ceph-mon[34357]: pgmap v185: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:29.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:28 smithi086 ceph-mon[30110]: pgmap v185: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:31.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:30 smithi176 ceph-mon[34357]: pgmap v186: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:31.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:30 smithi086 ceph-mon[30110]: pgmap v186: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:31.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:30 smithi172 ceph-mon[34517]: pgmap v186: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:33.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:32 smithi176 ceph-mon[34357]: pgmap v187: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:33.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:32 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:15:33.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:32 smithi086 ceph-mon[30110]: pgmap v187: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:33.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:32 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:15:33.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:32 smithi172 ceph-mon[34517]: pgmap v187: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:33.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:32 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:15:34.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:33 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:15:34.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:33 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:15:34.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:33 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:15:34.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:33 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:15:34.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:33 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:15:34.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:33 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:15:34.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:33 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:15:34.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:33 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:15:34.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:33 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:15:35.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:34 smithi176 ceph-mon[34357]: pgmap v188: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:35.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:34 smithi086 ceph-mon[30110]: pgmap v188: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:35.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:34 smithi172 ceph-mon[34517]: pgmap v188: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:37.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:36 smithi176 ceph-mon[34357]: pgmap v189: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:37.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:36 smithi086 ceph-mon[30110]: pgmap v189: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:37.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:36 smithi172 ceph-mon[34517]: pgmap v189: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:39.268 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:38 smithi086 ceph-mon[30110]: pgmap v190: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:39.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:38 smithi176 ceph-mon[34357]: pgmap v190: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:39.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:38 smithi172 ceph-mon[34517]: pgmap v190: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:41.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:40 smithi176 ceph-mon[34357]: pgmap v191: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:41.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:40 smithi086 ceph-mon[30110]: pgmap v191: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:41.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:40 smithi172 ceph-mon[34517]: pgmap v191: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:43.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:43 smithi176 ceph-mon[34357]: pgmap v192: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:43.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:43 smithi086 ceph-mon[30110]: pgmap v192: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:43.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:43 smithi172 ceph-mon[34517]: pgmap v192: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:45.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:45 smithi176 ceph-mon[34357]: pgmap v193: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:45.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:45 smithi086 ceph-mon[30110]: pgmap v193: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:45.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:45 smithi172 ceph-mon[34517]: pgmap v193: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:47.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:47 smithi176 ceph-mon[34357]: pgmap v194: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:47.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:47 smithi086 ceph-mon[30110]: pgmap v194: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:47.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:47 smithi172 ceph-mon[34517]: pgmap v194: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:49.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:49 smithi176 ceph-mon[34357]: pgmap v195: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:49.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:49 smithi086 ceph-mon[30110]: pgmap v195: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:49.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:49 smithi172 ceph-mon[34517]: pgmap v195: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:51.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:51 smithi176 ceph-mon[34357]: pgmap v196: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:51.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:51 smithi086 ceph-mon[30110]: pgmap v196: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:51.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:51 smithi172 ceph-mon[34517]: pgmap v196: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:53.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:53 smithi176 ceph-mon[34357]: pgmap v197: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:53.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:53 smithi086 ceph-mon[30110]: pgmap v197: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:53.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:53 smithi172 ceph-mon[34517]: pgmap v197: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:55.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:55 smithi176 ceph-mon[34357]: pgmap v198: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:55.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:55 smithi086 ceph-mon[30110]: pgmap v198: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:55.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:55 smithi172 ceph-mon[34517]: pgmap v198: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:57.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:57 smithi176 ceph-mon[34357]: pgmap v199: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:57.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:57 smithi086 ceph-mon[30110]: pgmap v199: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:57.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:57 smithi172 ceph-mon[34517]: pgmap v199: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:15:59.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:15:59 smithi172 ceph-mon[34517]: pgmap v200: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:59.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:15:59 smithi086 ceph-mon[30110]: pgmap v200: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:15:59.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:15:59 smithi176 ceph-mon[34357]: pgmap v200: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:01.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:01 smithi086 ceph-mon[30110]: pgmap v201: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:01.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:01 smithi172 ceph-mon[34517]: pgmap v201: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:01.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:01 smithi176 ceph-mon[34357]: pgmap v201: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:03.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:03 smithi086 ceph-mon[30110]: pgmap v202: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:03.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:03 smithi172 ceph-mon[34517]: pgmap v202: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:03.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:03 smithi176 ceph-mon[34357]: pgmap v202: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:05.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:05 smithi086 ceph-mon[30110]: pgmap v203: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:05.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:05 smithi172 ceph-mon[34517]: pgmap v203: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:05.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:05 smithi176 ceph-mon[34357]: pgmap v203: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:07.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:07 smithi086 ceph-mon[30110]: pgmap v204: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:16:07.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:07 smithi172 ceph-mon[34517]: pgmap v204: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:16:07.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:07 smithi176 ceph-mon[34357]: pgmap v204: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:16:09.467 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:09 smithi086 ceph-mon[30110]: pgmap v205: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:16:09.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:09 smithi172 ceph-mon[34517]: pgmap v205: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:16:09.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:09 smithi176 ceph-mon[34357]: pgmap v205: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:16:11.467 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:11 smithi086 ceph-mon[30110]: pgmap v206: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-05-12T11:16:11.467 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:11 smithi086 ceph-mon[30110]: osdmap e84: 12 total, 12 up, 12 in 2024-05-12T11:16:11.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:11 smithi172 ceph-mon[34517]: pgmap v206: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-05-12T11:16:11.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:11 smithi172 ceph-mon[34517]: osdmap e84: 12 total, 12 up, 12 in 2024-05-12T11:16:11.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:11 smithi176 ceph-mon[34357]: pgmap v206: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-05-12T11:16:11.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:11 smithi176 ceph-mon[34357]: osdmap e84: 12 total, 12 up, 12 in 2024-05-12T11:16:13.467 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:13 smithi086 ceph-mon[30110]: pgmap v208: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:16:13.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:13 smithi172 ceph-mon[34517]: pgmap v208: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:16:13.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:13 smithi176 ceph-mon[34357]: pgmap v208: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:16:15.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:15 smithi086 ceph-mon[30110]: pgmap v209: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:16:15.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:15 smithi172 ceph-mon[34517]: pgmap v209: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:16:15.520 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:15 smithi176 ceph-mon[34357]: pgmap v209: 97 pgs: 97 active+clean; 7.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:16:17.467 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:17 smithi086 ceph-mon[30110]: pgmap v210: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:16:17.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:17 smithi172 ceph-mon[34517]: pgmap v210: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:16:17.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:17 smithi176 ceph-mon[34357]: pgmap v210: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:16:19.466 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:19 smithi086 ceph-mon[30110]: pgmap v211: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:16:19.477 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:19 smithi172 ceph-mon[34517]: pgmap v211: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:16:19.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:19 smithi176 ceph-mon[34357]: pgmap v211: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:16:21.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:20 smithi086 ceph-mon[30110]: pgmap v212: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:21.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:20 smithi086 ceph-mon[30110]: osdmap e85: 12 total, 12 up, 12 in 2024-05-12T11:16:21.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:20 smithi172 ceph-mon[34517]: pgmap v212: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:21.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:20 smithi172 ceph-mon[34517]: osdmap e85: 12 total, 12 up, 12 in 2024-05-12T11:16:21.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:20 smithi176 ceph-mon[34357]: pgmap v212: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:21.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:20 smithi176 ceph-mon[34357]: osdmap e85: 12 total, 12 up, 12 in 2024-05-12T11:16:23.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:22 smithi086 ceph-mon[30110]: pgmap v214: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:23.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:22 smithi172 ceph-mon[34517]: pgmap v214: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:23.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:22 smithi176 ceph-mon[34357]: pgmap v214: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:25.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:24 smithi086 ceph-mon[30110]: pgmap v215: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:25.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:24 smithi172 ceph-mon[34517]: pgmap v215: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:25.270 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:24 smithi176 ceph-mon[34357]: pgmap v215: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:16:27.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:26 smithi086 ceph-mon[30110]: pgmap v216: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:27.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:26 smithi172 ceph-mon[34517]: pgmap v216: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:27.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:26 smithi176 ceph-mon[34357]: pgmap v216: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:29.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:28 smithi086 ceph-mon[30110]: pgmap v217: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:29.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:28 smithi172 ceph-mon[34517]: pgmap v217: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:28 smithi176 ceph-mon[34357]: pgmap v217: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:31.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:30 smithi086 ceph-mon[30110]: pgmap v218: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:31.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:30 smithi172 ceph-mon[34517]: pgmap v218: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:31.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:30 smithi176 ceph-mon[34357]: pgmap v218: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:16:33.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:32 smithi086 ceph-mon[30110]: pgmap v219: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:33.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:32 smithi172 ceph-mon[34517]: pgmap v219: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:33.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:32 smithi176 ceph-mon[34357]: pgmap v219: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:34.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:33 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:16:34.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:33 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:16:34.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:33 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:16:35.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:34 smithi086 ceph-mon[30110]: pgmap v220: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:35.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:34 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:16:35.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:34 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:16:35.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:34 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:16:35.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:34 smithi172 ceph-mon[34517]: pgmap v220: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:35.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:34 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:16:35.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:34 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:16:35.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:34 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:16:35.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:34 smithi176 ceph-mon[34357]: pgmap v220: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:35.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:34 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:16:35.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:34 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:16:35.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:34 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:16:37.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:36 smithi086 ceph-mon[30110]: pgmap v221: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:37.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:36 smithi172 ceph-mon[34517]: pgmap v221: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:37.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:36 smithi176 ceph-mon[34357]: pgmap v221: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:39.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:38 smithi086 ceph-mon[30110]: pgmap v222: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:39.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:38 smithi172 ceph-mon[34517]: pgmap v222: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:39.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:38 smithi176 ceph-mon[34357]: pgmap v222: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:41.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:40 smithi086 ceph-mon[30110]: pgmap v223: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:41.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:40 smithi172 ceph-mon[34517]: pgmap v223: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:41.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:40 smithi176 ceph-mon[34357]: pgmap v223: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:43.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:42 smithi086 ceph-mon[30110]: pgmap v224: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:43.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:42 smithi172 ceph-mon[34517]: pgmap v224: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:43.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:42 smithi176 ceph-mon[34357]: pgmap v224: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:45.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:44 smithi086 ceph-mon[30110]: pgmap v225: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:45.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:44 smithi172 ceph-mon[34517]: pgmap v225: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:45.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:44 smithi176 ceph-mon[34357]: pgmap v225: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:47.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:46 smithi086 ceph-mon[30110]: pgmap v226: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:47.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:46 smithi172 ceph-mon[34517]: pgmap v226: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:47.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:46 smithi176 ceph-mon[34357]: pgmap v226: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:49.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:48 smithi086 ceph-mon[30110]: pgmap v227: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:49.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:48 smithi172 ceph-mon[34517]: pgmap v227: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:49.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:48 smithi176 ceph-mon[34357]: pgmap v227: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:51.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:50 smithi086 ceph-mon[30110]: pgmap v228: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:51.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:50 smithi172 ceph-mon[34517]: pgmap v228: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:51.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:50 smithi176 ceph-mon[34357]: pgmap v228: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:53.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:52 smithi086 ceph-mon[30110]: pgmap v229: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:53.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:52 smithi172 ceph-mon[34517]: pgmap v229: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:53.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:52 smithi176 ceph-mon[34357]: pgmap v229: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:55.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:54 smithi086 ceph-mon[30110]: pgmap v230: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:55.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:54 smithi172 ceph-mon[34517]: pgmap v230: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:55.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:54 smithi176 ceph-mon[34357]: pgmap v230: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:57.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:56 smithi086 ceph-mon[30110]: pgmap v231: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:57.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:56 smithi172 ceph-mon[34517]: pgmap v231: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:57.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:56 smithi176 ceph-mon[34357]: pgmap v231: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:16:59.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:16:58 smithi086 ceph-mon[30110]: pgmap v232: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:59.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:16:58 smithi172 ceph-mon[34517]: pgmap v232: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:16:59.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:16:58 smithi176 ceph-mon[34357]: pgmap v232: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:01.222 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:00 smithi086 ceph-mon[30110]: pgmap v233: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:01.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:00 smithi172 ceph-mon[34517]: pgmap v233: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:01.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:00 smithi176 ceph-mon[34357]: pgmap v233: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:03.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:02 smithi086 ceph-mon[30110]: pgmap v234: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-12T11:17:03.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:02 smithi172 ceph-mon[34517]: pgmap v234: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-12T11:17:03.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:02 smithi176 ceph-mon[34357]: pgmap v234: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-12T11:17:05.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:04 smithi086 ceph-mon[30110]: pgmap v235: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-12T11:17:05.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:04 smithi172 ceph-mon[34517]: pgmap v235: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-12T11:17:05.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:04 smithi176 ceph-mon[34357]: pgmap v235: 97 pgs: 97 active+clean; 7.1 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-12T11:17:07.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:06 smithi086 ceph-mon[30110]: pgmap v236: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:17:07.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:06 smithi172 ceph-mon[34517]: pgmap v236: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:17:07.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:06 smithi176 ceph-mon[34357]: pgmap v236: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:17:09.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:08 smithi086 ceph-mon[30110]: pgmap v237: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:17:09.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:08 smithi172 ceph-mon[34517]: pgmap v237: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:17:09.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:08 smithi176 ceph-mon[34357]: pgmap v237: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:17:11.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:10 smithi086 ceph-mon[30110]: pgmap v238: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-05-12T11:17:11.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:10 smithi086 ceph-mon[30110]: osdmap e86: 12 total, 12 up, 12 in 2024-05-12T11:17:11.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:10 smithi172 ceph-mon[34517]: pgmap v238: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-05-12T11:17:11.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:10 smithi172 ceph-mon[34517]: osdmap e86: 12 total, 12 up, 12 in 2024-05-12T11:17:11.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:10 smithi176 ceph-mon[34357]: pgmap v238: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-05-12T11:17:11.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:10 smithi176 ceph-mon[34357]: osdmap e86: 12 total, 12 up, 12 in 2024-05-12T11:17:13.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:12 smithi086 ceph-mon[30110]: pgmap v240: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:17:13.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:12 smithi172 ceph-mon[34517]: pgmap v240: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:17:13.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:12 smithi176 ceph-mon[34357]: pgmap v240: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:17:15.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:14 smithi086 ceph-mon[30110]: pgmap v241: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:17:15.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:14 smithi172 ceph-mon[34517]: pgmap v241: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:17:15.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:14 smithi176 ceph-mon[34357]: pgmap v241: 97 pgs: 97 active+clean; 7.1 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:17:17.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:16 smithi086 ceph-mon[30110]: pgmap v242: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:17:17.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:16 smithi172 ceph-mon[34517]: pgmap v242: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:17:17.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:16 smithi176 ceph-mon[34357]: pgmap v242: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:17:19.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:18 smithi086 ceph-mon[30110]: pgmap v243: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:17:19.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:18 smithi172 ceph-mon[34517]: pgmap v243: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:17:19.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:18 smithi176 ceph-mon[34357]: pgmap v243: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:17:21.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:20 smithi086 ceph-mon[30110]: pgmap v244: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:21.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:20 smithi086 ceph-mon[30110]: osdmap e87: 12 total, 12 up, 12 in 2024-05-12T11:17:21.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:20 smithi172 ceph-mon[34517]: pgmap v244: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:21.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:20 smithi172 ceph-mon[34517]: osdmap e87: 12 total, 12 up, 12 in 2024-05-12T11:17:21.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:20 smithi176 ceph-mon[34357]: pgmap v244: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:21.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:20 smithi176 ceph-mon[34357]: osdmap e87: 12 total, 12 up, 12 in 2024-05-12T11:17:23.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:22 smithi086 ceph-mon[30110]: pgmap v246: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:23.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:22 smithi172 ceph-mon[34517]: pgmap v246: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:23.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:22 smithi176 ceph-mon[34357]: pgmap v246: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:25.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:24 smithi086 ceph-mon[30110]: pgmap v247: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:25.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:24 smithi172 ceph-mon[34517]: pgmap v247: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:25.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:24 smithi176 ceph-mon[34357]: pgmap v247: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:17:27.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:26 smithi086 ceph-mon[30110]: pgmap v248: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:17:27.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:26 smithi172 ceph-mon[34517]: pgmap v248: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:17:27.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:26 smithi176 ceph-mon[34357]: pgmap v248: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:17:29.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:28 smithi086 ceph-mon[30110]: pgmap v249: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:17:29.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:28 smithi172 ceph-mon[34517]: pgmap v249: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:17:29.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:28 smithi176 ceph-mon[34357]: pgmap v249: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:17:31.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:30 smithi086 ceph-mon[30110]: pgmap v250: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:17:31.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:30 smithi172 ceph-mon[34517]: pgmap v250: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:17:31.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:30 smithi176 ceph-mon[34357]: pgmap v250: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:17:33.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:32 smithi086 ceph-mon[30110]: pgmap v251: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:33.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:32 smithi172 ceph-mon[34517]: pgmap v251: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:33.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:32 smithi176 ceph-mon[34357]: pgmap v251: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:35.217 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:34 smithi086 ceph-mon[30110]: pgmap v252: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:35.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:34 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:17:35.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:34 smithi172 ceph-mon[34517]: pgmap v252: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:35.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:34 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:17:35.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:34 smithi176 ceph-mon[34357]: pgmap v252: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:35.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:34 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:17:36.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:35 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:17:36.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:35 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:17:36.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:35 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:17:36.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:35 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:17:36.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:35 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:17:36.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:35 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:17:36.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:35 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:17:36.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:35 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:17:36.271 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:35 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:17:37.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:37 smithi176 ceph-mon[34357]: pgmap v253: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:37.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:37 smithi086 ceph-mon[30110]: pgmap v253: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:37.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:37 smithi172 ceph-mon[34517]: pgmap v253: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:39.520 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:39 smithi086 ceph-mon[30110]: pgmap v254: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:39.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:39 smithi176 ceph-mon[34357]: pgmap v254: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:39.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:39 smithi172 ceph-mon[34517]: pgmap v254: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:41.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:41 smithi176 ceph-mon[34357]: pgmap v255: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:41.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:41 smithi086 ceph-mon[30110]: pgmap v255: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:41.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:41 smithi172 ceph-mon[34517]: pgmap v255: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:43.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:43 smithi176 ceph-mon[34357]: pgmap v256: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:43.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:43 smithi086 ceph-mon[30110]: pgmap v256: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:43.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:43 smithi172 ceph-mon[34517]: pgmap v256: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:45.522 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:45 smithi176 ceph-mon[34357]: pgmap v257: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:45.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:45 smithi086 ceph-mon[30110]: pgmap v257: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:45.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:45 smithi172 ceph-mon[34517]: pgmap v257: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:47.522 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:47 smithi176 ceph-mon[34357]: pgmap v258: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:47.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:47 smithi086 ceph-mon[30110]: pgmap v258: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:47.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:47 smithi172 ceph-mon[34517]: pgmap v258: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:49.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:49 smithi176 ceph-mon[34357]: pgmap v259: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:49.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:49 smithi086 ceph-mon[30110]: pgmap v259: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:49.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:49 smithi172 ceph-mon[34517]: pgmap v259: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:51.521 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:51 smithi176 ceph-mon[34357]: pgmap v260: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:51.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:51 smithi086 ceph-mon[30110]: pgmap v260: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:51.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:51 smithi172 ceph-mon[34517]: pgmap v260: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:53.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:53 smithi086 ceph-mon[30110]: pgmap v261: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:53.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:53 smithi172 ceph-mon[34517]: pgmap v261: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:53.771 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:53 smithi176 ceph-mon[34357]: pgmap v261: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:55.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:55 smithi086 ceph-mon[30110]: pgmap v262: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:55.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:55 smithi172 ceph-mon[34517]: pgmap v262: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:55.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:55 smithi176 ceph-mon[34357]: pgmap v262: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:57.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:57 smithi086 ceph-mon[30110]: pgmap v263: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:57.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:57 smithi172 ceph-mon[34517]: pgmap v263: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:57.771 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:57 smithi176 ceph-mon[34357]: pgmap v263: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:17:59.531 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:17:59 smithi172 ceph-mon[34517]: pgmap v264: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:59.573 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:17:59 smithi176 ceph-mon[34357]: pgmap v264: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:17:59.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:17:59 smithi086 ceph-mon[30110]: pgmap v264: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:01.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:01 smithi086 ceph-mon[30110]: pgmap v265: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:01.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:01 smithi172 ceph-mon[34517]: pgmap v265: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:01.771 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:01 smithi176 ceph-mon[34357]: pgmap v265: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:03.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:03 smithi086 ceph-mon[30110]: pgmap v266: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:03.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:03 smithi172 ceph-mon[34517]: pgmap v266: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:03.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:03 smithi176 ceph-mon[34357]: pgmap v266: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:05.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:05 smithi086 ceph-mon[30110]: pgmap v267: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:05.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:05 smithi172 ceph-mon[34517]: pgmap v267: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:05.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:05 smithi176 ceph-mon[34357]: pgmap v267: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:07.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:07 smithi086 ceph-mon[30110]: pgmap v268: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:18:07.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:07 smithi172 ceph-mon[34517]: pgmap v268: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:18:07.771 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:07 smithi176 ceph-mon[34357]: pgmap v268: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:18:09.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:09 smithi086 ceph-mon[30110]: pgmap v269: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:18:09.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:09 smithi172 ceph-mon[34517]: pgmap v269: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:18:09.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:09 smithi176 ceph-mon[34357]: pgmap v269: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:18:11.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:11 smithi086 ceph-mon[30110]: pgmap v270: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:18:11.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:11 smithi086 ceph-mon[30110]: osdmap e88: 12 total, 12 up, 12 in 2024-05-12T11:18:11.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:11 smithi172 ceph-mon[34517]: pgmap v270: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:18:11.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:11 smithi172 ceph-mon[34517]: osdmap e88: 12 total, 12 up, 12 in 2024-05-12T11:18:11.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:11 smithi176 ceph-mon[34357]: pgmap v270: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:18:11.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:11 smithi176 ceph-mon[34357]: osdmap e88: 12 total, 12 up, 12 in 2024-05-12T11:18:13.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:13 smithi086 ceph-mon[30110]: pgmap v272: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:18:13.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:13 smithi172 ceph-mon[34517]: pgmap v272: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:18:13.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:13 smithi176 ceph-mon[34357]: pgmap v272: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:18:15.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:15 smithi086 ceph-mon[30110]: pgmap v273: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:18:15.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:15 smithi172 ceph-mon[34517]: pgmap v273: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:18:15.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:15 smithi176 ceph-mon[34357]: pgmap v273: 97 pgs: 97 active+clean; 7.1 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:18:17.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:17 smithi086 ceph-mon[30110]: pgmap v274: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:18:17.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:17 smithi172 ceph-mon[34517]: pgmap v274: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:18:17.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:17 smithi176 ceph-mon[34357]: pgmap v274: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:18:19.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:19 smithi086 ceph-mon[30110]: pgmap v275: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:18:19.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:19 smithi172 ceph-mon[34517]: pgmap v275: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:18:19.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:19 smithi176 ceph-mon[34357]: pgmap v275: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:18:21.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:20 smithi086 ceph-mon[30110]: pgmap v276: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:21.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:20 smithi086 ceph-mon[30110]: osdmap e89: 12 total, 12 up, 12 in 2024-05-12T11:18:21.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:20 smithi172 ceph-mon[34517]: pgmap v276: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:21.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:20 smithi172 ceph-mon[34517]: osdmap e89: 12 total, 12 up, 12 in 2024-05-12T11:18:21.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:20 smithi176 ceph-mon[34357]: pgmap v276: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:21.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:20 smithi176 ceph-mon[34357]: osdmap e89: 12 total, 12 up, 12 in 2024-05-12T11:18:23.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:22 smithi086 ceph-mon[30110]: pgmap v278: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:23.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:22 smithi172 ceph-mon[34517]: pgmap v278: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:23.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:22 smithi176 ceph-mon[34357]: pgmap v278: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:25.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:24 smithi086 ceph-mon[30110]: pgmap v279: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:25.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:24 smithi172 ceph-mon[34517]: pgmap v279: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:25.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:24 smithi176 ceph-mon[34357]: pgmap v279: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:18:27.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:26 smithi086 ceph-mon[30110]: pgmap v280: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:18:27.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:26 smithi172 ceph-mon[34517]: pgmap v280: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:18:27.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:26 smithi176 ceph-mon[34357]: pgmap v280: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:18:29.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:28 smithi086 ceph-mon[30110]: pgmap v281: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:18:29.228 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:28 smithi172 ceph-mon[34517]: pgmap v281: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:18:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:28 smithi176 ceph-mon[34357]: pgmap v281: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:18:31.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:30 smithi086 ceph-mon[30110]: pgmap v282: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:18:31.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:30 smithi172 ceph-mon[34517]: pgmap v282: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:18:31.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:30 smithi176 ceph-mon[34357]: pgmap v282: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-12T11:18:33.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:32 smithi086 ceph-mon[30110]: pgmap v283: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:33.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:32 smithi172 ceph-mon[34517]: pgmap v283: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:33.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:32 smithi176 ceph-mon[34357]: pgmap v283: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:35.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:34 smithi086 ceph-mon[30110]: pgmap v284: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:35.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:34 smithi172 ceph-mon[34517]: pgmap v284: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:35.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:34 smithi176 ceph-mon[34357]: pgmap v284: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:36.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:35 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:18:36.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:35 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:18:36.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:35 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:18:37.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:36 smithi086 ceph-mon[30110]: pgmap v285: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:37.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:18:37.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:18:37.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:18:37.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:36 smithi172 ceph-mon[34517]: pgmap v285: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:37.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:18:37.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:18:37.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:18:37.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:36 smithi176 ceph-mon[34357]: pgmap v285: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:37.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:18:37.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:18:37.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:18:39.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:38 smithi086 ceph-mon[30110]: pgmap v286: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:39.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:38 smithi172 ceph-mon[34517]: pgmap v286: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:39.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:38 smithi176 ceph-mon[34357]: pgmap v286: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:41.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:40 smithi086 ceph-mon[30110]: pgmap v287: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:41.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:40 smithi172 ceph-mon[34517]: pgmap v287: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:41.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:40 smithi176 ceph-mon[34357]: pgmap v287: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:43.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:42 smithi086 ceph-mon[30110]: pgmap v288: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:43.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:42 smithi172 ceph-mon[34517]: pgmap v288: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:43.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:42 smithi176 ceph-mon[34357]: pgmap v288: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:45.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:44 smithi086 ceph-mon[30110]: pgmap v289: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:45.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:44 smithi172 ceph-mon[34517]: pgmap v289: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:45.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:44 smithi176 ceph-mon[34357]: pgmap v289: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:47.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:46 smithi086 ceph-mon[30110]: pgmap v290: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:47.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:46 smithi172 ceph-mon[34517]: pgmap v290: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:47.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:46 smithi176 ceph-mon[34357]: pgmap v290: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:49.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:48 smithi086 ceph-mon[30110]: pgmap v291: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:49.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:48 smithi172 ceph-mon[34517]: pgmap v291: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:49.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:48 smithi176 ceph-mon[34357]: pgmap v291: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:51.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:50 smithi086 ceph-mon[30110]: pgmap v292: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:51.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:50 smithi172 ceph-mon[34517]: pgmap v292: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:51.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:50 smithi176 ceph-mon[34357]: pgmap v292: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:53.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:52 smithi086 ceph-mon[30110]: pgmap v293: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:53.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:52 smithi172 ceph-mon[34517]: pgmap v293: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:53.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:52 smithi176 ceph-mon[34357]: pgmap v293: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:55.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:54 smithi086 ceph-mon[30110]: pgmap v294: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:55.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:54 smithi172 ceph-mon[34517]: pgmap v294: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:55.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:54 smithi176 ceph-mon[34357]: pgmap v294: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:57.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:56 smithi086 ceph-mon[30110]: pgmap v295: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:57.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:56 smithi172 ceph-mon[34517]: pgmap v295: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:57.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:56 smithi176 ceph-mon[34357]: pgmap v295: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:18:59.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:18:58 smithi086 ceph-mon[30110]: pgmap v296: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:59.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:18:58 smithi172 ceph-mon[34517]: pgmap v296: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:18:59.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:18:58 smithi176 ceph-mon[34357]: pgmap v296: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:01.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:00 smithi086 ceph-mon[30110]: pgmap v297: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:01.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:00 smithi172 ceph-mon[34517]: pgmap v297: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:01.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:00 smithi176 ceph-mon[34357]: pgmap v297: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:03.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:02 smithi086 ceph-mon[30110]: pgmap v298: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:03.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:02 smithi172 ceph-mon[34517]: pgmap v298: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:03.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:02 smithi176 ceph-mon[34357]: pgmap v298: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:05.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:04 smithi086 ceph-mon[30110]: pgmap v299: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:05.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:04 smithi172 ceph-mon[34517]: pgmap v299: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:05.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:04 smithi176 ceph-mon[34357]: pgmap v299: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:07.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:06 smithi086 ceph-mon[30110]: pgmap v300: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:19:07.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:06 smithi172 ceph-mon[34517]: pgmap v300: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:19:07.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:06 smithi176 ceph-mon[34357]: pgmap v300: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:19:09.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:08 smithi086 ceph-mon[30110]: pgmap v301: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:19:09.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:08 smithi172 ceph-mon[34517]: pgmap v301: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:19:09.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:08 smithi176 ceph-mon[34357]: pgmap v301: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:19:11.221 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:10 smithi086 ceph-mon[30110]: pgmap v302: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:19:11.221 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:10 smithi086 ceph-mon[30110]: osdmap e90: 12 total, 12 up, 12 in 2024-05-12T11:19:11.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:10 smithi172 ceph-mon[34517]: pgmap v302: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:19:11.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:10 smithi172 ceph-mon[34517]: osdmap e90: 12 total, 12 up, 12 in 2024-05-12T11:19:11.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:10 smithi176 ceph-mon[34357]: pgmap v302: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:19:11.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:10 smithi176 ceph-mon[34357]: osdmap e90: 12 total, 12 up, 12 in 2024-05-12T11:19:13.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:12 smithi086 ceph-mon[30110]: pgmap v304: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:19:13.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:12 smithi172 ceph-mon[34517]: pgmap v304: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:19:13.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:12 smithi176 ceph-mon[34357]: pgmap v304: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:19:15.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:14 smithi086 ceph-mon[30110]: pgmap v305: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:19:15.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:14 smithi172 ceph-mon[34517]: pgmap v305: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:19:15.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:14 smithi176 ceph-mon[34357]: pgmap v305: 97 pgs: 97 active+clean; 3.1 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-05-12T11:19:17.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:16 smithi086 ceph-mon[30110]: pgmap v306: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:19:17.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:16 smithi172 ceph-mon[34517]: pgmap v306: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:19:17.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:16 smithi176 ceph-mon[34357]: pgmap v306: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:19:19.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:18 smithi086 ceph-mon[30110]: pgmap v307: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:19:19.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:18 smithi172 ceph-mon[34517]: pgmap v307: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:19:19.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:18 smithi176 ceph-mon[34357]: pgmap v307: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-12T11:19:21.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:20 smithi086 ceph-mon[30110]: pgmap v308: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:21.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:20 smithi086 ceph-mon[30110]: osdmap e91: 12 total, 12 up, 12 in 2024-05-12T11:19:21.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:20 smithi172 ceph-mon[34517]: pgmap v308: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:21.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:20 smithi172 ceph-mon[34517]: osdmap e91: 12 total, 12 up, 12 in 2024-05-12T11:19:21.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:20 smithi176 ceph-mon[34357]: pgmap v308: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:21.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:20 smithi176 ceph-mon[34357]: osdmap e91: 12 total, 12 up, 12 in 2024-05-12T11:19:23.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:22 smithi086 ceph-mon[30110]: pgmap v310: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:23.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:22 smithi172 ceph-mon[34517]: pgmap v310: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:23.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:22 smithi176 ceph-mon[34357]: pgmap v310: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:25.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:24 smithi086 ceph-mon[30110]: pgmap v311: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:25.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:24 smithi172 ceph-mon[34517]: pgmap v311: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:25.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:24 smithi176 ceph-mon[34357]: pgmap v311: 97 pgs: 97 active+clean; 3.1 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-05-12T11:19:27.143 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:26 smithi086 ceph-mon[30110]: pgmap v312: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:19:27.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-12T11:19:27.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:26 smithi172 ceph-mon[34517]: pgmap v312: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:19:27.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 -- 172.21.15.86:0/3993842479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701022a0 msgr2=0x7fee7010e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 --2- 172.21.15.86:0/3993842479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701022a0 0x7fee7010e760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fee68009cd0 tx=0x7fee6802a8e0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 -- 172.21.15.86:0/3993842479 shutdown_connections 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 --2- 172.21.15.86:0/3993842479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701022a0 0x7fee7010e760 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 --2- 172.21.15.86:0/3993842479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701018e0 0x7fee70101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 --2- 172.21.15.86:0/3993842479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee701078a0 0x7fee70107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 -- 172.21.15.86:0/3993842479 >> 172.21.15.86:0/3993842479 conn(0x7fee70078a30 msgr2=0x7fee70078e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 -- 172.21.15.86:0/3993842479 shutdown_connections 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 -- 172.21.15.86:0/3993842479 wait complete. 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 Processor -- start 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.264+0000 7fee78445640 1 -- start start 2024-05-12T11:19:27.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee78445640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701018e0 0x7fee70199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee78445640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee701022a0 0x7fee70199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee78445640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701078a0 0x7fee7019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee78445640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fee70112c60 con 0x7fee701078a0 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee78445640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee70112ae0 con 0x7fee701018e0 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee78445640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee70112de0 con 0x7fee701022a0 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701078a0 0x7fee7019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701078a0 0x7fee7019d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45390/0 (socket says 172.21.15.86:45390) 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 -- 172.21.15.86:0/721038795 learned_addr learned my addr 172.21.15.86:0/721038795 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee761e1640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701018e0 0x7fee70199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee759e0640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee701022a0 0x7fee70199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 -- 172.21.15.86:0/721038795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee701022a0 msgr2=0x7fee70199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee701022a0 0x7fee70199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 -- 172.21.15.86:0/721038795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701018e0 msgr2=0x7fee70199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701018e0 0x7fee70199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 -- 172.21.15.86:0/721038795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7019e010 con 0x7fee701078a0 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee759e0640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee701022a0 0x7fee70199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee769e2640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701078a0 0x7fee7019d8e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fee68005cc0 tx=0x7fee68003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee637fe640 1 -- 172.21.15.86:0/721038795 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68004450 con 0x7fee701078a0 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee637fe640 1 -- 172.21.15.86:0/721038795 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee68031c90 con 0x7fee701078a0 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.265+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7019e2a0 con 0x7fee701078a0 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.266+0000 7fee637fe640 1 -- 172.21.15.86:0/721038795 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6803b400 con 0x7fee701078a0 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.266+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee701a5b90 con 0x7fee701078a0 2024-05-12T11:19:27.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.267+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee70050740 con 0x7fee701078a0 2024-05-12T11:19:27.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.268+0000 7fee637fe640 1 -- 172.21.15.86:0/721038795 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fee68004680 con 0x7fee701078a0 2024-05-12T11:19:27.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.268+0000 7fee637fe640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fee5c0b2a90 0x7fee5c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.269+0000 7fee761e1640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fee5c0b2a90 0x7fee5c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.269+0000 7fee637fe640 1 -- 172.21.15.86:0/721038795 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fee6802e030 con 0x7fee701078a0 2024-05-12T11:19:27.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.269+0000 7fee761e1640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fee5c0b2a90 0x7fee5c0b4f50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee6c005fd0 tx=0x7fee6c00b390 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:27.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.273+0000 7fee637fe640 1 -- 172.21.15.86:0/721038795 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fee680cb1b0 con 0x7fee701078a0 2024-05-12T11:19:27.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:26 smithi176 ceph-mon[34357]: pgmap v312: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:19:27.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.477+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fee70104a70 con 0x7fee5c0b2a90 2024-05-12T11:19:27.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.485+0000 7fee637fe640 1 -- 172.21.15.86:0/721038795 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fee70104a70 con 0x7fee5c0b2a90 2024-05-12T11:19:27.482 INFO:teuthology.orchestra.run.smithi086.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-12T00:00:00", "created": "2024-05-12T11:09:26", "first": "2024-05-12T11:10:00", "last": "2024-05-12T11:19:00", "last_pruned": "2024-05-12T11:19:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fee5c0b2a90 msgr2=0x7fee5c0b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fee5c0b2a90 0x7fee5c0b4f50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee6c005fd0 tx=0x7fee6c00b390 comp rx=0 tx=0).stop 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701078a0 msgr2=0x7fee7019d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701078a0 0x7fee7019d8e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fee68005cc0 tx=0x7fee68003c20 comp rx=0 tx=0).stop 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 shutdown_connections 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fee5c0b2a90 0x7fee5c0b4f50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee701078a0 0x7fee7019d8e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee701022a0 0x7fee70199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 --2- 172.21.15.86:0/721038795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701018e0 0x7fee70199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 >> 172.21.15.86:0/721038795 conn(0x7fee70078a30 msgr2=0x7fee70104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:27.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 shutdown_connections 2024-05-12T11:19:27.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.487+0000 7fee78445640 1 -- 172.21.15.86:0/721038795 wait complete. 2024-05-12T11:19:27.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- 172.21.15.86:0/3757777740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241078a0 msgr2=0x7fa024107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 --2- 172.21.15.86:0/3757777740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241078a0 0x7fa024107c80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa014009930 tx=0x7fa01402a420 comp rx=0 tx=0).stop 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- 172.21.15.86:0/3757777740 shutdown_connections 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 --2- 172.21.15.86:0/3757777740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0241022a0 0x7fa02410e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 --2- 172.21.15.86:0/3757777740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0241018e0 0x7fa024101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 --2- 172.21.15.86:0/3757777740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241078a0 0x7fa024107c80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- 172.21.15.86:0/3757777740 >> 172.21.15.86:0/3757777740 conn(0x7fa024078a30 msgr2=0x7fa024078e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- 172.21.15.86:0/3757777740 shutdown_connections 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- 172.21.15.86:0/3757777740 wait complete. 2024-05-12T11:19:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 Processor -- start 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- start start 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241018e0 0x7fa0241990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0241022a0 0x7fa024199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0241078a0 0x7fa02419d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa024112c60 con 0x7fa0241018e0 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa024112ae0 con 0x7fa0241022a0 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.601+0000 7fa02ac93640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa024112de0 con 0x7fa0241078a0 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241018e0 0x7fa0241990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241018e0 0x7fa0241990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45416/0 (socket says 172.21.15.86:45416) 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 -- 172.21.15.86:0/1413828626 learned_addr learned my addr 172.21.15.86:0/1413828626 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa023fff640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0241022a0 0x7fa024199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa029230640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0241078a0 0x7fa02419d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 -- 172.21.15.86:0/1413828626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0241078a0 msgr2=0x7fa02419d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0241078a0 0x7fa02419d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 -- 172.21.15.86:0/1413828626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0241022a0 msgr2=0x7fa024199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0241022a0 0x7fa024199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 -- 172.21.15.86:0/1413828626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02419e0d0 con 0x7fa0241018e0 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa023fff640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0241022a0 0x7fa024199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa029230640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0241078a0 0x7fa02419d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa028a2f640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241018e0 0x7fa0241990e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa014005940 tx=0x7fa0140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa021ffb640 1 -- 172.21.15.86:0/1413828626 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01403f030 con 0x7fa0241018e0 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa021ffb640 1 -- 172.21.15.86:0/1413828626 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa014003cb0 con 0x7fa0241018e0 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02419e360 con 0x7fa0241018e0 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa021ffb640 1 -- 172.21.15.86:0/1413828626 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014035070 con 0x7fa0241018e0 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.602+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0241a5c50 con 0x7fa0241018e0 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.603+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa024050740 con 0x7fa0241018e0 2024-05-12T11:19:27.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.605+0000 7fa021ffb640 1 -- 172.21.15.86:0/1413828626 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fa014042030 con 0x7fa0241018e0 2024-05-12T11:19:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.605+0000 7fa021ffb640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa00c0b2a10 0x7fa00c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.605+0000 7fa023fff640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa00c0b2a10 0x7fa00c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.605+0000 7fa021ffb640 1 -- 172.21.15.86:0/1413828626 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fa014102ee0 con 0x7fa0241018e0 2024-05-12T11:19:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.606+0000 7fa023fff640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa00c0b2a10 0x7fa00c0b4ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0240790e0 tx=0x7fa018009500 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.610+0000 7fa021ffb640 1 -- 172.21.15.86:0/1413828626 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa0140ca890 con 0x7fa0241018e0 2024-05-12T11:19:27.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.814+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 --> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fa024109e70 con 0x7fa00c0b2a10 2024-05-12T11:19:27.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.821+0000 7fa021ffb640 1 -- 172.21.15.86:0/1413828626 <== mgr.24749 v2:172.21.15.86:6800/3529939097 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fa018009c80 con 0x7fa00c0b2a10 2024-05-12T11:19:27.818 INFO:teuthology.orchestra.run.smithi086.stdout:/ 1m 6m3h 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa00c0b2a10 msgr2=0x7fa00c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa00c0b2a10 0x7fa00c0b4ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0240790e0 tx=0x7fa018009500 comp rx=0 tx=0).stop 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241018e0 msgr2=0x7fa0241990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241018e0 0x7fa0241990e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa014005940 tx=0x7fa0140042f0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 shutdown_connections 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa00c0b2a10 0x7fa00c0b4ed0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0241078a0 0x7fa02419d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0241022a0 0x7fa024199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 --2- 172.21.15.86:0/1413828626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0241018e0 0x7fa0241990e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 >> 172.21.15.86:0/1413828626 conn(0x7fa024078a30 msgr2=0x7fa024104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:27.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 shutdown_connections 2024-05-12T11:19:27.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.823+0000 7fa02ac93640 1 -- 172.21.15.86:0/1413828626 wait complete. 2024-05-12T11:19:27.832 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-12T11:19:27.844 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 -- 172.21.15.86:0/1433116206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45341079b0 msgr2=0x7f4534107d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 --2- 172.21.15.86:0/1433116206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45341079b0 0x7f4534107d90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4524009900 tx=0x7f452402a410 comp rx=0 tx=0).stop 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 -- 172.21.15.86:0/1433116206 shutdown_connections 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 --2- 172.21.15.86:0/1433116206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453406a500 0x7f453410f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 --2- 172.21.15.86:0/1433116206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4534069b40 0x7f4534069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 --2- 172.21.15.86:0/1433116206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45341079b0 0x7f4534107d90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 -- 172.21.15.86:0/1433116206 >> 172.21.15.86:0/1433116206 conn(0x7f4534078890 msgr2=0x7f4534078ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 -- 172.21.15.86:0/1433116206 shutdown_connections 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 -- 172.21.15.86:0/1433116206 wait complete. 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 Processor -- start 2024-05-12T11:19:27.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.948+0000 7f4539d19640 1 -- start start 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4539d19640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4534069b40 0x7f4534101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4539d19640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453406a500 0x7f4534102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4539d19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45341079b0 0x7f4534102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4539d19640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4534112bf0 con 0x7f4534069b40 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4539d19640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4534112a70 con 0x7f45341079b0 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4539d19640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4534112d70 con 0x7f453406a500 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4534069b40 0x7f4534101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4534069b40 0x7f4534101cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45428/0 (socket says 172.21.15.86:45428) 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 -- 172.21.15.86:0/667304018 learned_addr learned my addr 172.21.15.86:0/667304018 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4533fff640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45341079b0 0x7f4534102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f452bfff640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453406a500 0x7f4534102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 -- 172.21.15.86:0/667304018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453406a500 msgr2=0x7f4534102210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453406a500 0x7f4534102210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 -- 172.21.15.86:0/667304018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45341079b0 msgr2=0x7f4534102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45341079b0 0x7f4534102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 -- 172.21.15.86:0/667304018 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45341a7510 con 0x7f4534069b40 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f452bfff640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453406a500 0x7f4534102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45337fe640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4534069b40 0x7f4534101cd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4524006010 tx=0x7f45240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45317fa640 1 -- 172.21.15.86:0/667304018 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452403f030 con 0x7f4534069b40 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45317fa640 1 -- 172.21.15.86:0/667304018 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4524003cb0 con 0x7f4534069b40 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45341a77a0 con 0x7f4534069b40 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f45317fa640 1 -- 172.21.15.86:0/667304018 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4524035070 con 0x7f4534069b40 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.949+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45341a7c90 con 0x7f4534069b40 2024-05-12T11:19:27.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.950+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4534069840 con 0x7f4534069b40 2024-05-12T11:19:27.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.952+0000 7f45317fa640 1 -- 172.21.15.86:0/667304018 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4524042030 con 0x7f4534069b40 2024-05-12T11:19:27.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.952+0000 7f45317fa640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f45200b2990 0x7f45200b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:27.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.952+0000 7f452bfff640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f45200b2990 0x7f45200b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:27.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.952+0000 7f45317fa640 1 -- 172.21.15.86:0/667304018 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f4524102cf0 con 0x7f4534069b40 2024-05-12T11:19:27.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.953+0000 7f452bfff640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f45200b2990 0x7f45200b4e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f451c0058c0 tx=0x7f451c005850 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:27.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:27.956+0000 7f45317fa640 1 -- 172.21.15.86:0/667304018 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f45240ca6a0 con 0x7f4534069b40 2024-05-12T11:19:28.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.137+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f453402db50 con 0x7f4534069b40 2024-05-12T11:19:28.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.139+0000 7f45317fa640 1 -- 172.21.15.86:0/667304018 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23212 (secure 0 0 0) 0x7f45240c9fa0 con 0x7f4534069b40 2024-05-12T11:19:28.137 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:19:28.137 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":91,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:19:19.878920+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/155657181":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/2138389102":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/2852030835":"2024-05-13T11:09:23.662823+0000","172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3505671883":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/155657181":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/4229502845":"2024-05-13T11:09:23.662823+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:19:28.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f45200b2990 msgr2=0x7f45200b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f45200b2990 0x7f45200b4e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f451c0058c0 tx=0x7f451c005850 comp rx=0 tx=0).stop 2024-05-12T11:19:28.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4534069b40 msgr2=0x7f4534101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4534069b40 0x7f4534101cd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4524006010 tx=0x7f45240042f0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 shutdown_connections 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f45200b2990 0x7f45200b4e50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45341079b0 0x7f4534102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453406a500 0x7f4534102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 --2- 172.21.15.86:0/667304018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4534069b40 0x7f4534101cd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 >> 172.21.15.86:0/667304018 conn(0x7f4534078890 msgr2=0x7f45340ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 shutdown_connections 2024-05-12T11:19:28.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.141+0000 7f4539d19640 1 -- 172.21.15.86:0/667304018 wait complete. 2024-05-12T11:19:28.150 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-12T11:01:12.074132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-12T11:06:00.763348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-12T11:06:04.018363+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 90, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-12T11:19:28.150 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-12T11:19:28.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 -- 172.21.15.86:0/3460139973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006b970 msgr2=0x7f027010f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 --2- 172.21.15.86:0/3460139973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006b970 0x7f027010f890 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f026c009900 tx=0x7f026c02a480 comp rx=0 tx=0).stop 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 -- 172.21.15.86:0/3460139973 shutdown_connections 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 --2- 172.21.15.86:0/3460139973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006b970 0x7f027010f890 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 --2- 172.21.15.86:0/3460139973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f027006afd0 0x7f027006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 --2- 172.21.15.86:0/3460139973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0270108a90 0x7f0270108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 -- 172.21.15.86:0/3460139973 >> 172.21.15.86:0/3460139973 conn(0x7f0270078890 msgr2=0x7f0270078ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 -- 172.21.15.86:0/3460139973 shutdown_connections 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.256+0000 7f02777c1640 1 -- 172.21.15.86:0/3460139973 wait complete. 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f02777c1640 1 Processor -- start 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f02777c1640 1 -- start start 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f02777c1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006afd0 0x7f02701990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f02777c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027006b970 0x7f0270199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f02777c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0270108a90 0x7f027019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f02777c1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0270112cc0 con 0x7f027006afd0 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f02777c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0270112b40 con 0x7f027006b970 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f02777c1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0270112e40 con 0x7f0270108a90 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f027555d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006afd0 0x7f02701990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f027555d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006afd0 0x7f02701990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45458/0 (socket says 172.21.15.86:45458) 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f027555d640 1 -- 172.21.15.86:0/1775797250 learned_addr learned my addr 172.21.15.86:0/1775797250 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f0275d5e640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0270108a90 0x7f027019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f0274d5c640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027006b970 0x7f0270199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f027555d640 1 -- 172.21.15.86:0/1775797250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0270108a90 msgr2=0x7f027019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f027555d640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0270108a90 0x7f027019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f027555d640 1 -- 172.21.15.86:0/1775797250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027006b970 msgr2=0x7f0270199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f027555d640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027006b970 0x7f0270199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f027555d640 1 -- 172.21.15.86:0/1775797250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027019e080 con 0x7f027006afd0 2024-05-12T11:19:28.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.257+0000 7f0274d5c640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027006b970 0x7f0270199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:19:28.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.258+0000 7f027555d640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006afd0 0x7f02701990e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f026800cce0 tx=0x7f026800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:28.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.258+0000 7f02667fc640 1 -- 172.21.15.86:0/1775797250 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026800f650 con 0x7f027006afd0 2024-05-12T11:19:28.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.258+0000 7f02667fc640 1 -- 172.21.15.86:0/1775797250 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f026800fca0 con 0x7f027006afd0 2024-05-12T11:19:28.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.258+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027019e370 con 0x7f027006afd0 2024-05-12T11:19:28.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.258+0000 7f02667fc640 1 -- 172.21.15.86:0/1775797250 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268018b40 con 0x7f027006afd0 2024-05-12T11:19:28.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.258+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02701a5c00 con 0x7f027006afd0 2024-05-12T11:19:28.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.259+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0270069c20 con 0x7f027006afd0 2024-05-12T11:19:28.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.261+0000 7f02667fc640 1 -- 172.21.15.86:0/1775797250 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f0268018d00 con 0x7f027006afd0 2024-05-12T11:19:28.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.261+0000 7f02667fc640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f025c0b2960 0x7f025c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.262+0000 7f0274d5c640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f025c0b2960 0x7f025c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.262+0000 7f02667fc640 1 -- 172.21.15.86:0/1775797250 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f02680e2e60 con 0x7f027006afd0 2024-05-12T11:19:28.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.262+0000 7f0274d5c640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f025c0b2960 0x7f025c0b4e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0270108000 tx=0x7f0260005e50 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:28.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.265+0000 7f02667fc640 1 -- 172.21.15.86:0/1775797250 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0268014030 con 0x7f027006afd0 2024-05-12T11:19:28.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.448+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f027010af10 con 0x7f027006afd0 2024-05-12T11:19:28.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.448+0000 7f02667fc640 1 -- 172.21.15.86:0/1775797250 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f02680aa8a0 con 0x7f027006afd0 2024-05-12T11:19:28.446 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-05-12T11:19:28.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f025c0b2960 msgr2=0x7f025c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f025c0b2960 0x7f025c0b4e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0270108000 tx=0x7f0260005e50 comp rx=0 tx=0).stop 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006afd0 msgr2=0x7f02701990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006afd0 0x7f02701990e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f026800cce0 tx=0x7f026800a620 comp rx=0 tx=0).stop 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 shutdown_connections 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f025c0b2960 0x7f025c0b4e20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0270108a90 0x7f027019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027006b970 0x7f0270199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 --2- 172.21.15.86:0/1775797250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f027006afd0 0x7f02701990e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 >> 172.21.15.86:0/1775797250 conn(0x7f0270078890 msgr2=0x7f0270100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 shutdown_connections 2024-05-12T11:19:28.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.451+0000 7f02777c1640 1 -- 172.21.15.86:0/1775797250 wait complete. 2024-05-12T11:19:28.460 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-12T11:19:28.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 -- 172.21.15.86:0/4032064319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b01078a0 msgr2=0x7f76b0107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 --2- 172.21.15.86:0/4032064319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b01078a0 0x7f76b0107c80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009930 tx=0x7f76a002a420 comp rx=0 tx=0).stop 2024-05-12T11:19:28.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 -- 172.21.15.86:0/4032064319 shutdown_connections 2024-05-12T11:19:28.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 --2- 172.21.15.86:0/4032064319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76b0102250 0x7f76b010e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 --2- 172.21.15.86:0/4032064319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b0101890 0x7f76b0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 --2- 172.21.15.86:0/4032064319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b01078a0 0x7f76b0107c80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 -- 172.21.15.86:0/4032064319 >> 172.21.15.86:0/4032064319 conn(0x7f76b0077c30 msgr2=0x7f76b0078040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:28.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 -- 172.21.15.86:0/4032064319 shutdown_connections 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 -- 172.21.15.86:0/4032064319 wait complete. 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 Processor -- start 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.566+0000 7f76b6a33640 1 -- start start 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b6a33640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b0101890 0x7f76b019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b6a33640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b0102250 0x7f76b019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b6a33640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76b01078a0 0x7f76b01a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b6a33640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76b0111b20 con 0x7f76b0101890 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b6a33640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76b01119a0 con 0x7f76b0102250 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b6a33640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76b0111ca0 con 0x7f76b01078a0 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b0101890 0x7f76b019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b0101890 0x7f76b019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45476/0 (socket says 172.21.15.86:45476) 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 -- 172.21.15.86:0/1673763971 learned_addr learned my addr 172.21.15.86:0/1673763971 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76af7fe640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b0102250 0x7f76b019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b4fd0640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76b01078a0 0x7f76b01a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 -- 172.21.15.86:0/1673763971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76b01078a0 msgr2=0x7f76b01a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76b01078a0 0x7f76b01a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 -- 172.21.15.86:0/1673763971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b0102250 msgr2=0x7f76b019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b0102250 0x7f76b019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 -- 172.21.15.86:0/1673763971 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b01a55c0 con 0x7f76b0101890 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76affff640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b0101890 0x7f76b019a000 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f76a0004770 tx=0x7f76a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76ad7fa640 1 -- 172.21.15.86:0/1673763971 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a003f070 con 0x7f76b0101890 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76ad7fa640 1 -- 172.21.15.86:0/1673763971 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a003b460 con 0x7f76b0101890 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b01a5790 con 0x7f76b0101890 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76ad7fa640 1 -- 172.21.15.86:0/1673763971 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0035070 con 0x7f76b0101890 2024-05-12T11:19:28.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.567+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b01a5bf0 con 0x7f76b0101890 2024-05-12T11:19:28.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.568+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b0069c20 con 0x7f76b0101890 2024-05-12T11:19:28.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.570+0000 7f76ad7fa640 1 -- 172.21.15.86:0/1673763971 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f76a003b8d0 con 0x7f76b0101890 2024-05-12T11:19:28.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.570+0000 7f76ad7fa640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f769c0b2960 0x7f769c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.571+0000 7f76af7fe640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f769c0b2960 0x7f769c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.571+0000 7f76ad7fa640 1 -- 172.21.15.86:0/1673763971 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f76a0102c70 con 0x7f76b0101890 2024-05-12T11:19:28.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.571+0000 7f76af7fe640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f769c0b2960 0x7f769c0b4e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f76b006bb40 tx=0x7f769800b390 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:28.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.574+0000 7f76ad7fa640 1 -- 172.21.15.86:0/1673763971 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f76a00ca620 con 0x7f76b0101890 2024-05-12T11:19:28.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.755+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f76b0109870 con 0x7f76b0101890 2024-05-12T11:19:28.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.756+0000 7f76ad7fa640 1 -- 172.21.15.86:0/1673763971 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f76a00c9f20 con 0x7f76b0101890 2024-05-12T11:19:28.753 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-05-12T11:19:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f769c0b2960 msgr2=0x7f769c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f769c0b2960 0x7f769c0b4e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f76b006bb40 tx=0x7f769800b390 comp rx=0 tx=0).stop 2024-05-12T11:19:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b0101890 msgr2=0x7f76b019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b0101890 0x7f76b019a000 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f76a0004770 tx=0x7f76a00042f0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 shutdown_connections 2024-05-12T11:19:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f769c0b2960 0x7f769c0b4e20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76b01078a0 0x7f76b01a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b0102250 0x7f76b019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 --2- 172.21.15.86:0/1673763971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76b0101890 0x7f76b019a000 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 >> 172.21.15.86:0/1673763971 conn(0x7f76b0077c30 msgr2=0x7f76b00ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 shutdown_connections 2024-05-12T11:19:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.758+0000 7f76b6a33640 1 -- 172.21.15.86:0/1673763971 wait complete. 2024-05-12T11:19:28.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-12T11:19:28.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 -- 172.21.15.86:0/1096452003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f010cf70 msgr2=0x7fd2f010f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 --2- 172.21.15.86:0/1096452003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f010cf70 0x7fd2f010f410 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009900 tx=0x7fd2e802a510 comp rx=0 tx=0).stop 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 -- 172.21.15.86:0/1096452003 shutdown_connections 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 --2- 172.21.15.86:0/1096452003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f010cf70 0x7fd2f010f410 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 --2- 172.21.15.86:0/1096452003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0104550 0x7fd2f010ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 --2- 172.21.15.86:0/1096452003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2f0103c30 0x7fd2f0104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 -- 172.21.15.86:0/1096452003 >> 172.21.15.86:0/1096452003 conn(0x7fd2f00789b0 msgr2=0x7fd2f0078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 -- 172.21.15.86:0/1096452003 shutdown_connections 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 -- 172.21.15.86:0/1096452003 wait complete. 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 Processor -- start 2024-05-12T11:19:28.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.872+0000 7fd2f6045640 1 -- start start 2024-05-12T11:19:28.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2f6045640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103c30 0x7fd2f0199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2f6045640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f0104550 0x7fd2f01996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2f6045640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2f010cf70 0x7fd2f019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2f6045640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0112c20 con 0x7fd2f0104550 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2f6045640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0112aa0 con 0x7fd2f0103c30 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2f6045640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0112da0 con 0x7fd2f010cf70 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f0104550 0x7fd2f01996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f0104550 0x7fd2f01996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45488/0 (socket says 172.21.15.86:45488) 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 -- 172.21.15.86:0/997662080 learned_addr learned my addr 172.21.15.86:0/997662080 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2ef7fe640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103c30 0x7fd2f0199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2effff640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2f010cf70 0x7fd2f019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 -- 172.21.15.86:0/997662080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2f010cf70 msgr2=0x7fd2f019da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2f010cf70 0x7fd2f019da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 -- 172.21.15.86:0/997662080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103c30 msgr2=0x7fd2f0199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103c30 0x7fd2f0199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 -- 172.21.15.86:0/997662080 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f019e150 con 0x7fd2f0104550 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2eeffd640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f0104550 0x7fd2f01996a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e9f0 tx=0x7fd2e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2ecff9640 1 -- 172.21.15.86:0/997662080 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e400cd80 con 0x7fd2f0104550 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2ecff9640 1 -- 172.21.15.86:0/997662080 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2e40108e0 con 0x7fd2f0104550 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2ecff9640 1 -- 172.21.15.86:0/997662080 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4018980 con 0x7fd2f0104550 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f019e440 con 0x7fd2f0104550 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.873+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f01a5cd0 con 0x7fd2f0104550 2024-05-12T11:19:28.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.874+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f00697d0 con 0x7fd2f0104550 2024-05-12T11:19:28.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.876+0000 7fd2ecff9640 1 -- 172.21.15.86:0/997662080 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fd2e4010430 con 0x7fd2f0104550 2024-05-12T11:19:28.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.876+0000 7fd2ecff9640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2d80b2960 0x7fd2d80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:28.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.876+0000 7fd2ef7fe640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2d80b2960 0x7fd2d80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:28.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.877+0000 7fd2ecff9640 1 -- 172.21.15.86:0/997662080 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fd2e40e2dc0 con 0x7fd2f0104550 2024-05-12T11:19:28.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.877+0000 7fd2ef7fe640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2d80b2960 0x7fd2d80b4e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0005fd0 tx=0x7fd2e0009680 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:28.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:28.880+0000 7fd2ecff9640 1 -- 172.21.15.86:0/997662080 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd2e40aa120 con 0x7fd2f0104550 2024-05-12T11:19:29.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.063+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd2f01080f0 con 0x7fd2f0104550 2024-05-12T11:19:29.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.064+0000 7fd2ecff9640 1 -- 172.21.15.86:0/997662080 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fd2e40ae420 con 0x7fd2f0104550 2024-05-12T11:19:29.061 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-05-12T11:19:29.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2d80b2960 msgr2=0x7fd2d80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:29.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2d80b2960 0x7fd2d80b4e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0005fd0 tx=0x7fd2e0009680 comp rx=0 tx=0).stop 2024-05-12T11:19:29.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f0104550 msgr2=0x7fd2f01996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:29.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f0104550 0x7fd2f01996a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e9f0 tx=0x7fd2e400eeb0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 shutdown_connections 2024-05-12T11:19:29.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fd2d80b2960 0x7fd2d80b4e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2f010cf70 0x7fd2f019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2f0104550 0x7fd2f01996a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 --2- 172.21.15.86:0/997662080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103c30 0x7fd2f0199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 >> 172.21.15.86:0/997662080 conn(0x7fd2f00789b0 msgr2=0x7fd2f00fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:29.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 shutdown_connections 2024-05-12T11:19:29.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.066+0000 7fd2f6045640 1 -- 172.21.15.86:0/997662080 wait complete. 2024-05-12T11:19:29.073 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:28 smithi086 ceph-mon[30110]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:19:29.073 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:28 smithi086 ceph-mon[30110]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:19:29.073 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:28 smithi086 ceph-mon[30110]: pgmap v313: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:19:29.073 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:28 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/667304018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:19:29.073 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:28 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1775797250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-12T11:19:29.073 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:28 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1673763971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-12T11:19:29.074 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 -- 172.21.15.86:0/1151962007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254104530 msgr2=0x7f225410ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 --2- 172.21.15.86:0/1151962007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254104530 0x7f225410ca10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2240009900 tx=0x7f224002a480 comp rx=0 tx=0).stop 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 -- 172.21.15.86:0/1151962007 shutdown_connections 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 --2- 172.21.15.86:0/1151962007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f225410cfe0 0x7f225410f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 --2- 172.21.15.86:0/1151962007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254104530 0x7f225410ca10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 --2- 172.21.15.86:0/1151962007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2254103c10 0x7f2254103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 -- 172.21.15.86:0/1151962007 >> 172.21.15.86:0/1151962007 conn(0x7f2254077c30 msgr2=0x7f2254078040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 -- 172.21.15.86:0/1151962007 shutdown_connections 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.177+0000 7f225b237640 1 -- 172.21.15.86:0/1151962007 wait complete. 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f225b237640 1 Processor -- start 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f225b237640 1 -- start start 2024-05-12T11:19:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f225b237640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103c10 0x7f22541991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f225b237640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2254104530 0x7f2254199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f225b237640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f225410cfe0 0x7f225419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f225b237640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2254112c20 con 0x7f2254103c10 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f225b237640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2254112aa0 con 0x7f2254104530 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f225b237640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2254112da0 con 0x7f225410cfe0 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2258fd3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103c10 0x7f22541991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2258fd3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103c10 0x7f22541991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45506/0 (socket says 172.21.15.86:45506) 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2258fd3640 1 -- 172.21.15.86:0/1882407969 learned_addr learned my addr 172.21.15.86:0/1882407969 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2253fff640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2254104530 0x7f2254199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2258fd3640 1 -- 172.21.15.86:0/1882407969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f225410cfe0 msgr2=0x7f225419daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2258fd3640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f225410cfe0 0x7f225419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2258fd3640 1 -- 172.21.15.86:0/1882407969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2254104530 msgr2=0x7f2254199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2258fd3640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2254104530 0x7f2254199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2258fd3640 1 -- 172.21.15.86:0/1882407969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225419e1d0 con 0x7f2254103c10 2024-05-12T11:19:29.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.178+0000 7f2253fff640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2254104530 0x7f2254199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:19:29.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.179+0000 7f2258fd3640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103c10 0x7f22541991e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f224800c920 tx=0x7f224800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:29.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.179+0000 7f2251ffb640 1 -- 172.21.15.86:0/1882407969 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248007c70 con 0x7f2254103c10 2024-05-12T11:19:29.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.179+0000 7f2251ffb640 1 -- 172.21.15.86:0/1882407969 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2248007e10 con 0x7f2254103c10 2024-05-12T11:19:29.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.179+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225419e4c0 con 0x7f2254103c10 2024-05-12T11:19:29.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.179+0000 7f2251ffb640 1 -- 172.21.15.86:0/1882407969 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248018820 con 0x7f2254103c10 2024-05-12T11:19:29.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.179+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541a5d50 con 0x7f2254103c10 2024-05-12T11:19:29.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.180+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2254069c20 con 0x7f2254103c10 2024-05-12T11:19:29.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.181+0000 7f2251ffb640 1 -- 172.21.15.86:0/1882407969 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f224800f450 con 0x7f2254103c10 2024-05-12T11:19:29.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.182+0000 7f2251ffb640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f22440b2960 0x7f22440b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:19:29.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.182+0000 7f2253fff640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f22440b2960 0x7f22440b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:19:29.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.182+0000 7f2251ffb640 1 -- 172.21.15.86:0/1882407969 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f22480e2ae0 con 0x7f2254103c10 2024-05-12T11:19:29.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.182+0000 7f2253fff640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f22440b2960 0x7f22440b4e20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2240031440 tx=0x7f2240005a20 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:19:29.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.185+0000 7f2251ffb640 1 -- 172.21.15.86:0/1882407969 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2248014030 con 0x7f2254103c10 2024-05-12T11:19:29.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:28 smithi172 ceph-mon[34517]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:19:29.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:28 smithi172 ceph-mon[34517]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:19:29.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:28 smithi172 ceph-mon[34517]: pgmap v313: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:19:29.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:28 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/667304018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:19:29.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:28 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1775797250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-12T11:19:29.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:28 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1673763971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-12T11:19:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:28 smithi176 ceph-mon[34357]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:19:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:28 smithi176 ceph-mon[34357]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-12T11:19:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:28 smithi176 ceph-mon[34357]: pgmap v313: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-12T11:19:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:28 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/667304018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:19:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:28 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1775797250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-12T11:19:29.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:28 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1673763971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-12T11:19:29.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.415+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f225419a530 con 0x7f2254103c10 2024-05-12T11:19:29.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.423+0000 7f2251ffb640 1 -- 172.21.15.86:0/1882407969 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+816175 (secure 0 0 0) 0x7f22480aa520 con 0x7f2254103c10 2024-05-12T11:19:29.431 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:19:29.431 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:19:29.431 INFO:teuthology.orchestra.run.smithi086.stdout: "epoch": 26, 2024-05-12T11:19:29.431 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "active_gid": 24749, 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "active_name": "x", 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "active_addrs": { 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:6800", 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3529939097 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:6801", 2024-05-12T11:19:29.432 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3529939097 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "active_addr": "172.21.15.86:6801/3529939097", 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "active_change": "2024-05-12T11:09:23.663039+0000", 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "active_mgr_features": 4540701547738038271, 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "available": true, 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "standbys": [ 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "gid": 24746, 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "y", 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_features": 4540701547738038271, 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "available_modules": [ 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.433 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "alerts", 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.434 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How frequently to reexamine health status", 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.435 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.436 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.437 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.438 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.439 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_destination": { 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_destination", 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.440 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email address to send alerts to", 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_from_name": { 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_from_name", 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "Ceph", 2024-05-12T11:19:29.441 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email From: name", 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_host": { 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_host", 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP server", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_password": { 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_password", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.443 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Password to authenticate with", 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_port": { 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_port", 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "465", 2024-05-12T11:19:29.444 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP port", 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_sender": { 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_sender", 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.445 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP envelope sender", 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_ssl": { 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_ssl", 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.446 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_user": { 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_user", 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.447 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "User to authenticate as", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.448 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "balancer", 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.449 INFO:teuthology.orchestra.run.smithi086.stdout: "active": { 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "active", 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically balance PGs across cluster", 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.450 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_time": { 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_time", 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0000", 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "beginning time of day to automatically balance", 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.451 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_weekday": { 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_weekday", 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-12T11:19:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_max_iterations": { 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_max_iterations", 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "25", 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "250", 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.453 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_metrics": { 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_metrics", 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "pgs,objects,bytes", 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.454 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_step": { 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_step", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.5", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0.001", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "0.999", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "aggressiveness of optimization", 2024-05-12T11:19:29.455 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "end_time": { 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_time", 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2359", 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ending time of day to automatically balance", 2024-05-12T11:19:29.456 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "end_weekday": { 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_weekday", 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.457 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.458 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.459 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.461 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.462 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "min_score": { 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_score", 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "upmap", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "crush-compat", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "none", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "read", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap-read" 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Balancer mode", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.465 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_ids": { 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_ids", 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-12T11:19:29.466 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-12T11:19:29.467 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.468 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_deviation": { 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_deviation", 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.469 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_optimizations": { 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_optimizations", 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.470 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm", 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.471 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_down_multiplier": { 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_down_multiplier", 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.472 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_refresh_rate": { 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_refresh_rate", 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "20", 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.473 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_starting_port": { 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_starting_port", 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4721", 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.474 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_ptrace": { 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_ptrace", 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-12T11:19:29.475 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_interval": { 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_interval", 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.476 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_memory_target_ratio": { 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_memory_target_ratio", 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.7", 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.477 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm_log_destination": { 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm_log_destination", 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "file", 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "file,syslog", 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: "syslog" 2024-05-12T11:19:29.478 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "cgroups_split": { 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cgroups_split", 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.479 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "config_checks_enabled": { 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_checks_enabled", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-12T11:19:29.480 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "config_dashboard": { 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_dashboard", 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-12T11:19:29.481 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_alertmanager": { 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_alertmanager", 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.482 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_base": { 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_base", 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.483 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Container image name, without the tag", 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_elasticsearch": { 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_elasticsearch", 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.484 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "elasticsearch container image", 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_grafana": { 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_grafana", 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.485 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_haproxy": { 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_haproxy", 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-12T11:19:29.486 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "HAproxy container image", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_agent": { 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_agent", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger agent container image", 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_collector": { 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_collector", 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.488 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger collector container image", 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_query": { 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_query", 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.489 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger query container image", 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_keepalived": { 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_keepalived", 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.490 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Keepalived container image", 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.491 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.492 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_loki": { 2024-05-12T11:19:29.492 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_loki", 2024-05-12T11:19:29.492 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.492 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.492 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Loki container image", 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.493 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_node_exporter": { 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_node_exporter", 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_nvmeof": { 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_nvmeof", 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Nvme-of container image", 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.495 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_prometheus": { 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_prometheus", 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.496 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_promtail": { 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_promtail", 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Promtail container image", 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.497 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_samba": { 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_samba", 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Samba/SMB container image", 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.498 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_snmp_gateway": { 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_snmp_gateway", 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SNMP Gateway container image", 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.499 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "container_init": { 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_init", 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Run podman/docker with `--init`", 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.500 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "daemon_cache_timeout": { 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "daemon_cache_timeout", 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.501 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "default_cephadm_command_timeout": { 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_cephadm_command_timeout", 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "900", 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.502 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "default_registry": { 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_registry", 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io", 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.503 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "device_cache_timeout": { 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_cache_timeout", 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1800", 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache device inventory", 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.504 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "device_enhanced_scan": { 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_enhanced_scan", 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.505 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "facts_cache_timeout": { 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "facts_cache_timeout", 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache host facts data", 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "grafana_dashboards_path": { 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "grafana_dashboards_path", 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "host_check_interval": { 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "host_check_interval", 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to perform a host check", 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "hw_monitoring": { 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hw_monitoring", 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "inventory_list_all": { 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "inventory_list_all", 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.510 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.511 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "log_refresh_metadata": { 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_refresh_metadata", 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.512 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.513 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.514 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.515 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.516 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.517 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "*", 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "max_count_per_host": { 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_count_per_host", 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of daemons per service per host", 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "max_osd_draining_count": { 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_osd_draining_count", 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.520 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "migration_current": { 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "migration_current", 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "internal - do not modify", 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "root", 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm-package", 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "root" 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.522 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "mode for remote execution of cephadm", 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "oob_default_addr": { 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "oob_default_addr", 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "169.254.1.1", 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.523 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "prometheus_alerts_path": { 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus_alerts_path", 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_insecure": { 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_insecure", 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_password": { 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_password", 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.526 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_url": { 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_url", 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.527 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_username": { 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_username", 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.528 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "secure_monitoring_stack": { 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "secure_monitoring_stack", 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.529 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "service_discovery_port": { 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "service_discovery_port", 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8765", 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.530 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "cephadm service discovery port", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.531 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "ssh_config_file": { 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssh_config_file", 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-12T11:19:29.532 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "use_agent": { 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_agent", 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-12T11:19:29.533 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "use_repo_digest": { 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_repo_digest", 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-12T11:19:29.534 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_failed_host_check": { 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_failed_host_check", 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.535 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if the host check fails", 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_daemons": { 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_daemons", 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.536 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_hosts": { 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_hosts", 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.537 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crash", 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.538 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.539 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.540 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.541 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.542 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "retain_interval": { 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retain_interval", 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "31536000", 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_recent_interval": { 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_recent_interval", 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1209600", 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dashboard", 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.546 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.547 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_HOST": { 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.548 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.549 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_ENABLED": { 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_ENABLED", 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.550 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.551 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "ENABLE_BROWSABLE_API": { 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.553 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.554 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.555 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.556 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.557 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.560 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_PASSWORD": { 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-12T11:19:29.561 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_URL": { 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_URL", 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.563 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_USERNAME": { 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.564 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.565 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.566 INFO:teuthology.orchestra.run.smithi086.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-12T11:19:29.567 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-12T11:19:29.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "[]", 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "MULTICLUSTER_CONFIG": { 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-12T11:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "{}", 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_HOST": { 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-12T11:19:29.570 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.571 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.572 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.573 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.574 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.575 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.576 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.577 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.578 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_ENABLED": { 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.579 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.580 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.581 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8", 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.582 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "45", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.583 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ACCESS_KEY": { 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.584 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.585 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SECRET_KEY": { 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.586 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SSL_VERIFY": { 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.587 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "UNSAFE_TLS_v1_2": { 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.588 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.589 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.590 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.591 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "cross_origin_url": { 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cross_origin_url", 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.592 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "crt_file": { 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crt_file", 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.593 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "debug": { 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "debug", 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable/disable debug options", 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.594 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "jwt_token_ttl": { 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "jwt_token_ttl", 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "28800", 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.596 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.597 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.598 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.599 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.600 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "motd": { 2024-05-12T11:19:29.601 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "motd", 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "The message of the day", 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect_resolve_ip_addr": { 2024-05-12T11:19:29.602 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "redirect_resolve_ip_addr", 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:29.603 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:29.604 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8080", 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-05-12T11:19:29.606 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl_server_port": { 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl_server_port", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8443", 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "redirect", 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect" 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-05-12T11:19:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "url_prefix": { 2024-05-12T11:19:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url_prefix", 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "devicehealth", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_monitoring": { 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_monitoring", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "monitor device health metrics", 2024-05-12T11:19:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "mark_out_threshold": { 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mark_out_threshold", 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2419200", 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-12T11:19:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_name": { 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_name", 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "device_health_metrics", 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-12T11:19:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "retention_period": { 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retention_period", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15552000", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain device health metrics", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_frequency": { 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_frequency", 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "self_heal": { 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "self_heal", 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and check device health", 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_threshold": { 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_threshold", 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7257600", 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "diskprediction_local", 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.630 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "predict_interval": { 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predict_interval", 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.631 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "predictor_model": { 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predictor_model", 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "prophetstor", 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.632 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "influx", 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": false, 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "influxdb python module not found", 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "batch_size": { 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "batch_size", 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5000", 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "database": { 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "database", 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "ceph", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": { 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hostname", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server hostname", 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "30", 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "5", 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "password": { 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "password", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "password of InfluxDB server user", 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "port": { 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "port", 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8086", 2024-05-12T11:19:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server port", 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "false", 2024-05-12T11:19:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "threads": { 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threads", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "32", 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "username": { 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "username", 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "username of InfluxDB server user", 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "verify_ssl": { 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "verify_ssl", 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "true", 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-12T11:19:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "insights", 2024-05-12T11:19:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "iostat", 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "k8sevents", 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_event_retention_days": { 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ceph_event_retention_days", 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7", 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "config_check_secs": { 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_check_secs", 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "10", 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "localpool", 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "failure_domain": { 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "failure_domain", 2024-05-12T11:19:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "host", 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "failure domain for any created local pool", 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "min_size": { 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_size", 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default min_size for any created local pool", 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "num_rep": { 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "num_rep", 2024-05-12T11:19:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3", 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default replica count for any created local pool", 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_num": { 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_num", 2024-05-12T11:19:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "128", 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default pg_num for any created local pool", 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "prefix": { 2024-05-12T11:19:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prefix", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name prefix for any created local pool", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "subtree": { 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "subtree", 2024-05-12T11:19:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "rack", 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mds_autoscaler", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirroring", 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "nfs", 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "fail_fs": { 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "fail_fs", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator": { 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "rook", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "test_orchestrator" 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Orchestrator backend", 2024-05-12T11:19:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_perf_query", 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_support", 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_autoscaler", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "threshold": { 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threshold", 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1.0", 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "scaling threshold", 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "progress", 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_pg_recovery_event": { 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_pg_recovery_event", 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "max_completed_events": { 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_completed_events", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "50", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "number of past completed events to remember", 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long the module is going to sleep", 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus", 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "cache": { 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cache", 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "exclude_perf_counters": { 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "exclude_perf_counters", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools": { 2024-05-12T11:19:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-12T11:19:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "300", 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_interval": { 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_interval", 2024-05-12T11:19:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15.0", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "9283", 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "stale_cache_strategy": { 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stale_cache_strategy", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "log", 2024-05-12T11:19:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "default", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "default", 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "error" 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_support", 2024-05-12T11:19:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_snap_create": { 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_snap_create", 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "mirror_snapshot_schedule": { 2024-05-12T11:19:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirror_snapshot_schedule", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "trash_purge_schedule": { 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "trash_purge_schedule", 2024-05-12T11:19:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "restful", 2024-05-12T11:19:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_auth": { 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_auth", 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.781 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.782 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.783 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rgw", 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.784 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.785 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.786 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.787 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.788 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.789 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rook", 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.791 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.793 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.794 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.795 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "storage_class": { 2024-05-12T11:19:29.796 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "storage_class", 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "local", 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "selftest", 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.798 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.799 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.800 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.801 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.802 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "roption1": { 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption1", 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.803 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "roption2": { 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption2", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "xyz", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.804 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption1": { 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption1", 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption2": { 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption2", 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.806 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption3": { 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption3", 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.807 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption4": { 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption4", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.808 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption5": { 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption5", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption6": { 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption6", 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.810 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption7": { 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption7", 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "42", 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.811 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.812 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "testkey": { 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testkey", 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "testlkey": { 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testlkey", 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "testnewline": { 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testnewline", 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smb", 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.816 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.817 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "update_orchestration": { 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "update_orchestration", 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-12T11:19:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snap_schedule", 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_m_granularity": { 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_m_granularity", 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow minute scheduled snapshots", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "dump_on_update": { 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dump_on_update", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "dump database to debug log on update", 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stats", 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "status", 2024-05-12T11:19:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telegraf", 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "address": { 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "address", 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telemetry", 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_basic": { 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_basic", 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_crash": { 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_crash", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_device": { 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_device", 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_ident": { 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_ident", 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_perf": { 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_perf", 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "contact": { 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "contact", 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "description": { 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "description", 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "device_url": { 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_url", 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "24", 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "8", 2024-05-12T11:19:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "last_opt_revision": { 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "last_opt_revision", 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1", 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard": { 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard", 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard_description": { 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard_description", 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "organization": { 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "organization", 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "proxy": { 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "proxy", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "url": { 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url", 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "test_orchestrator", 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "volumes", 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_clones": { 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_clones", 2024-05-12T11:19:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4", 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "periodic_async_work": { 2024-05-12T11:19:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "periodic_async_work", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Periodically check for async work", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_delay": { 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_delay", 2024-05-12T11:19:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_no_wait": { 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_no_wait", 2024-05-12T11:19:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "discovery_interval": { 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "discovery_interval", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "100", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "identifier": { 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "identifier", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_host": { 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_host", 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_port": { 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_port", 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10051", 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_sender": { 2024-05-12T11:19:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_sender", 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "gid": 24784, 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "z", 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_features": 4540701547738038271, 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "available_modules": [ 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "alerts", 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How frequently to reexamine health status", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_destination": { 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_destination", 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email address to send alerts to", 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_from_name": { 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_from_name", 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "Ceph", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email From: name", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_host": { 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_host", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP server", 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_password": { 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_password", 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Password to authenticate with", 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_port": { 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_port", 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "465", 2024-05-12T11:19:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP port", 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_sender": { 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_sender", 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP envelope sender", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_ssl": { 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_ssl", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_user": { 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_user", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.916 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "User to authenticate as", 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.917 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "balancer", 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "active": { 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "active", 2024-05-12T11:19:29.918 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically balance PGs across cluster", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_time": { 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_time", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.919 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0000", 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "beginning time of day to automatically balance", 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_weekday": { 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_weekday", 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.920 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_max_iterations": { 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_max_iterations", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.921 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "25", 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "250", 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_metrics": { 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_metrics", 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.922 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "pgs,objects,bytes", 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_step": { 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_step", 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.923 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.5", 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0.001", 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "0.999", 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "aggressiveness of optimization", 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "end_time": { 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_time", 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.924 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2359", 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ending time of day to automatically balance", 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "end_weekday": { 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_weekday", 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.925 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.928 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.930 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "min_score": { 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_score", 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.931 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.932 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "upmap", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "crush-compat", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "none", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "read", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap-read" 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Balancer mode", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_ids": { 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_ids", 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.934 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_deviation": { 2024-05-12T11:19:29.936 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_deviation", 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.937 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_optimizations": { 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_optimizations", 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm", 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_down_multiplier": { 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_down_multiplier", 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.939 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_refresh_rate": { 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_refresh_rate", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "20", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.940 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_starting_port": { 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_starting_port", 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4721", 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.941 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_ptrace": { 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_ptrace", 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.942 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_interval": { 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_interval", 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_memory_target_ratio": { 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_memory_target_ratio", 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.7", 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm_log_destination": { 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm_log_destination", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "file", 2024-05-12T11:19:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: "file,syslog", 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "syslog" 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "cgroups_split": { 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cgroups_split", 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "config_checks_enabled": { 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_checks_enabled", 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "config_dashboard": { 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_dashboard", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_alertmanager": { 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_alertmanager", 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_base": { 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_base", 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Container image name, without the tag", 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_elasticsearch": { 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_elasticsearch", 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "elasticsearch container image", 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_grafana": { 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_grafana", 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_haproxy": { 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_haproxy", 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "HAproxy container image", 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_agent": { 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_agent", 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger agent container image", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_collector": { 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_collector", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger collector container image", 2024-05-12T11:19:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_query": { 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_query", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger query container image", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.956 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_keepalived": { 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_keepalived", 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Keepalived container image", 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.957 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_loki": { 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_loki", 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Loki container image", 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_node_exporter": { 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_node_exporter", 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_nvmeof": { 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_nvmeof", 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Nvme-of container image", 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.960 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_prometheus": { 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_prometheus", 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.961 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_promtail": { 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_promtail", 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Promtail container image", 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.962 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_samba": { 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_samba", 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Samba/SMB container image", 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.963 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_snmp_gateway": { 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_snmp_gateway", 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SNMP Gateway container image", 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "container_init": { 2024-05-12T11:19:29.964 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_init", 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Run podman/docker with `--init`", 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "daemon_cache_timeout": { 2024-05-12T11:19:29.965 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "daemon_cache_timeout", 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "default_cephadm_command_timeout": { 2024-05-12T11:19:29.966 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_cephadm_command_timeout", 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "900", 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "default_registry": { 2024-05-12T11:19:29.967 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_registry", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "device_cache_timeout": { 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_cache_timeout", 2024-05-12T11:19:29.968 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1800", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache device inventory", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "device_enhanced_scan": { 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_enhanced_scan", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.969 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "facts_cache_timeout": { 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "facts_cache_timeout", 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.970 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache host facts data", 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "grafana_dashboards_path": { 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "grafana_dashboards_path", 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.971 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "host_check_interval": { 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "host_check_interval", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.972 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to perform a host check", 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "hw_monitoring": { 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hw_monitoring", 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.973 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "inventory_list_all": { 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "inventory_list_all", 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.974 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.975 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.976 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "log_refresh_metadata": { 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_refresh_metadata", 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.977 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.978 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:29.979 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.980 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.981 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "*", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.982 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "max_count_per_host": { 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_count_per_host", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.983 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of daemons per service per host", 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "max_osd_draining_count": { 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_osd_draining_count", 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.984 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "migration_current": { 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "migration_current", 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.985 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "internal - do not modify", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "root", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.986 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm-package", 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "root" 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "mode for remote execution of cephadm", 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "oob_default_addr": { 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "oob_default_addr", 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.987 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "169.254.1.1", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "prometheus_alerts_path": { 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus_alerts_path", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-12T11:19:29.988 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_insecure": { 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_insecure", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.989 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_password": { 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_password", 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.990 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_url": { 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_url", 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.991 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_username": { 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_username", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.992 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "secure_monitoring_stack": { 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "secure_monitoring_stack", 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.993 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "service_discovery_port": { 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "service_discovery_port", 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8765", 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.994 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "cephadm service discovery port", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:29.995 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "ssh_config_file": { 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssh_config_file", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.996 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "use_agent": { 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_agent", 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-12T11:19:29.997 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "use_repo_digest": { 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_repo_digest", 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-12T11:19:29.998 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_failed_host_check": { 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_failed_host_check", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if the host check fails", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:29.999 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_daemons": { 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_daemons", 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.000 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_hosts": { 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_hosts", 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.001 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crash", 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.002 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.005 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.006 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "retain_interval": { 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retain_interval", 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "31536000", 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.007 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.008 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_recent_interval": { 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_recent_interval", 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1209600", 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dashboard", 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-12T11:19:30.010 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_HOST": { 2024-05-12T11:19:30.011 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-12T11:19:30.012 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_ENABLED": { 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_ENABLED", 2024-05-12T11:19:30.013 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.014 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "ENABLE_BROWSABLE_API": { 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.015 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.016 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.017 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.018 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.020 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.021 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.022 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.023 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_PASSWORD": { 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.024 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.025 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_URL": { 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_URL", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.026 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_USERNAME": { 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.027 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.028 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.029 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.030 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "[]", 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.032 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "MULTICLUSTER_CONFIG": { 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "{}", 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_HOST": { 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.037 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.039 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-12T11:19:30.040 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-12T11:19:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_ENABLED": { 2024-05-12T11:19:30.042 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-12T11:19:30.043 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-12T11:19:30.044 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-12T11:19:30.045 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8", 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-12T11:19:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "45", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ACCESS_KEY": { 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-12T11:19:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-12T11:19:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SECRET_KEY": { 2024-05-12T11:19:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SSL_VERIFY": { 2024-05-12T11:19:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "UNSAFE_TLS_v1_2": { 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-12T11:19:30.051 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.052 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.052 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.052 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.052 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.052 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.052 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.052 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.054 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.055 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.056 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "cross_origin_url": { 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cross_origin_url", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.057 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "crt_file": { 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crt_file", 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.058 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "debug": { 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "debug", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.059 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable/disable debug options", 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "jwt_token_ttl": { 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "jwt_token_ttl", 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "28800", 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.060 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.061 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.062 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.063 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.064 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.065 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.066 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "motd": { 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "motd", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "The message of the day", 2024-05-12T11:19:30.067 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect_resolve_ip_addr": { 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "redirect_resolve_ip_addr", 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.069 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8080", 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.070 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.071 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl_server_port": { 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl_server_port", 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8443", 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.073 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "redirect", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect" 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.074 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.075 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "url_prefix": { 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url_prefix", 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.076 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "devicehealth", 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_monitoring": { 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_monitoring", 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.077 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "monitor device health metrics", 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.078 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.080 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.081 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.082 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "mark_out_threshold": { 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mark_out_threshold", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2419200", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_name": { 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_name", 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "device_health_metrics", 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.084 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "retention_period": { 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retention_period", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15552000", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain device health metrics", 2024-05-12T11:19:30.085 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_frequency": { 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_frequency", 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-12T11:19:30.086 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "self_heal": { 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "self_heal", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.087 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and check device health", 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.088 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_threshold": { 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_threshold", 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7257600", 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "diskprediction_local", 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "predict_interval": { 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predict_interval", 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "predictor_model": { 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predictor_model", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "prophetstor", 2024-05-12T11:19:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "influx", 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": false, 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "influxdb python module not found", 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "batch_size": { 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "batch_size", 2024-05-12T11:19:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5000", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "database": { 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "database", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "ceph", 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": { 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hostname", 2024-05-12T11:19:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server hostname", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "30", 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "5", 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "password": { 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "password", 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "password of InfluxDB server user", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "port": { 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "port", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8086", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server port", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "false", 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "threads": { 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threads", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "32", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-12T11:19:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "username": { 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "username", 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "username of InfluxDB server user", 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "verify_ssl": { 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "verify_ssl", 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "true", 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "insights", 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "iostat", 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "k8sevents", 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_event_retention_days": { 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ceph_event_retention_days", 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7", 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "config_check_secs": { 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_check_secs", 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "10", 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.138 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.139 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.140 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "localpool", 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "failure_domain": { 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "failure_domain", 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.141 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "host", 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "failure domain for any created local pool", 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "min_size": { 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_size", 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default min_size for any created local pool", 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "num_rep": { 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "num_rep", 2024-05-12T11:19:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3", 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default replica count for any created local pool", 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_num": { 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_num", 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "128", 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default pg_num for any created local pool", 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "prefix": { 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prefix", 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name prefix for any created local pool", 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "subtree": { 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "subtree", 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "rack", 2024-05-12T11:19:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mds_autoscaler", 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirroring", 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "nfs", 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-05-12T11:19:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "fail_fs": { 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "fail_fs", 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator": { 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.185 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm", 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rook", 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "test_orchestrator" 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Orchestrator backend", 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.186 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_perf_query", 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.188 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.189 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.190 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.191 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.192 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_support", 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_autoscaler", 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "threshold": { 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threshold", 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-05-12T11:19:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1.0", 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "scaling threshold", 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "progress", 2024-05-12T11:19:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_pg_recovery_event": { 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_pg_recovery_event", 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "max_completed_events": { 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_completed_events", 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "50", 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "number of past completed events to remember", 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long the module is going to sleep", 2024-05-12T11:19:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus", 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "cache": { 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cache", 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "exclude_perf_counters": { 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "exclude_perf_counters", 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools": { 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools", 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "300", 2024-05-12T11:19:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_interval": { 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_interval", 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15.0", 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "9283", 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "stale_cache_strategy": { 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stale_cache_strategy", 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "log", 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "default", 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "default", 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "error" 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_support", 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_snap_create": { 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_snap_create", 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "mirror_snapshot_schedule": { 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirror_snapshot_schedule", 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "trash_purge_schedule": { 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "trash_purge_schedule", 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "restful", 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_auth": { 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_auth", 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-05-12T11:19:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-05-12T11:19:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rgw", 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rook", 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "storage_class": { 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "storage_class", 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "local", 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "selftest", 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "roption1": { 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption1", 2024-05-12T11:19:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.292 INFO:teuthology.orchestra.run.smithi086.stdout: "roption2": { 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption2", 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "xyz", 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.293 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption1": { 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption1", 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.294 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption2": { 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption2", 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.295 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption3": { 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption3", 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.296 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption4": { 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption4", 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.297 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption5": { 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption5", 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.298 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption6": { 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption6", 2024-05-12T11:19:30.299 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.300 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption7": { 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption7", 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "42", 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.302 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "testkey": { 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testkey", 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.303 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "testlkey": { 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testlkey", 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "testnewline": { 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testnewline", 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.305 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smb", 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.307 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.309 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.310 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.312 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "update_orchestration": { 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "update_orchestration", 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.314 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snap_schedule", 2024-05-12T11:19:30.315 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_m_granularity": { 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_m_granularity", 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.316 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow minute scheduled snapshots", 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "dump_on_update": { 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dump_on_update", 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.317 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "dump database to debug log on update", 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.318 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.319 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.320 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.321 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stats", 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "status", 2024-05-12T11:19:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telegraf", 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "address": { 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "address", 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15", 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telemetry", 2024-05-12T11:19:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_basic": { 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_basic", 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_crash": { 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_crash", 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_device": { 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_device", 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_ident": { 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_ident", 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_perf": { 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_perf", 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "contact": { 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "contact", 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "description": { 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "description", 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "device_url": { 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_url", 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-12T11:19:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "24", 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "8", 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "last_opt_revision": { 2024-05-12T11:19:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "last_opt_revision", 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1", 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard": { 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard", 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard_description": { 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard_description", 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "organization": { 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "organization", 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "proxy": { 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "proxy", 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "url": { 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url", 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "test_orchestrator", 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "volumes", 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_clones": { 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_clones", 2024-05-12T11:19:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4", 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "periodic_async_work": { 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "periodic_async_work", 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Periodically check for async work", 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_delay": { 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_delay", 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_no_wait": { 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_no_wait", 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix", 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "discovery_interval": { 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "discovery_interval", 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "100", 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "identifier": { 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "identifier", 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_host": { 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_host", 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_port": { 2024-05-12T11:19:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_port", 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10051", 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_sender": { 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_sender", 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "modules": [ 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm", 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "dashboard", 2024-05-12T11:19:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "iostat", 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "nfs", 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "restful", 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "snap_schedule" 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "available_modules": [ 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "alerts", 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How frequently to reexamine health status", 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_destination": { 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_destination", 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email address to send alerts to", 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_from_name": { 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_from_name", 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "Ceph", 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email From: name", 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_host": { 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_host", 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP server", 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_password": { 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_password", 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Password to authenticate with", 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_port": { 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_port", 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "465", 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP port", 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_sender": { 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_sender", 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP envelope sender", 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_ssl": { 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_ssl", 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_user": { 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_user", 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "User to authenticate as", 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "balancer", 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "active": { 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "active", 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically balance PGs across cluster", 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_time": { 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_time", 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0000", 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "beginning time of day to automatically balance", 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_weekday": { 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_weekday", 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_max_iterations": { 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_max_iterations", 2024-05-12T11:19:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "25", 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "250", 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_metrics": { 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_metrics", 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "pgs,objects,bytes", 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_step": { 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_step", 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.5", 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0.001", 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "0.999", 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "aggressiveness of optimization", 2024-05-12T11:19:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "end_time": { 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_time", 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2359", 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ending time of day to automatically balance", 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "end_weekday": { 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_weekday", 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "min_score": { 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_score", 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "upmap", 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "crush-compat", 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "none", 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "read", 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap", 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap-read" 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Balancer mode", 2024-05-12T11:19:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_ids": { 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_ids", 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_deviation": { 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_deviation", 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_optimizations": { 2024-05-12T11:19:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_optimizations", 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm", 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_down_multiplier": { 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_down_multiplier", 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_refresh_rate": { 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_refresh_rate", 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "20", 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_starting_port": { 2024-05-12T11:19:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_starting_port", 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4721", 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_ptrace": { 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_ptrace", 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-12T11:19:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_interval": { 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_interval", 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_memory_target_ratio": { 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_memory_target_ratio", 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.7", 2024-05-12T11:19:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm_log_destination": { 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm_log_destination", 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "file", 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "file,syslog", 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "syslog" 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-12T11:19:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "cgroups_split": { 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cgroups_split", 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-12T11:19:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "config_checks_enabled": { 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_checks_enabled", 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "config_dashboard": { 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_dashboard", 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_alertmanager": { 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_alertmanager", 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_base": { 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_base", 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-12T11:19:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Container image name, without the tag", 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_elasticsearch": { 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_elasticsearch", 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-12T11:19:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "elasticsearch container image", 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_grafana": { 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_grafana", 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-12T11:19:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_haproxy": { 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_haproxy", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "HAproxy container image", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_agent": { 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_agent", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger agent container image", 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_collector": { 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_collector", 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger collector container image", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_query": { 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_query", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger query container image", 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_keepalived": { 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_keepalived", 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Keepalived container image", 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_loki": { 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_loki", 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Loki container image", 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_node_exporter": { 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_node_exporter", 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_nvmeof": { 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_nvmeof", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Nvme-of container image", 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_prometheus": { 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_prometheus", 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_promtail": { 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_promtail", 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Promtail container image", 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_samba": { 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_samba", 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Samba/SMB container image", 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_snmp_gateway": { 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_snmp_gateway", 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SNMP Gateway container image", 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "container_init": { 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_init", 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Run podman/docker with `--init`", 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "daemon_cache_timeout": { 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "daemon_cache_timeout", 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "default_cephadm_command_timeout": { 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_cephadm_command_timeout", 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "900", 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "default_registry": { 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_registry", 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io", 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "device_cache_timeout": { 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_cache_timeout", 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1800", 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache device inventory", 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "device_enhanced_scan": { 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_enhanced_scan", 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "facts_cache_timeout": { 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "facts_cache_timeout", 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache host facts data", 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "grafana_dashboards_path": { 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "grafana_dashboards_path", 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "host_check_interval": { 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "host_check_interval", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to perform a host check", 2024-05-12T11:19:30.492 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "hw_monitoring": { 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hw_monitoring", 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.493 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "inventory_list_all": { 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "inventory_list_all", 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.494 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "log_refresh_metadata": { 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_refresh_metadata", 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.496 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.497 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.499 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "*", 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.502 INFO:teuthology.orchestra.run.smithi086.stdout: "max_count_per_host": { 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_count_per_host", 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of daemons per service per host", 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.503 INFO:teuthology.orchestra.run.smithi086.stdout: "max_osd_draining_count": { 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_osd_draining_count", 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.504 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "migration_current": { 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "migration_current", 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "internal - do not modify", 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.505 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "root", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm-package", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "root" 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "mode for remote execution of cephadm", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.506 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "oob_default_addr": { 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "oob_default_addr", 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "169.254.1.1", 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "prometheus_alerts_path": { 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus_alerts_path", 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_insecure": { 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_insecure", 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_password": { 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_password", 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_url": { 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_url", 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.511 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_username": { 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_username", 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "secure_monitoring_stack": { 2024-05-12T11:19:30.512 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "secure_monitoring_stack", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "service_discovery_port": { 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "service_discovery_port", 2024-05-12T11:19:30.513 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8765", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "cephadm service discovery port", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.514 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "ssh_config_file": { 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssh_config_file", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.515 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "use_agent": { 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_agent", 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.516 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "use_repo_digest": { 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_repo_digest", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.517 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_failed_host_check": { 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_failed_host_check", 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.518 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if the host check fails", 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_daemons": { 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_daemons", 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.519 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_hosts": { 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_hosts", 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.520 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crash", 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.521 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.522 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.523 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.524 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.525 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "retain_interval": { 2024-05-12T11:19:30.526 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retain_interval", 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "31536000", 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.527 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.528 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_recent_interval": { 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_recent_interval", 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1209600", 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dashboard", 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.530 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_HOST": { 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.531 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.532 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_ENABLED": { 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_ENABLED", 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.533 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.534 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "ENABLE_BROWSABLE_API": { 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.535 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.536 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.537 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.538 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.539 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.540 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.541 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.543 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_PASSWORD": { 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.545 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_URL": { 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_URL", 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.546 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_USERNAME": { 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-12T11:19:30.547 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-12T11:19:30.548 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.549 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.550 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.551 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "[]", 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "MULTICLUSTER_CONFIG": { 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.552 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "{}", 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_HOST": { 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.553 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.554 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.555 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.556 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.558 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.559 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.560 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.561 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_ENABLED": { 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.562 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.563 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.564 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8", 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.565 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "45", 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.566 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ACCESS_KEY": { 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.567 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.568 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SECRET_KEY": { 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.569 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SSL_VERIFY": { 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.570 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "UNSAFE_TLS_v1_2": { 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.571 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.572 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.573 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.574 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "cross_origin_url": { 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cross_origin_url", 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "crt_file": { 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crt_file", 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.576 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "debug": { 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "debug", 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable/disable debug options", 2024-05-12T11:19:30.577 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "jwt_token_ttl": { 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "jwt_token_ttl", 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "28800", 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.578 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.579 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.580 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.581 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.582 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.583 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "motd": { 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "motd", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "The message of the day", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect_resolve_ip_addr": { 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "redirect_resolve_ip_addr", 2024-05-12T11:19:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8080", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl_server_port": { 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl_server_port", 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8443", 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "redirect", 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect" 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-05-12T11:19:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "url_prefix": { 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url_prefix", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "devicehealth", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_monitoring": { 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_monitoring", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "monitor device health metrics", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "mark_out_threshold": { 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mark_out_threshold", 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2419200", 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_name": { 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_name", 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "device_health_metrics", 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "retention_period": { 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retention_period", 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15552000", 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain device health metrics", 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_frequency": { 2024-05-12T11:19:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_frequency", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "self_heal": { 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "self_heal", 2024-05-12T11:19:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and check device health", 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_threshold": { 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_threshold", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7257600", 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "diskprediction_local", 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "predict_interval": { 2024-05-12T11:19:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predict_interval", 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "predictor_model": { 2024-05-12T11:19:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predictor_model", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "prophetstor", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "influx", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": false, 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "influxdb python module not found", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "batch_size": { 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "batch_size", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5000", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-12T11:19:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "database": { 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "database", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "ceph", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": { 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hostname", 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server hostname", 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "30", 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "5", 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "password": { 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "password", 2024-05-12T11:19:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "password of InfluxDB server user", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "port": { 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "port", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8086", 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server port", 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "false", 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "threads": { 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threads", 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "32", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "username": { 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "username", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "username of InfluxDB server user", 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "verify_ssl": { 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "verify_ssl", 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "true", 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "insights", 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "iostat", 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "k8sevents", 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_event_retention_days": { 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ceph_event_retention_days", 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7", 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "config_check_secs": { 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_check_secs", 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "10", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "localpool", 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "failure_domain": { 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "failure_domain", 2024-05-12T11:19:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "host", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "failure domain for any created local pool", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "min_size": { 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_size", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default min_size for any created local pool", 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "num_rep": { 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "num_rep", 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3", 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default replica count for any created local pool", 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_num": { 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_num", 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "128", 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default pg_num for any created local pool", 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "prefix": { 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prefix", 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name prefix for any created local pool", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "subtree": { 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "subtree", 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "rack", 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-12T11:19:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mds_autoscaler", 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirroring", 2024-05-12T11:19:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "nfs", 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "fail_fs": { 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "fail_fs", 2024-05-12T11:19:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator": { 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm", 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "rook", 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "test_orchestrator" 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Orchestrator backend", 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_perf_query", 2024-05-12T11:19:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_support", 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_autoscaler", 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "threshold": { 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threshold", 2024-05-12T11:19:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1.0", 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "scaling threshold", 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "progress", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_pg_recovery_event": { 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_pg_recovery_event", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-12T11:19:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "max_completed_events": { 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_completed_events", 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "50", 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "number of past completed events to remember", 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long the module is going to sleep", 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus", 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "cache": { 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cache", 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "exclude_perf_counters": { 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "exclude_perf_counters", 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.732 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.733 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.734 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools": { 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools", 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.735 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "300", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.736 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_interval": { 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_interval", 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15.0", 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.737 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.738 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "9283", 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.740 INFO:teuthology.orchestra.run.smithi086.stdout: "stale_cache_strategy": { 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stale_cache_strategy", 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "log", 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.741 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "default", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "default", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "error" 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.742 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.743 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_support", 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.744 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.747 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.748 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_snap_create": { 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_snap_create", 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "mirror_snapshot_schedule": { 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirror_snapshot_schedule", 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.751 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "trash_purge_schedule": { 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "trash_purge_schedule", 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.752 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "restful", 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_auth": { 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_auth", 2024-05-12T11:19:30.753 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.754 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.755 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.756 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.758 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.759 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.760 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.761 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.762 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rgw", 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.764 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.765 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.766 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.767 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rook", 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.769 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.770 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.771 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.772 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.773 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.774 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "storage_class": { 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "storage_class", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "local", 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "selftest", 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.776 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.777 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.778 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.779 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.780 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "roption1": { 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption1", 2024-05-12T11:19:30.781 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "roption2": { 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption2", 2024-05-12T11:19:30.782 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "xyz", 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption1": { 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption1", 2024-05-12T11:19:30.783 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption2": { 2024-05-12T11:19:30.784 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption2", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption3": { 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption3", 2024-05-12T11:19:30.785 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption4": { 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption4", 2024-05-12T11:19:30.786 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption5": { 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption5", 2024-05-12T11:19:30.787 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption6": { 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption6", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.788 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption7": { 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption7", 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.789 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "42", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.790 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "testkey": { 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testkey", 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.791 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "testlkey": { 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testlkey", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.792 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "testnewline": { 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testnewline", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.793 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smb", 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.794 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.795 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.796 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.797 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.799 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "update_orchestration": { 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "update_orchestration", 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.800 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snap_schedule", 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.801 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_m_granularity": { 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_m_granularity", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow minute scheduled snapshots", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.802 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "dump_on_update": { 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dump_on_update", 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "dump database to debug log on update", 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.805 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.806 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.807 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stats", 2024-05-12T11:19:30.809 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.810 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.811 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.812 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "status", 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.816 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.819 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.820 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.821 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telegraf", 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "address": { 2024-05-12T11:19:30.822 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "address", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.824 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.825 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.826 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.827 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.828 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telemetry", 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.830 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_basic": { 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_basic", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.831 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_crash": { 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_crash", 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_device": { 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_device", 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_ident": { 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_ident", 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_perf": { 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_perf", 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.835 INFO:teuthology.orchestra.run.smithi086.stdout: "contact": { 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "contact", 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "description": { 2024-05-12T11:19:30.836 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "description", 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "device_url": { 2024-05-12T11:19:30.837 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_url", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-05-12T11:19:30.838 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.839 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "24", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "8", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "last_opt_revision": { 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "last_opt_revision", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1", 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard": { 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard", 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.841 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard_description": { 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard_description", 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.842 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.843 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.844 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.846 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.847 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "organization": { 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "organization", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.848 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "proxy": { 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "proxy", 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.849 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "url": { 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url", 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.851 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "test_orchestrator", 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.852 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.854 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.855 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.856 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.857 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "volumes", 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.858 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.859 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.860 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.861 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.862 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_clones": { 2024-05-12T11:19:30.863 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_clones", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "periodic_async_work": { 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "periodic_async_work", 2024-05-12T11:19:30.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Periodically check for async work", 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_delay": { 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_delay", 2024-05-12T11:19:30.865 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_no_wait": { 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_no_wait", 2024-05-12T11:19:30.866 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.867 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.868 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "discovery_interval": { 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "discovery_interval", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "100", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.869 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "identifier": { 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "identifier", 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.870 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.872 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-05-12T11:19:30.873 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.874 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.875 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-05-12T11:19:30.876 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.877 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "sqlite3_killpoint": { 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sqlite3_killpoint", 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "dev", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_host": { 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_host", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_port": { 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_port", 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10051", 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_sender": { 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_sender", 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-05-12T11:19:30.881 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "services": { 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: "dashboard": "https://172.21.15.86:8443/" 2024-05-12T11:19:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "always_on_modules": { 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "octopus": [ 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.883 INFO:teuthology.orchestra.run.smithi086.stdout: "pacific": [ 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "quincy": [ 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-05-12T11:19:30.884 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "reef": [ 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-05-12T11:19:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "squid": [ 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-05-12T11:19:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "last_failure_osd_epoch": 83, 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "active_clients": [ 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "devicehealth", 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3379751495 2024-05-12T11:19:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "libcephsqlite", 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3588426850 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_support", 2024-05-12T11:19:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3002258528 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snap_schedule", 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3823750754 2024-05-12T11:19:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snap_schedule", 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3687841288 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "volumes", 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 1198968841 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-05-12T11:19:30.891 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:19:30.892 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:29 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/997662080' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-12T11:19:30.892 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:29 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1882407969' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-12T11:19:30.892 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:29 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/997662080' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-12T11:19:30.892 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:29 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1882407969' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-12T11:19:30.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f22440b2960 msgr2=0x7f22440b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f22440b2960 0x7f22440b4e20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2240031440 tx=0x7f2240005a20 comp rx=0 tx=0).stop 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103c10 msgr2=0x7f22541991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103c10 0x7f22541991e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f224800c920 tx=0x7f224800cde0 comp rx=0 tx=0).stop 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 shutdown_connections 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f22440b2960 0x7f22440b4e20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f225410cfe0 0x7f225419daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2254104530 0x7f2254199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 --2- 172.21.15.86:0/1882407969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103c10 0x7f22541991e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 >> 172.21.15.86:0/1882407969 conn(0x7f2254077c30 msgr2=0x7f22540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 shutdown_connections 2024-05-12T11:19:30.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:19:29.429+0000 7f225b237640 1 -- 172.21.15.86:0/1882407969 wait complete. 2024-05-12T11:19:30.900 DEBUG:tasks.check_counter:Getting stats from a 2024-05-12T11:19:30.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-12T11:19:30.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:29 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/997662080' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-12T11:19:30.901 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:29 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1882407969' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-12T11:19:31.153 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:19:31.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:30 smithi086 ceph-mon[30110]: pgmap v314: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-05-12T11:19:31.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:30 smithi172 ceph-mon[34517]: pgmap v314: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-05-12T11:19:31.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:30 smithi176 ceph-mon[34357]: pgmap v314: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-05-12T11:19:33.083 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:19:33.083 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:33.083 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 1581, 2024-05-12T11:19:33.083 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 1583, 2024-05-12T11:19:33.083 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 473491, 2024-05-12T11:19:33.083 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 502759, 2024-05-12T11:19:33.083 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 6, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 2, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.132370188, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.044196369, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.034083016, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.041659026, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1581, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.046823141, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000029616 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 0 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 869, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 854, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 1904672, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 334920, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 3, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.102095022, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.031253580, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.051041938, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.026148459, 2024-05-12T11:19:33.085 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 854, 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.033226513, 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000038906 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 1752976, 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 139600 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.086 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 3, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 170, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 588, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 458014, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 6, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 4, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.012968293, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.008691071, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.002203328, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000021180, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 167, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.018013582, 2024-05-12T11:19:33.087 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000107865 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 457696 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 1, 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-MDSRank": { 2024-05-12T11:19:33.088 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 3641, 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.092800547, 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000025487 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-PurgeQueue": { 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": { 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "request": 0, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "reply": 0, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "reply_latency": { 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_reply": 0, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "forward": 0, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_complete": 0, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_keys": 0, 2024-05-12T11:19:33.090 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_commit": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_split": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_merge": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_top": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_bottom": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pin_tail": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pinned": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_expired": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_with_caps": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "subtrees": 1, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_hit": 0, 2024-05-12T11:19:33.091 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_forward": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_discover": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_remote_ino": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_lock": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "load_cent": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "q": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "exported": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "exported_inodes": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "imported": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "imported_inodes": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_dir_fetch": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_peer_discover": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rfiles": 0, 2024-05-12T11:19:33.092 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rbytes": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rsnaps": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_set_tag": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_file_inodes": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_revoke": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_grant": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:19:33.093 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_cap_release": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "process_request_cap_release": 0 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache": { 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update_receipt": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_try_discover": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_send_discover": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_handle_discover": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays": 0, 2024-05-12T11:19:33.094 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_delayed": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_created": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_enqueued": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_reintegrated": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_migrated": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_processing": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_started": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_completed": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_path": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_inode": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_exportdir": 0, 2024-05-12T11:19:33.095 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_flush": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragstats": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_inodestats": 0 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log": { 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "evlrg": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "evadd": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "evex": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "evtrm": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "ev": 3, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "evexg": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "evexd": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "segadd": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "segex": 0, 2024-05-12T11:19:33.096 INFO:teuthology.orchestra.run.smithi086.stdout: "segtrm": 0, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "seg": 2, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "segmjr": 2, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "segexg": 0, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "segexd": 0, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "expos": 4194304, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "wrpos": 4195200, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "rdpos": 4194892, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "jlat": { 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "replayed": 3 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.097 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_mem": { 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "ino": 3, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "ino+": 3, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "ino-": 0, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "dir": 1, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "dir+": 1, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "dir-": 0, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "dn": 0, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "dn+": 0, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "dn-": 0, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "cap": 0, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "cap+": 0, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "cap-": 0, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "rss": 50724, 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: "heap": 215416 2024-05-12T11:19:33.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_server": { 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_client_request": 0, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_server_request": 0, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_request": 0, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_session": 0, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_peer_request": 0, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "req_create_latency": { 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getattr_latency": { 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.099 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getfilelock_latency": { 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "req_link_latency": { 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookup_latency": { 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookuphash_latency": { 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupino_latency": { 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupname_latency": { 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.101 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupparent_latency": { 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupsnap_latency": { 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lssnap_latency": { 2024-05-12T11:19:33.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.103 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.103 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.103 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mkdir_latency": { 2024-05-12T11:19:33.103 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.103 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mknod_latency": { 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mksnap_latency": { 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "req_open_latency": { 2024-05-12T11:19:33.104 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "req_readdir_latency": { 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rename_latency": { 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "req_renamesnap_latency": { 2024-05-12T11:19:33.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "req_snapdiff_latency": { 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmdir_latency": { 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmsnap_latency": { 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmxattr_latency": { 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setattr_latency": { 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setdirlayout_latency": { 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setfilelock_latency": { 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setlayout_latency": { 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.108 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setxattr_latency": { 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "req_symlink_latency": { 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "req_unlink_latency": { 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.109 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getvxattr_latency": { 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_sessions": { 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "session_count": 1, 2024-05-12T11:19:33.110 INFO:teuthology.orchestra.run.smithi086.stdout: "session_add": 1, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "session_remove": 0, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_open": 1, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_stale": 0, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "total_load": 0, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "average_load": 0, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "avg_session_uptime": 1763, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mdthresh_evicted": 0 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:33.111 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:33.112 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-05-12T11:19:33.113 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 190178, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 53, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:33.114 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 8224, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 171, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 8512, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 13, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter": { 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "op_active": 0, 2024-05-12T11:19:33.115 INFO:teuthology.orchestra.run.smithi086.stdout: "op_laggy": 0, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send": 2196, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send_bytes": 21, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "op_resend": 3, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "op_reply": 2196, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "op_latency": { 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2196, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 1.311971249, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000597436 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "op_inflight": 0, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "oplen_avg": { 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2196, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 2197 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "op": 2196, 2024-05-12T11:19:33.116 INFO:teuthology.orchestra.run.smithi086.stdout: "op_r": 2196, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "op_w": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "op_rmw": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "op_pg": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_stat": 1400, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_create": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_read": 794, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_write": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writefull": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writesame": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_append": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_zero": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_truncate": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_delete": 0, 2024-05-12T11:19:33.117 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_mapext": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_sparse_read": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_clonerange": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_getxattr": 1, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_setxattr": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_rmxattr": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_call": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_watch": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_notify": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:19:33.118 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_other": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_active": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_send": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_resend": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_ping": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_active": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_send": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_resend": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_active": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_send": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_resend": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_active": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_send": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_resend": 0, 2024-05-12T11:19:33.119 INFO:teuthology.orchestra.run.smithi086.stdout: "command_active": 0, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "command_send": 0, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "command_resend": 0, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "map_epoch": 91, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "map_full": 0, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "map_inc": 11, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_sessions": 5, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_open": 5, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_close": 0, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_laggy": 0, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_wr": 0, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_rd": 2, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_del": 0 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "oft": { 2024-05-12T11:19:33.120 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_objs": 0, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_updates": 0, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_removes": 0 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "osd-slow-ops": { 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_ops_count": 0 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "purge_queue": { 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops": 0, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing": 0, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_high_water": 0, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed_ops": 0, 2024-05-12T11:19:33.121 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed": 0, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_item_in_journal": 0 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 2449, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 2142465, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 2449, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2449, 2024-05-12T11:19:33.122 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 2142465, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_bytes": { 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:33.123 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 2196, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 901, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2196, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 901, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_ops": { 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 1024, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:33.124 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 2196, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 2196, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2196, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 2196, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:19:33.125 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.126 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle-0x55e09ffaa6e0": { 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 0, 2024-05-12T11:19:33.127 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 0, 2024-05-12T11:19:33.128 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:33.128 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:33.128 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:33.128 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:33.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:33.128 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:19:33.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:32 smithi086 ceph-mon[30110]: pgmap v315: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:33.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:32 smithi172 ceph-mon[34517]: pgmap v315: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:33.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:32 smithi176 ceph-mon[34357]: pgmap v315: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:33.767 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-12T11:19:33.767 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-12T11:19:33.767 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-05-12T11:19:33.767 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:19:33.767 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:19:33.768 DEBUG:tasks.check_counter:Getting stats from d 2024-05-12T11:19:33.768 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-12T11:19:34.023 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:19:35.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:34 smithi086 ceph-mon[30110]: pgmap v316: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:35.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:34 smithi172 ceph-mon[34517]: pgmap v316: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:35.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:34 smithi176 ceph-mon[34357]: pgmap v316: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:35.906 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 0, 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 2, 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 0, 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 0, 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 0, 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.001069154, 2024-05-12T11:19:35.907 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.000000000, 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.000215744, 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:35.908 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 0 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 6, 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 177, 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 3312, 2024-05-12T11:19:35.909 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 188544, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 5, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 3, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.015355371, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.010515294, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.002217879, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 175, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.015256414, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000087179 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.910 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 188544 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 239, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 228, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 1715616, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 140224, 2024-05-12T11:19:35.911 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 2, 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 1, 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.046243455, 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.014244470, 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.038150161, 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.004539182, 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 227, 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.012217495, 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000053821 2024-05-12T11:19:35.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 1715616, 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 140224 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-05-12T11:19:35.913 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 0, 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:35.914 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:35.915 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:35.916 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:35.917 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 148731, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 31, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 0, 2024-05-12T11:19:35.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 928, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 2, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:35.919 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 241, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 1681900, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 241, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 241, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 1681900, 2024-05-12T11:19:35.920 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:35.921 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:35.921 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:35.921 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:35.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:35.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:35.921 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:19:36.610 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-12T11:19:36.610 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-12T11:19:36.610 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-05-12T11:19:36.610 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-05-12T11:19:36.610 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-05-12T11:19:36.610 DEBUG:tasks.check_counter:Getting stats from g 2024-05-12T11:19:36.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-12T11:19:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:19:37.162 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:36 smithi086 ceph-mon[30110]: pgmap v317: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-12T11:19:37.163 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:19:37.163 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.163 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.163 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.163 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.163 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.163 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:36 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:36 smithi172 ceph-mon[34517]: pgmap v317: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-12T11:19:37.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:19:37.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:36 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:36 smithi176 ceph-mon[34357]: pgmap v317: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-12T11:19:37.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-12T11:19:37.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:37.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:36 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 796, 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 798, 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 267401, 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 253129, 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 6, 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 2, 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.092660509, 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.039759025, 2024-05-12T11:19:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.019088297, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.024434578, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 796, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.042611235, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000053531 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 0 2024-05-12T11:19:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 1422, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 1589, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 366783, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 910457, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 7, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 5, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.103608715, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.034444002, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.025656063, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.034841324, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1587, 2024-05-12T11:19:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.050772205, 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000031992 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 460112 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 257, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 244, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 1752148, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 142037, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 3, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.047093249, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.014859293, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.038810387, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.004455829, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 243, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.012965275, 2024-05-12T11:19:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000053355 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 1750800, 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 141072 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 1, 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-MDSRank": { 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 3800, 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.096535467, 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000025404 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-PurgeQueue": { 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": { 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "request": 0, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "reply": 0, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "reply_latency": { 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_reply": 0, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "forward": 0, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_complete": 0, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_keys": 0, 2024-05-12T11:19:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_commit": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_split": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_merge": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_top": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_bottom": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pin_tail": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pinned": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_expired": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_with_caps": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "subtrees": 1, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_hit": 0, 2024-05-12T11:19:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_forward": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_discover": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_remote_ino": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_lock": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "load_cent": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "q": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "exported": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "exported_inodes": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "imported": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "imported_inodes": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_dir_fetch": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_peer_discover": 0, 2024-05-12T11:19:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rfiles": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rbytes": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rsnaps": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_set_tag": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_file_inodes": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_revoke": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_grant": 0, 2024-05-12T11:19:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_cap_release": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "process_request_cap_release": 0 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache": { 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update_receipt": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_try_discover": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_send_discover": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_handle_discover": 0, 2024-05-12T11:19:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_delayed": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_created": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_enqueued": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_reintegrated": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_migrated": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_processing": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_started": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_completed": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_path": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_inode": 0, 2024-05-12T11:19:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_exportdir": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_flush": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragstats": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_inodestats": 0 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log": { 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "evlrg": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "evadd": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "evex": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "evtrm": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "ev": 8, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "evexg": 0, 2024-05-12T11:19:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "evexd": 0, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "segadd": 0, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "segex": 0, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "segtrm": 0, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "seg": 2, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "segmjr": 2, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "segexg": 0, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "segexd": 0, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "expos": 4194304, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "wrpos": 4196655, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "rdpos": 4196514, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "jlat": { 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "replayed": 8 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_mem": { 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "ino": 3, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "ino+": 3, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "ino-": 0, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "dir": 1, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "dir+": 1, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "dir-": 0, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "dn": 0, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "dn+": 0, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "dn-": 0, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "cap": 0, 2024-05-12T11:19:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "cap+": 0, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "cap-": 0, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "rss": 50684, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "heap": 215416 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_server": { 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_client_request": 0, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_server_request": 0, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_request": 0, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_session": 0, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_peer_request": 0, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "req_create_latency": { 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getattr_latency": { 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getfilelock_latency": { 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "req_link_latency": { 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookup_latency": { 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookuphash_latency": { 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupino_latency": { 2024-05-12T11:19:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupname_latency": { 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupparent_latency": { 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupsnap_latency": { 2024-05-12T11:19:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lssnap_latency": { 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mkdir_latency": { 2024-05-12T11:19:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mknod_latency": { 2024-05-12T11:19:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mksnap_latency": { 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "req_open_latency": { 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "req_readdir_latency": { 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rename_latency": { 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "req_renamesnap_latency": { 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "req_snapdiff_latency": { 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmdir_latency": { 2024-05-12T11:19:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmsnap_latency": { 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmxattr_latency": { 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setattr_latency": { 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setdirlayout_latency": { 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setfilelock_latency": { 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setlayout_latency": { 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setxattr_latency": { 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "req_symlink_latency": { 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "req_unlink_latency": { 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getvxattr_latency": { 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_sessions": { 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "session_count": 2, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "session_add": 4, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "session_remove": 2, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_open": 4, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_stale": 0, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "total_load": 0, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "average_load": 0, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "avg_session_uptime": 2925, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "mdthresh_evicted": 0 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 199272, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 57, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-05-12T11:19:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 8224, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 171, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 8512, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 13, 2024-05-12T11:19:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter": { 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "op_active": 0, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "op_laggy": 0, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send": 2215, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send_bytes": 21, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "op_resend": 3, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "op_reply": 2215, 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "op_latency": { 2024-05-12T11:19:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2215, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 1.120975434, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000506083 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "op_inflight": 0, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "oplen_avg": { 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2215, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 2216 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "op": 2215, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "op_r": 2215, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "op_w": 0, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "op_rmw": 0, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "op_pg": 0, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_stat": 1409, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_create": 0, 2024-05-12T11:19:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_read": 804, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_write": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writefull": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writesame": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_append": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_zero": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_truncate": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_delete": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_mapext": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_sparse_read": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_clonerange": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_getxattr": 1, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_setxattr": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:19:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_rmxattr": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_call": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_watch": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_notify": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_other": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_active": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_send": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_resend": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_ping": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_active": 0, 2024-05-12T11:19:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_send": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_resend": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_active": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_send": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_resend": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_active": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_send": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_resend": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "command_active": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "command_send": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "command_resend": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "map_epoch": 91, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "map_full": 0, 2024-05-12T11:19:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "map_inc": 11, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_sessions": 6, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_open": 6, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_close": 0, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_laggy": 0, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_wr": 0, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_rd": 2, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_del": 0 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "oft": { 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_objs": 0, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_updates": 0, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_removes": 0 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "osd-slow-ops": { 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_ops_count": 0 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "purge_queue": { 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops": 0, 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing": 0, 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_high_water": 0, 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed_ops": 0, 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed": 0, 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_item_in_journal": 0 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 2471, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 2147910, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 2471, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2471, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 2147910, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_bytes": { 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 2215, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 2356, 2024-05-12T11:19:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2215, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 2356, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_ops": { 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 1024, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-05-12T11:19:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 2215, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 2215, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2215, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 2215, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:19:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle-0x55c5624566e0": { 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-05-12T11:19:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 0, 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 0, 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:38.719 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:19:39.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: pgmap v318: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:39.622 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.622 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.622 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.622 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.622 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:39 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.649 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-12T11:19:39.649 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-12T11:19:39.649 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-05-12T11:19:39.649 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:19:39.649 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:19:39.650 DEBUG:tasks.check_counter:Getting stats from j 2024-05-12T11:19:39.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-12T11:19:39.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: pgmap v318: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:39.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:39 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: pgmap v318: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:39.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:39 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:40.182 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:19:40.612 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:40 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-12T11:19:40.612 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:40 smithi086 ceph-mon[30110]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-12T11:19:40.612 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:40 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi176 to 176.2M 2024-05-12T11:19:40.612 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:40 smithi086 ceph-mon[30110]: Unable to set osd_memory_target on smithi176 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-05-12T11:19:40.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:40 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-12T11:19:40.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:40 smithi172 ceph-mon[34517]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-12T11:19:40.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:40 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi176 to 176.2M 2024-05-12T11:19:40.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:40 smithi172 ceph-mon[34517]: Unable to set osd_memory_target on smithi176 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-05-12T11:19:40.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:40 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-12T11:19:40.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:40 smithi176 ceph-mon[34357]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-12T11:19:40.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:40 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi176 to 176.2M 2024-05-12T11:19:40.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:40 smithi176 ceph-mon[34357]: Unable to set osd_memory_target on smithi176 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-05-12T11:19:41.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:41 smithi086 ceph-mon[30110]: pgmap v319: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-12T11:19:41.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:41 smithi172 ceph-mon[34517]: pgmap v319: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-12T11:19:41.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:41 smithi176 ceph-mon[34357]: pgmap v319: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 0, 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 2, 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 0, 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 0, 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 0, 2024-05-12T11:19:41.852 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.001000082, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.000000000, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.000205411, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:41.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 0 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 6, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 178, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 3312, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 188720, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 5, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 3, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.015613486, 2024-05-12T11:19:41.854 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.011228902, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.001888048, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 176, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.010906835, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000061970 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 188720 2024-05-12T11:19:41.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 242, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 231, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 1716432, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 142144, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 2, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 1, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.050589369, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.015718349, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.040734190, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.004536688, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 230, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.010758715, 2024-05-12T11:19:41.856 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000046777 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 1716432, 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 142144 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 0, 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-05-12T11:19:41.857 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:41.858 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 148732, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 31, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-05-12T11:19:41.860 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 928, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 2, 2024-05-12T11:19:41.861 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 244, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 1682290, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:41.862 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 244, 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 244, 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 1682290, 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-05-12T11:19:41.863 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-05-12T11:19:42.670 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-12T11:19:42.670 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-12T11:19:42.670 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-05-12T11:19:42.670 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-05-12T11:19:42.670 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-05-12T11:19:42.670 DEBUG:tasks.check_counter:Getting stats from b 2024-05-12T11:19:42.670 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-12T11:19:42.922 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: pgmap v320: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:19:43.719 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:43 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:43.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: pgmap v320: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:43.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:43.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:43.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:19:43.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:19:43.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:43 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: pgmap v320: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-12T11:19:43.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-12T11:19:43.774 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:43 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' 2024-05-12T11:19:44.691 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:44 smithi172 ceph-mon[34517]: Adjusting osd_memory_target on smithi086 to 176.2M 2024-05-12T11:19:44.691 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:44 smithi172 ceph-mon[34517]: Unable to set osd_memory_target on smithi086 to 184767385: error parsing value: Value '184767385' is below minimum 939524096 2024-05-12T11:19:44.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:44 smithi086 ceph-mon[30110]: Adjusting osd_memory_target on smithi086 to 176.2M 2024-05-12T11:19:44.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:44 smithi086 ceph-mon[30110]: Unable to set osd_memory_target on smithi086 to 184767385: error parsing value: Value '184767385' is below minimum 939524096 2024-05-12T11:19:44.727 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-12T11:19:44.727 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:44.727 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 643, 2024-05-12T11:19:44.727 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 815, 2024-05-12T11:19:44.727 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1874493, 2024-05-12T11:19:44.727 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 386559, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 10, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.104284318, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.037061488, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.062169030, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.011178195, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 819, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.089893312, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000109759 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.728 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 839, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000248776, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000296 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1783056, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 151312 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 33, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 208, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 8648, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 524320, 2024-05-12T11:19:44.729 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 15, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.015855856, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.007687138, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.005826990, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000297529, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 201, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.031162719, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000155038 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 38, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000004770, 2024-05-12T11:19:44.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000125 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 5280, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 470960 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 19, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 21, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 5193, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 14224, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-05-12T11:19:44.731 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.003361802, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.000331050, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.002206069, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000638194, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 19, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.012247370, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000644598 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.732 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 57, 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001941677, 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000034064 2024-05-12T11:19:44.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000008764, 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000004382 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 6, 2024-05-12T11:19:44.734 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 4, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000932951, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000233237 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 2, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 12, 2024-05-12T11:19:44.735 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 12, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 11, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 15, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 12, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 2, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-12T11:19:44.736 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 3, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:19:44.737 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 3, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:19:44.738 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 3, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 1 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 3, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-05-12T11:19:44.739 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 2, 2024-05-12T11:19:44.740 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 6, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 7, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-12T11:19:44.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 7, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 2, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4196347, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-05-12T11:19:44.742 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.010856468, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001809411 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 15, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 15, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 0, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 13, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 14, 2024-05-12T11:19:44.743 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 1, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 12, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 12, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 0, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 4, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 4, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 55756, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223608 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 8, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 6, 2024-05-12T11:19:44.744 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 16, 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000365908, 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000182954 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.745 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000567043, 2024-05-12T11:19:44.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000283521 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.747 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.748 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-12T11:19:44.749 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.749 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.749 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.749 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-12T11:19:44.749 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.749 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.751 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-12T11:19:44.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.758 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-12T11:19:44.758 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.758 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.758 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.758 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:19:44.758 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 3, 2024-05-12T11:19:44.759 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 3, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 579, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:44.760 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:44.761 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 256503, 2024-05-12T11:19:44.762 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 93, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 88, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 1, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8224, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 171, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:44.763 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 59336, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 234, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 46, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 12750, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 33, 2024-05-12T11:19:44.764 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 46, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 46, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.236994055, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005152044 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 46, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 70 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 46, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 0, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 46, 2024-05-12T11:19:44.765 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 6, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 9, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 6, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-12T11:19:44.766 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-12T11:19:44.767 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-12T11:19:44.768 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 91, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 11, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 10, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 10, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 17, 2024-05-12T11:19:44.769 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 2 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 8 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-12T11:19:44.770 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 691, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1807312, 2024-05-12T11:19:44.771 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 691, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 691, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1807312, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-12T11:19:44.772 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 46, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12750, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 46, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12750, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 46, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 46, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 46, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 46, 2024-05-12T11:19:44.774 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:44.775 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55cbd7b1e500": { 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 7, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2043, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:44.776 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 7, 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 6, 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2043, 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:44.777 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-12T11:19:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:44 smithi176 ceph-mon[34357]: Adjusting osd_memory_target on smithi086 to 176.2M 2024-05-12T11:19:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:44 smithi176 ceph-mon[34357]: Unable to set osd_memory_target on smithi086 to 184767385: error parsing value: Value '184767385' is below minimum 939524096 2024-05-12T11:19:45.643 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-05-12T11:19:45.643 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-05-12T11:19:45.643 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=3 2024-05-12T11:19:45.643 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:19:45.643 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:19:45.643 DEBUG:tasks.check_counter:Getting stats from e 2024-05-12T11:19:45.644 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-12T11:19:45.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:45 smithi086 ceph-mon[30110]: pgmap v321: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:45.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:45 smithi172 ceph-mon[34517]: pgmap v321: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:45.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:45 smithi176 ceph-mon[34357]: pgmap v321: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:45.886 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:19:47.613 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:47 smithi172 ceph-mon[34517]: pgmap v322: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:47.649 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1653, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1653, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4681297, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 524840, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.154302786, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.056767611, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.036053382, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.047473959, 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:47.650 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1652, 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.058515991, 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000035421 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2024-05-12T11:19:47.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 769, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 756, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 7908934, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 306360, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.096529282, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.027419208, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.058143865, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.018730793, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 755, 2024-05-12T11:19:47.652 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.030870122, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000040887 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1752320, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 144432 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 343, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 517, 2024-05-12T11:19:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4278757, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 573831, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.042066241, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.015488384, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.010494493, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.011138649, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 514, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.026751301, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000052045 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.654 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 465392 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4160, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.108561054, 2024-05-12T11:19:47.655 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000026096 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-05-12T11:19:47.656 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 1239, 2024-05-12T11:19:47.657 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 649, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 590, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 137, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-12T11:19:47.658 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:19:47.659 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-05-12T11:19:47.660 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-12T11:19:47.661 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-12T11:19:47.662 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 6192, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 14, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 18462653, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 18606120, 2024-05-12T11:19:47.663 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 18606008, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 6192 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 25, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 1235, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 1210, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 19, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 23, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 4, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 1239, 2024-05-12T11:19:47.664 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 1244, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 5, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 52272, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215416 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.665 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.667 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.669 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-12T11:19:47.670 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.674 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.675 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 6, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 4, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 5, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 4113, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.677 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:47.678 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:47.679 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 190420, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 59, 2024-05-12T11:19:47.680 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8224, 2024-05-12T11:19:47.681 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 171, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 970827, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 5548, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-12T11:19:47.682 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 2499, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 2499, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2499, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.094972397, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000438164 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2499, 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2500 2024-05-12T11:19:47.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 2499, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 2499, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 1607, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 889, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-05-12T11:19:47.684 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:19:47.685 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-12T11:19:47.686 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 91, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 11, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 5, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 5, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-05-12T11:19:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2761, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 16604160, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2761, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2761, 2024-05-12T11:19:47.689 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 16604160, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:47.690 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2499, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 14411826, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2499, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 14411826, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:47.691 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2499, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 2499, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2499, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2499, 2024-05-12T11:19:47.692 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55aa4c8166e0": { 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:47.694 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:47.695 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-12T11:19:47.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:47 smithi086 ceph-mon[30110]: pgmap v322: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:47.772 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:47 smithi176 ceph-mon[34357]: pgmap v322: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:48.456 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-12T11:19:48.456 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-12T11:19:48.456 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-05-12T11:19:48.456 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:19:48.456 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:19:48.456 DEBUG:tasks.check_counter:Getting stats from h 2024-05-12T11:19:48.456 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-12T11:19:48.696 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:19:49.718 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:49 smithi086 ceph-mon[30110]: pgmap v323: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:49.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:49 smithi172 ceph-mon[34517]: pgmap v323: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:49.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:49 smithi176 ceph-mon[34357]: pgmap v323: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:50.455 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-12T11:19:50.455 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 36, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 196, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 8224, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 382295, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 14, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.020633549, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.008219189, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.008644115, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000508230, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 190, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.028514023, 2024-05-12T11:19:50.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000150073 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 50, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000008884, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000177 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2480, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 323520 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 589, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 801, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1846463, 2024-05-12T11:19:50.457 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 494542, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 9, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.107953124, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.040242267, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.067530097, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.011218515, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 804, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.060986816, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000075854 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 793, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000232749, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000293 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1768144, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 160384 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 28, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 75, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 9089, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 160821, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 9, 2024-05-12T11:19:50.459 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.007909308, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.002520834, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.003939411, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000405458, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 73, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.020243851, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000277313 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 16, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000001953, 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000122 2024-05-12T11:19:50.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 5008, 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 153456 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 47, 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002275907, 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000048423 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000007355, 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000003677 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 6, 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 4, 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-12T11:19:50.462 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000920969, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000230242 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 2, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 10, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 10, 2024-05-12T11:19:50.463 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 10, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 1, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 2, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 1, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 11, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 10, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-12T11:19:50.464 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 3, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-12T11:19:50.465 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 2, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 2, 2024-05-12T11:19:50.466 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 1, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-05-12T11:19:50.467 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 2, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 2, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-12T11:19:50.468 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 8, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 8, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 2, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-12T11:19:50.469 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4196655, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.011266289, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001609469 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.470 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 13, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 13, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 0, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 11, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 12, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 1, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 10, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 10, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 0, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 2, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 2, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 52584, 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223608 2024-05-12T11:19:50.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 6, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 6, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 25, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3, 2024-05-12T11:19:50.472 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000748632, 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000249544 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-12T11:19:50.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000172337, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000172337 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-12T11:19:50.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.475 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-12T11:19:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-12T11:19:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.476 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-12T11:19:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.478 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-12T11:19:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.483 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-12T11:19:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-12T11:19:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-12T11:19:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.487 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.488 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.489 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.490 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 4, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 3, 2024-05-12T11:19:50.491 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 592, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:50.492 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:50.493 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:50.494 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 248439, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 89, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 88, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 1, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8224, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 171, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:50.495 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 51608, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 202, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 44, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 12743, 2024-05-12T11:19:50.496 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 33, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 44, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 44, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.217994514, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004954420 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 44, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 66 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 44, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 0, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 44, 2024-05-12T11:19:50.497 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 7, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 8, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 6, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-12T11:19:50.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-12T11:19:50.499 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-12T11:19:50.500 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 91, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 11, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 9, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 9, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 14, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 1 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:19:50.501 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 4 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-05-12T11:19:50.502 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 649, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1786157, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 649, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 649, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1786157, 2024-05-12T11:19:50.503 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:50.504 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 44, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12743, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 44, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12743, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:50.505 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 44, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 44, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 44, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 44, 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:50.506 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:50.507 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x564c989dc500": { 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 8, 2024-05-12T11:19:50.508 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2351, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 8, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 7, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2351, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:50.509 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-12T11:19:51.207 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:50 smithi172 ceph-mon[34517]: pgmap v324: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:51.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:50 smithi086 ceph-mon[30110]: pgmap v324: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:51.234 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-12T11:19:51.234 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-12T11:19:51.235 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=3 2024-05-12T11:19:51.235 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:19:51.235 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:19:51.235 DEBUG:tasks.check_counter:Getting stats from k 2024-05-12T11:19:51.235 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-12T11:19:51.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:50 smithi176 ceph-mon[34357]: pgmap v324: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:51.474 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.b/config 2024-05-12T11:19:53.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:52 smithi086 ceph-mon[30110]: pgmap v325: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:53.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:52 smithi172 ceph-mon[34517]: pgmap v325: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:53.258 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-12T11:19:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 816, 2024-05-12T11:19:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 818, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 215795, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 259552, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.078439225, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.031444169, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.018433080, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.020597246, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 816, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.029125293, 2024-05-12T11:19:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000035692 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 267, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 380, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1754194, 2024-05-12T11:19:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 462273, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.059690695, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.020603853, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.043374886, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.006461657, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 379, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.029595204, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000078087 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1753680, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 461632 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1442, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1491, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 429464, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 609174, 2024-05-12T11:19:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.157807388, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.048736305, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.038168166, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.055460709, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1489, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.070760381, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000047522 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 152208 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3811, 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.118141405, 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000031000 2024-05-12T11:19:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-12T11:19:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-05-12T11:19:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 1, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-12T11:19:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-12T11:19:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-05-12T11:19:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-05-12T11:19:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-12T11:19:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 5, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-05-12T11:19:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4195732, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 4195591, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 5 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 3, 2024-05-12T11:19:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 3, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 0, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 1, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 1, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 0, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 0, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 0, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 51156, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215416 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-12T11:19:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-12T11:19:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.279 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:52 smithi176 ceph-mon[34357]: pgmap v325: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.285 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.286 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 2, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 3422, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-12T11:19:53.287 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:53.289 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 190184, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 53, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8224, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 171, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 8512, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 13, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-12T11:19:53.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 2255, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 21, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 3, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 2255, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2255, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.026974085, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000455420 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-12T11:19:53.292 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2255, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2256 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 2255, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 2255, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 1437, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 816, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-12T11:19:53.293 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-12T11:19:53.294 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-12T11:19:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 91, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 11, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 5, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 5, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-05-12T11:19:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:19:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2521, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2156011, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2521, 2024-05-12T11:19:53.298 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2521, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2156011, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:53.299 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2255, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1433, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2255, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1433, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-12T11:19:53.300 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2255, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 2255, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2255, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2255, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.301 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-12T11:19:53.302 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55c34c1126e0": { 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:53.303 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-12T11:19:53.304 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-12T11:19:54.079 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-12T11:19:54.080 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-12T11:19:54.080 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-05-12T11:19:54.080 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:19:54.080 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:19:54.080 DEBUG:tasks.check_counter:Getting stats from c 2024-05-12T11:19:54.080 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-12T11:19:54.330 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:19:55.023 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:54 smithi176 ceph-mon[34357]: pgmap v326: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:55.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:54 smithi086 ceph-mon[30110]: pgmap v326: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:55.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:54 smithi172 ceph-mon[34517]: pgmap v326: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:56.039 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 300, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 512, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 80811, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 203249, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 8, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 2, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.055904176, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.026290201, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.019649134, 2024-05-12T11:19:56.040 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.004914667, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 514, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.040035501, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000077890 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 750, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000230679, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000307 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 0 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.041 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 29, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 92, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 6798, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 171048, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 9, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 5, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.014428654, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.004982395, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.007865025, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.000370412, 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:56.042 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 89, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.009782440, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000109915 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 41, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000009584, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000233 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 3008, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 158944 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 312, 2024-05-12T11:19:56.043 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 422, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 1781904, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 541127, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 12, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 5, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.061928412, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.021338358, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.044420314, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.005922047, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 418, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.041600727, 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000099523 2024-05-12T11:19:56.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 6, 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000557, 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000092 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 1779648, 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 466112 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 1, 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MDSRank": { 2024-05-12T11:19:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 37, 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.003092814, 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000083589 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-PurgeQueue": { 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2, 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000010214, 2024-05-12T11:19:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000005107 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "mds": { 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "request": 1, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": 0, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "reply_latency": { 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_reply": 0, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "forward": 1, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_complete": 0, 2024-05-12T11:19:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_keys": 0, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_commit": 11, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_split": 0, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_merge": 0, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes": 10, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_top": 0, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_bottom": 10, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pin_tail": 0, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pinned": 10, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_expired": 0, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_with_caps": 0, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": 0, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "subtrees": 1, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse": 4, 2024-05-12T11:19:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_hit": 4, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_forward": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_discover": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_remote_ino": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_lock": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "load_cent": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "q": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "exported": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "exported_inodes": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "imported": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "imported_inodes": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_dir_fetch": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_peer_discover": 1, 2024-05-12T11:19:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rfiles": 4, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rbytes": 234, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rsnaps": 3, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_set_tag": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_file_inodes": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_revoke": 0, 2024-05-12T11:19:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_grant": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_cap_release": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "process_request_cap_release": 0 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_cache": { 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update_receipt": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_try_discover": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_send_discover": 1, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_handle_discover": 0, 2024-05-12T11:19:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_delayed": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_created": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_enqueued": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_reintegrated": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_migrated": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_processing": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_started": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_completed": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_path": 2, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_inode": 2, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:19:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_exportdir": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_flush": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragstats": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_inodestats": 0 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_log": { 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "evlrg": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "evadd": 5, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "evex": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "evtrm": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "ev": 5, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "evexg": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "evexd": 0, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "segadd": 2, 2024-05-12T11:19:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: "segex": 0, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "segtrm": 0, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "seg": 2, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "segmjr": 2, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "segexg": 0, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "segexd": 0, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "expos": 4194304, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "wrpos": 4195732, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "rdpos": 0, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "jlat": { 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 4, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.008585451, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.002146362 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: "replayed": 0 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_mem": { 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "ino": 13, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "ino+": 13, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "ino-": 0, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "dir": 11, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "dir+": 12, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "dir-": 1, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "dn": 10, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "dn+": 10, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "dn-": 0, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "cap": 0, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "cap+": 0, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "cap-": 0, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "rss": 54940, 2024-05-12T11:19:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: "heap": 223608 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_server": { 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_client_request": 1, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_server_request": 0, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_request": 1, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_session": 13, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_peer_request": 0, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "req_create_latency": { 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getattr_latency": { 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getfilelock_latency": { 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "req_link_latency": { 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookup_latency": { 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookuphash_latency": { 2024-05-12T11:19:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupino_latency": { 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupname_latency": { 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupparent_latency": { 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupsnap_latency": { 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lssnap_latency": { 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mkdir_latency": { 2024-05-12T11:19:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mknod_latency": { 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mksnap_latency": { 2024-05-12T11:19:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "req_open_latency": { 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "req_readdir_latency": { 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.062 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rename_latency": { 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "req_renamesnap_latency": { 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "req_snapdiff_latency": { 2024-05-12T11:19:56.063 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmdir_latency": { 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmsnap_latency": { 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.064 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmxattr_latency": { 2024-05-12T11:19:56.065 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.065 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.065 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.065 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setattr_latency": { 2024-05-12T11:19:56.065 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.065 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.065 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.066 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setdirlayout_latency": { 2024-05-12T11:19:56.066 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.066 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.066 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.066 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setfilelock_latency": { 2024-05-12T11:19:56.067 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.067 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.067 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.067 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setlayout_latency": { 2024-05-12T11:19:56.067 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.067 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setxattr_latency": { 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "req_symlink_latency": { 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.068 INFO:teuthology.orchestra.run.smithi176.stdout: "req_unlink_latency": { 2024-05-12T11:19:56.069 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.069 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.069 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.069 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:19:56.069 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:19:56.069 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getvxattr_latency": { 2024-05-12T11:19:56.069 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_sessions": { 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "session_count": 1, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "session_add": 2, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "session_remove": 1, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_open": 1, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_stale": 0, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "total_load": 0, 2024-05-12T11:19:56.070 INFO:teuthology.orchestra.run.smithi176.stdout: "average_load": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "avg_session_uptime": 606, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "mdthresh_evicted": 0 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:56.071 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:56.072 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:56.073 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 230983, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 72, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 0, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:56.074 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:56.075 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:56.075 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 8224, 2024-05-12T11:19:56.075 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 171, 2024-05-12T11:19:56.075 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:56.075 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 0, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 50872, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 198, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-05-12T11:19:56.076 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 41, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 11820, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 33, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 41, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 41, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.240997435, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.005877986 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 41, 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 63 2024-05-12T11:19:56.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 41, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 0, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 41, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 10, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 4, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 8, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-05-12T11:19:56.078 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 6, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 20, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-05-12T11:19:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-05-12T11:19:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-05-12T11:19:56.081 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-05-12T11:19:56.081 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-05-12T11:19:56.081 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-05-12T11:19:56.081 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-05-12T11:19:56.081 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 91, 2024-05-12T11:19:56.081 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-05-12T11:19:56.081 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 11, 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 8, 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 8, 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 14, 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 1 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.082 INFO:teuthology.orchestra.run.smithi176.stdout: "oft": { 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_objs": 1, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_updates": 0, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_removes": 0 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "osd-slow-ops": { 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_ops_count": 4 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "purge_queue": { 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops": 0, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing": 0, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_high_water": 0, 2024-05-12T11:19:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed_ops": 0, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed": 0, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_item_in_journal": 0 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 637, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 1793586, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 637, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 637, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 1793586, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-05-12T11:19:56.085 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 41, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 11820, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 41, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 11820, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.086 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 41, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 41, 2024-05-12T11:19:56.087 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 41, 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 41, 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:56.088 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:56.089 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle-0x55d442b5c500": { 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 5, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 1428, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 5, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 4, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 1428, 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:56.090 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:56.091 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:56.091 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:56.091 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.091 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:56.091 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-05-12T11:19:56.923 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-12T11:19:56.923 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-12T11:19:56.923 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=3 2024-05-12T11:19:56.923 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:19:56.923 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:19:56.924 DEBUG:tasks.check_counter:Getting stats from f 2024-05-12T11:19:56.924 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-12T11:19:57.022 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:56 smithi176 ceph-mon[34357]: pgmap v327: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:57.162 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:19:57.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:56 smithi086 ceph-mon[30110]: pgmap v327: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:57.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:56 smithi172 ceph-mon[34517]: pgmap v327: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:19:58.787 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-05-12T11:19:58.787 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:19:58.787 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 42, 2024-05-12T11:19:58.787 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 73, 2024-05-12T11:19:58.787 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 12609, 2024-05-12T11:19:58.787 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 70254, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 13, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 2, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.014990063, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.003671478, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.008596289, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.000823563, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 72, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.014775141, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000205210 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 61, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000015294, 2024-05-12T11:19:58.788 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000250 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 6896, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 12400 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 18, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 194, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 4779, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 478305, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 9, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 5, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.012763136, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.007509490, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.002787359, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.000281115, 2024-05-12T11:19:58.789 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 191, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.031909239, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000167064 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 470592 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 652, 2024-05-12T11:19:58.790 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 808, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 1871225, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 372367, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 7, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 4, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.108134762, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.042741015, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.065435401, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.010599601, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 807, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.051081467, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000063297 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 853, 2024-05-12T11:19:58.791 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000207372, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000243 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 1771840, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 150992 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 1, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MDSRank": { 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 32, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.001325015, 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000041406 2024-05-12T11:19:58.792 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-PurgeQueue": { 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2, 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000005737, 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000002868 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "mds": { 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "request": 2, 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": 1, 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "reply_latency": { 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1, 2024-05-12T11:19:58.793 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000657844, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000657844 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_reply": 0, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "forward": 1, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_complete": 0, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_keys": 0, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_commit": 11, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_split": 0, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_merge": 0, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes": 14, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_top": 0, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_bottom": 14, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pin_tail": 0, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pinned": 14, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_expired": 0, 2024-05-12T11:19:58.794 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_with_caps": 1, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": 1, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "subtrees": 2, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse": 7, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_hit": 5, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_forward": 0, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_discover": 1, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_remote_ino": 0, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_lock": 0, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "load_cent": 0, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "q": 0, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "exported": 0, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "exported_inodes": 0, 2024-05-12T11:19:58.795 INFO:teuthology.orchestra.run.smithi176.stdout: "imported": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "imported_inodes": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_dir_fetch": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_peer_discover": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rfiles": 4, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rbytes": 234, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rsnaps": 3, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_set_tag": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:19:58.796 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_file_inodes": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_revoke": 3, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_grant": 4, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps": 4, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_cap_release": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "process_request_cap_release": 1 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_cache": { 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update_receipt": 0, 2024-05-12T11:19:58.797 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_try_discover": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_send_discover": 2, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_handle_discover": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_delayed": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_created": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_enqueued": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_reintegrated": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_migrated": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_processing": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_started": 0, 2024-05-12T11:19:58.798 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_completed": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_path": 2, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_inode": 10, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_exportdir": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_flush": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragstats": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_inodestats": 0 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_log": { 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "evlrg": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "evadd": 3, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "evex": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "evtrm": 0, 2024-05-12T11:19:58.799 INFO:teuthology.orchestra.run.smithi176.stdout: "ev": 3, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "evexg": 0, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "evexd": 0, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "segadd": 2, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "segex": 0, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "segtrm": 0, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "seg": 2, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "segmjr": 2, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "segexg": 0, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "segexd": 0, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "expos": 4194304, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "wrpos": 4195200, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "rdpos": 0, 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "jlat": { 2024-05-12T11:19:58.800 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.002880477, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001440238 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "replayed": 0 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_mem": { 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "ino": 17, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "ino+": 17, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "ino-": 0, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "dir": 15, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "dir+": 16, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "dir-": 1, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "dn": 14, 2024-05-12T11:19:58.801 INFO:teuthology.orchestra.run.smithi176.stdout: "dn+": 14, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "dn-": 0, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "cap": 1, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "cap+": 1, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "cap-": 0, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "rss": 53900, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "heap": 223608 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_server": { 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_client_request": 3, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_server_request": 0, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_request": 2, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_session": 9, 2024-05-12T11:19:58.802 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_peer_request": 0, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "req_create_latency": { 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getattr_latency": { 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000657844, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000657844 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getfilelock_latency": { 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.803 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "req_link_latency": { 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookup_latency": { 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookuphash_latency": { 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.804 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupino_latency": { 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupname_latency": { 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupparent_latency": { 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.805 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupsnap_latency": { 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lssnap_latency": { 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.806 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mkdir_latency": { 2024-05-12T11:19:58.807 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.807 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.807 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.807 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mknod_latency": { 2024-05-12T11:19:58.807 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.807 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mksnap_latency": { 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "req_open_latency": { 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "req_readdir_latency": { 2024-05-12T11:19:58.808 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rename_latency": { 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "req_renamesnap_latency": { 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "req_snapdiff_latency": { 2024-05-12T11:19:58.809 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmdir_latency": { 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmsnap_latency": { 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.810 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmxattr_latency": { 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setattr_latency": { 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setdirlayout_latency": { 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.811 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setfilelock_latency": { 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setlayout_latency": { 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setxattr_latency": { 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "req_symlink_latency": { 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "req_unlink_latency": { 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getvxattr_latency": { 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.813 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_sessions": { 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "session_count": 1, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "session_add": 1, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "session_remove": 0, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_open": 1, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_stale": 0, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "total_load": 1, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "average_load": 1, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "avg_session_uptime": 635, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "mdthresh_evicted": 0 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.814 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:19:58.815 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-05-12T11:19:58.816 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 271239, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 86, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-05-12T11:19:58.817 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 8224, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 171, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 0, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 0, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 68037, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 288, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-05-12T11:19:58.818 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 41, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 11710, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 33, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 41, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 41, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.192997945, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.004707266 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 41, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 67 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 41, 2024-05-12T11:19:58.819 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 41, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 10, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 2, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 6, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 6, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-05-12T11:19:58.820 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 20, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-05-12T11:19:58.821 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 91, 2024-05-12T11:19:58.822 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 11, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 9, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 9, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 21, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 2 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "oft": { 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_objs": 1, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_updates": 0, 2024-05-12T11:19:58.823 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_removes": 0 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "osd-slow-ops": { 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_ops_count": 12 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "purge_queue": { 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops": 0, 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing": 0, 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_high_water": 0, 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed_ops": 0, 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed": 0, 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_item_in_journal": 0 2024-05-12T11:19:58.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 708, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 1806218, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 708, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 708, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 1806218, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.825 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:58.826 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 41, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 11710, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 41, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 11710, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:19:58.827 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 41, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 41, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 41, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 41, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.828 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.829 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle-0x5630b6918500": { 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 3, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 896, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 3, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 2, 2024-05-12T11:19:58.830 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 896, 2024-05-12T11:19:58.831 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:19:58.831 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:19:58.831 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:19:58.831 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:19:58.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:19:58.831 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-05-12T11:19:59.117 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:19:58 smithi176 ceph-mon[34357]: pgmap v328: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:59.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:19:58 smithi086 ceph-mon[30110]: pgmap v328: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:59.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:19:58 smithi172 ceph-mon[34517]: pgmap v328: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:19:59.608 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-12T11:19:59.608 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-12T11:19:59.608 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=3 2024-05-12T11:19:59.608 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:19:59.609 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:19:59.609 DEBUG:tasks.check_counter:Getting stats from i 2024-05-12T11:19:59.609 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-12T11:19:59.854 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:20:01.165 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:00 smithi176 ceph-mon[34357]: pgmap v329: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:20:01.165 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:00 smithi176 ceph-mon[34357]: overall HEALTH_OK 2024-05-12T11:20:01.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:00 smithi086 ceph-mon[30110]: pgmap v329: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:20:01.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:00 smithi086 ceph-mon[30110]: overall HEALTH_OK 2024-05-12T11:20:01.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:00 smithi172 ceph-mon[34517]: pgmap v329: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-05-12T11:20:01.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:00 smithi172 ceph-mon[34517]: overall HEALTH_OK 2024-05-12T11:20:01.510 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 9157, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 13245, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 3240211, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 14483233, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 32, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 4, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.737398674, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.296082113, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.382725334, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.122898424, 2024-05-12T11:20:01.511 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 13244, 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.415242662, 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000031353 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 14468, 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.002154884, 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000148 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 2294592, 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 4787248 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.512 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 3578, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 3271, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 2943551, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 5500346, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 11, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 7, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.296672760, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.101277715, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.102656198, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.086437015, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3267, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.373282640, 2024-05-12T11:20:01.513 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000114258 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 863, 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000223858, 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000259 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 1830256, 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 154096 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 3331, 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 2276, 2024-05-12T11:20:01.514 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 1151951, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 3231273, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 34, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 6, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.317713415, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.091013373, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.109779680, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.104992490, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2276, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.383293436, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000168406 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:20:01.515 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2832, 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000580523, 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000204 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 407120, 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 263472 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 1, 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MDSRank": { 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-05-12T11:20:01.516 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 4688, 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 2.354095040, 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000502153 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-PurgeQueue": { 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 5633, 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.183099783, 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000032504 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "mds": { 2024-05-12T11:20:01.517 INFO:teuthology.orchestra.run.smithi176.stdout: "request": 2598, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": 2598, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "reply_latency": { 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2598, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 2.948105712, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001134759 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_reply": 0, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "forward": 0, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_complete": 0, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_keys": 0, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_commit": 71, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_split": 0, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_merge": 0, 2024-05-12T11:20:01.518 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes": 154, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_top": 11, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_bottom": 143, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pin_tail": 0, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pinned": 138, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_expired": 0, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_with_caps": 3, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": 3, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "subtrees": 2, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse": 2650, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_hit": 2628, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_forward": 0, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_discover": 0, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:20:01.519 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_remote_ino": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_lock": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "load_cent": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "q": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "exported": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "exported_inodes": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "imported": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "imported_inodes": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_dir_fetch": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_peer_discover": 0, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rfiles": 4, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rbytes": 234, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rsnaps": 6, 2024-05-12T11:20:01.520 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_set_tag": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_file_inodes": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_inode_file_caps": 3, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_revoke": 34, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_grant": 3640, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps": 2454, 2024-05-12T11:20:01.521 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps_dirty": 1214, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_cap_release": 13, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "process_request_cap_release": 1241 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_cache": { 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update": 0, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update_receipt": 0, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_try_discover": 0, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_send_discover": 0, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_handle_discover": 7, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays": 2, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_delayed": 0, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:20:01.522 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_created": 1212, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_enqueued": 1210, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_reintegrated": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_migrated": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_processing": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_started": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_completed": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_path": 2, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_inode": 24, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_exportdir": 0, 2024-05-12T11:20:01.523 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_flush": 0, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragstats": 0, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_inodestats": 0 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_log": { 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "evlrg": 0, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "evadd": 6199, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "evex": 6013, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "evtrm": 6013, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "ev": 186, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "evexg": 0, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "evexd": 4859, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "segadd": 20, 2024-05-12T11:20:01.524 INFO:teuthology.orchestra.run.smithi176.stdout: "segex": 19, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "segtrm": 19, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "seg": 1, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "segmjr": 1, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "segexg": 0, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "segexd": 6, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "expos": 18462653, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "wrpos": 18609318, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "rdpos": 0, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "jlat": { 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2509, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3.977791485, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001585409 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.525 INFO:teuthology.orchestra.run.smithi176.stdout: "replayed": 0 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_mem": { 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "ino": 26, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "ino+": 1236, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "ino-": 1210, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "dir": 20, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "dir+": 24, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "dir-": 4, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "dn": 154, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "dn+": 1248, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "dn-": 1094, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "cap": 3, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "cap+": 1232, 2024-05-12T11:20:01.526 INFO:teuthology.orchestra.run.smithi176.stdout: "cap-": 1229, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "rss": 60444, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "heap": 231800 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_server": { 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_client_request": 2666, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_server_request": 0, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_request": 2598, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_session": 36, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_peer_request": 0, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "req_create_latency": { 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1210, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1.290823091, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001066795 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.527 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getattr_latency": { 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 109, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.019856525, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000182169 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getfilelock_latency": { 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "req_link_latency": { 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.528 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookup_latency": { 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 9, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.001876137, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000208459 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookuphash_latency": { 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupino_latency": { 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000162172, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000162172 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.529 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupname_latency": { 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupparent_latency": { 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupsnap_latency": { 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.531 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lssnap_latency": { 2024-05-12T11:20:01.531 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 11, 2024-05-12T11:20:01.531 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.001579406, 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000143582 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mkdir_latency": { 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 12, 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.017407434, 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001450619 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mknod_latency": { 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mksnap_latency": { 2024-05-12T11:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 11, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.055064757, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.005005887 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "req_open_latency": { 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000233367, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000233367 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "req_readdir_latency": { 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 6, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.005395159, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000899193 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.533 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rename_latency": { 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2, 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.002244352, 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001122176 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "req_renamesnap_latency": { 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "req_snapdiff_latency": { 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmdir_latency": { 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 6, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.021200413, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.003533402 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmsnap_latency": { 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 5, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.023035753, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.004607150 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmxattr_latency": { 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setattr_latency": { 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1, 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000998969, 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000998969 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setdirlayout_latency": { 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setfilelock_latency": { 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.536 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setlayout_latency": { 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setxattr_latency": { 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 8, 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.021846089, 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.002730761 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "req_symlink_latency": { 2024-05-12T11:20:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "req_unlink_latency": { 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1206, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1.486382088, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001232489 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getvxattr_latency": { 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.538 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_sessions": { 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "session_count": 2, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "session_add": 6, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "session_remove": 4, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_open": 2, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_stale": 0, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "total_load": 36, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "average_load": 18, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "avg_session_uptime": 618, 2024-05-12T11:20:01.539 INFO:teuthology.orchestra.run.smithi176.stdout: "mdthresh_evicted": 0 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:20:01.540 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:20:01.541 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 343782, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 120, 2024-05-12T11:20:01.542 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 8224, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 171, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 0, 2024-05-12T11:20:01.543 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 213947, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 1992, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 6998, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 14892318, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 37, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 6998, 2024-05-12T11:20:01.544 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 6998, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 30.584672591, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.004370487 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 6998, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 7588 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 6998, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 28, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 6970, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-05-12T11:20:01.545 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 50, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 209, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 28, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 2537, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 74, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 4014, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-05-12T11:20:01.546 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 418, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-05-12T11:20:01.547 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 91, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-05-12T11:20:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 11, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 12, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 12, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 227, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 31 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "oft": { 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_objs": 1, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_updates": 0, 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_removes": 0 2024-05-12T11:20:01.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "osd-slow-ops": { 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_ops_count": 26 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "purge_queue": { 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops": 0, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops_high_water": 10, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing": 0, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_high_water": 4, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed_ops": 3496, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed": 1210, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_item_in_journal": 0 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:20:01.550 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 16062, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 5529089, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 16062, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 16062, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 5529089, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.551 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 6998, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 15014536, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 6998, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 15014536, 2024-05-12T11:20:01.552 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 6998, 2024-05-12T11:20:01.553 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 6998, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 6998, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 6998, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:01.554 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 1210, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 122218, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 1210, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 28, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 122218, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle-0x55b7ad294500": { 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 84, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 6199, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 14415014, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 6199, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 2509, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 14414930, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:01.556 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:01.557 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:01.557 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.557 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:01.557 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-05-12T11:20:02.386 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-05-12T11:20:02.386 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-05-12T11:20:02.386 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-05-12T11:20:02.387 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-05-12T11:20:02.387 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-05-12T11:20:02.387 DEBUG:tasks.check_counter:Getting stats from l 2024-05-12T11:20:02.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-12T11:20:02.626 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.c/config 2024-05-12T11:20:03.002 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:02 smithi176 ceph-mon[34357]: pgmap v330: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:20:03.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:02 smithi086 ceph-mon[30110]: pgmap v330: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:20:03.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:02 smithi172 ceph-mon[34517]: pgmap v330: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:20:04.281 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-05-12T11:20:04.281 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-05-12T11:20:04.281 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 2387, 2024-05-12T11:20:04.281 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 2389, 2024-05-12T11:20:04.281 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 676788, 2024-05-12T11:20:04.281 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 759073, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 6, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 2, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.196346032, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.065853319, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.046355896, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.068643989, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2387, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.087544811, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000036675 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.282 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 0 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 273, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 258, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 1757884, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 150538, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 3, 2024-05-12T11:20:04.283 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 2, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.051449919, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.015634110, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.040540638, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.006017090, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 258, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.014523876, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000056294 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 1757328, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 149840 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 3, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 183, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 588, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 471614, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 6, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 4, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.013201225, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.007242341, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.003731802, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.000043412, 2024-05-12T11:20:04.285 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 180, 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.012236706, 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000067981 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 471296 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-05-12T11:20:04.286 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 1, 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MDSRank": { 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 4034, 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.106829078, 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000026482 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-PurgeQueue": { 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.287 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "mds": { 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "request": 0, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": 0, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "reply_latency": { 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_reply": 0, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "forward": 0, 2024-05-12T11:20:04.288 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_complete": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_keys": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_commit": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_split": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_merge": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_top": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_bottom": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pin_tail": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pinned": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_expired": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_with_caps": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "subtrees": 1, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_hit": 0, 2024-05-12T11:20:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_forward": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_discover": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_dir_fetch": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_remote_ino": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_lock": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "load_cent": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "q": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "exported": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "exported_inodes": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "imported": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "imported_inodes": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_dir_fetch": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_backtrace_fetch": 0, 2024-05-12T11:20:04.290 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_peer_discover": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rfiles": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rbytes": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rsnaps": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_fetch": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_set_tag": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_repaired": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_inotable_repaired": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_inodes": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_base_inodes": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dirfrag_rstats": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_file_inodes": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_inode_file_caps": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_revoke": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_grant": 0, 2024-05-12T11:20:04.291 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_trunc": 0, 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps": 0, 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps_dirty": 0, 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_cap_release": 0, 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: "process_request_cap_release": 0 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_cache": { 2024-05-12T11:20:04.292 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update": 0, 2024-05-12T11:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update_receipt": 0, 2024-05-12T11:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_try_discover": 0, 2024-05-12T11:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_send_discover": 0, 2024-05-12T11:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_handle_discover": 0, 2024-05-12T11:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays": 0, 2024-05-12T11:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_delayed": 0, 2024-05-12T11:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_enqueuing": 0, 2024-05-12T11:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_created": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_enqueued": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_reintegrated": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_migrated": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_processing": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_enqueued": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_prioritized": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_started": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_completed": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_path": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_inode": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_enqueue_scrub": 0, 2024-05-12T11:20:04.294 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_exportdir": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_flush": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragmentdir": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragstats": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_inodestats": 0 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_log": { 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "evlrg": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "evadd": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "evex": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "evtrm": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "ev": 7, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "evexg": 0, 2024-05-12T11:20:04.295 INFO:teuthology.orchestra.run.smithi176.stdout: "evexd": 0, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "segadd": 0, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "segex": 0, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "segtrm": 0, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "seg": 2, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "segmjr": 2, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "segexg": 0, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "segexd": 0, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "expos": 4194304, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "wrpos": 4196347, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "rdpos": 4196206, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "jlat": { 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.296 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "replayed": 7 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_mem": { 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "ino": 3, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "ino+": 3, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "ino-": 0, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "dir": 1, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "dir+": 1, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "dir-": 0, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "dn": 0, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "dn+": 0, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "dn-": 0, 2024-05-12T11:20:04.297 INFO:teuthology.orchestra.run.smithi176.stdout: "cap": 0, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "cap+": 0, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "cap-": 0, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "rss": 53452, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "heap": 215416 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_server": { 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_client_request": 0, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_server_request": 0, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_request": 0, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_session": 0, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_peer_request": 0, 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "req_create_latency": { 2024-05-12T11:20:04.298 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getattr_latency": { 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getfilelock_latency": { 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.299 INFO:teuthology.orchestra.run.smithi176.stdout: "req_link_latency": { 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookup_latency": { 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookuphash_latency": { 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.300 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupino_latency": { 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupname_latency": { 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupparent_latency": { 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.302 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupsnap_latency": { 2024-05-12T11:20:04.302 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.302 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.302 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.302 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lssnap_latency": { 2024-05-12T11:20:04.302 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.303 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.303 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.303 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mkdir_latency": { 2024-05-12T11:20:04.303 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.304 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.304 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mknod_latency": { 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mksnap_latency": { 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.306 INFO:teuthology.orchestra.run.smithi176.stdout: "req_open_latency": { 2024-05-12T11:20:04.306 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.306 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.306 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.306 INFO:teuthology.orchestra.run.smithi176.stdout: "req_readdir_latency": { 2024-05-12T11:20:04.306 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rename_latency": { 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "req_renamesnap_latency": { 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: "req_snapdiff_latency": { 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmdir_latency": { 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmsnap_latency": { 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmxattr_latency": { 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setattr_latency": { 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setdirlayout_latency": { 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setfilelock_latency": { 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setlayout_latency": { 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.310 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setxattr_latency": { 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "req_symlink_latency": { 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "req_unlink_latency": { 2024-05-12T11:20:04.311 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_revoke_eviction": 0, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_acquisition_throttle": 0, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getvxattr_latency": { 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_sessions": { 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "session_count": 1, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "session_add": 3, 2024-05-12T11:20:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: "session_remove": 2, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_open": 2, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_stale": 0, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "total_load": 0, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "average_load": 0, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "avg_session_uptime": 3461, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "mdthresh_evicted": 0 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-05-12T11:20:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-12T11:20:04.314 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-05-12T11:20:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 182088, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 48, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-05-12T11:20:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 8224, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 171, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 8512, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 13, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-05-12T11:20:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 2390, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 21, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 3, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 2390, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2390, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1.038988819, 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000434723 2024-05-12T11:20:04.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2390, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 2391 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 2390, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 2390, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 1559, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 829, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-05-12T11:20:04.319 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 1, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-05-12T11:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-05-12T11:20:04.321 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 91, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 11, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 4, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 4, 2024-05-12T11:20:04.322 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 2, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "oft": { 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_objs": 0, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_kv_pairs": 0, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_updates": 0, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_removes": 0 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "osd-slow-ops": { 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_ops_count": 0 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.323 INFO:teuthology.orchestra.run.smithi176.stdout: "purge_queue": { 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops": 0, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops_high_water": 0, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing": 0, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_high_water": 0, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed_ops": 0, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed": 0, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_item_in_journal": 0 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 2659, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 2179242, 2024-05-12T11:20:04.324 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 2659, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 2659, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 2179242, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:04.325 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 2390, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 2048, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 2390, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 2048, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.326 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 2390, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 2390, 2024-05-12T11:20:04.327 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 2390, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 2390, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle": { 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:20:04.328 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle-0x55574c5546e0": { 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-05-12T11:20:04.329 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-05-12T11:20:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-05-12T11:20:04.331 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-05-12T11:20:04.331 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-05-12T11:20:04.331 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.331 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-12T11:20:04.331 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-05-12T11:20:05.023 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:04 smithi176 ceph-mon[34357]: pgmap v331: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:20:05.121 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-12T11:20:05.122 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-12T11:20:05.122 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-05-12T11:20:05.122 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-05-12T11:20:05.122 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-05-12T11:20:05.122 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-12T11:20:05.135 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-12T11:20:05.135 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T11:20:05.135 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T11:20:05.156 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-05-12T11:20:05.156 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T11:20:05.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-12T11:20:05.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:04 smithi086 ceph-mon[30110]: pgmap v331: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:20:05.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:04 smithi172 ceph-mon[34517]: pgmap v331: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-12T11:20:05.472 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:20:07.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 -- 172.21.15.86:0/968800835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f81023a0 msgr2=0x7f31f8102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 --2- 172.21.15.86:0/968800835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f81023a0 0x7f31f8102820 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009990 tx=0x7f31ec009ca0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 -- 172.21.15.86:0/968800835 shutdown_connections 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 --2- 172.21.15.86:0/968800835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f8102d60 0x7f31f810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 --2- 172.21.15.86:0/968800835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f8108410 0x7f31f81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 --2- 172.21.15.86:0/968800835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f81023a0 0x7f31f8102820 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 -- 172.21.15.86:0/968800835 >> 172.21.15.86:0/968800835 conn(0x7f31f8079350 msgr2=0x7f31f8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 -- 172.21.15.86:0/968800835 shutdown_connections 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.160+0000 7f31ff794700 1 -- 172.21.15.86:0/968800835 wait complete. 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31ff794700 1 Processor -- start 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31ff794700 1 -- start start 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31ff794700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f81023a0 0x7f31f8104080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31ff794700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f8102d60 0x7f31f81045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:07.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31ff794700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f8108410 0x7f31f8104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31ff794700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f31f8112550 con 0x7f31f8102d60 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31ff794700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31f81123d0 con 0x7f31f8108410 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31ff794700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31f81126d0 con 0x7f31f81023a0 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31fcd2f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f8102d60 0x7f31f81045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31fcd2f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f8102d60 0x7f31f81045c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57130/0 (socket says 172.21.15.86:57130) 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31fcd2f700 1 -- 172.21.15.86:0/1061968710 learned_addr learned my addr 172.21.15.86:0/1061968710 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.161+0000 7f31fd530700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f81023a0 0x7f31f8104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31fcd2f700 1 -- 172.21.15.86:0/1061968710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f81023a0 msgr2=0x7f31f8104080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31fcd2f700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f81023a0 0x7f31f8104080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31fdd31700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f8108410 0x7f31f8104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31fcd2f700 1 -- 172.21.15.86:0/1061968710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f8108410 msgr2=0x7f31f8104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31fcd2f700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f8108410 0x7f31f8104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31fcd2f700 1 -- 172.21.15.86:0/1061968710 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f81a8030 con 0x7f31f8102d60 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31fcd2f700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f8102d60 0x7f31f81045c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f31ec000c00 tx=0x7f31ec0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:07.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31ea7fc700 1 -- 172.21.15.86:0/1061968710 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec027070 con 0x7f31f8102d60 2024-05-12T11:20:07.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31ea7fc700 1 -- 172.21.15.86:0/1061968710 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31ec0041d0 con 0x7f31f8102d60 2024-05-12T11:20:07.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f81a82c0 con 0x7f31f8102d60 2024-05-12T11:20:07.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31ea7fc700 1 -- 172.21.15.86:0/1061968710 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec00f460 con 0x7f31f8102d60 2024-05-12T11:20:07.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.162+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f81a8770 con 0x7f31f8102d60 2024-05-12T11:20:07.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.163+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f806a190 con 0x7f31f8102d60 2024-05-12T11:20:07.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.165+0000 7f31ea7fc700 1 -- 172.21.15.86:0/1061968710 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f31ec02a070 con 0x7f31f8102d60 2024-05-12T11:20:07.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.166+0000 7f31ea7fc700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f31e40b2a70 0x7f31e40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:07.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.166+0000 7f31fd530700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f31e40b2a70 0x7f31e40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:07.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.166+0000 7f31ea7fc700 1 -- 172.21.15.86:0/1061968710 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f31ec0e39c0 con 0x7f31f8102d60 2024-05-12T11:20:07.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.167+0000 7f31fd530700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f31e40b2a70 0x7f31e40b4f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f31f4005fd0 tx=0x7f31f4005d90 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:07.164 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:06 smithi086 ceph-mon[30110]: pgmap v332: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:20:07.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.171+0000 7f31ea7fc700 1 -- 172.21.15.86:0/1061968710 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f31ec031070 con 0x7f31f8102d60 2024-05-12T11:20:07.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:06 smithi172 ceph-mon[34517]: pgmap v332: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:20:07.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:06 smithi176 ceph-mon[34357]: pgmap v332: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-05-12T11:20:07.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.395+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f31f81a89d0 con 0x7f31f8102d60 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.396+0000 7f31ea7fc700 1 -- 172.21.15.86:0/1061968710 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v91) ==== 81+0+942 (secure 0 0 0) 0x7f31ec013070 con 0x7f31f8102d60 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/155657181 2024-05-13T11:09:23.662823+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/2138389102 2024-05-13T11:09:23.662823+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/2852030835 2024-05-13T11:09:23.662823+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/3515811906 2024-05-13T10:58:43.982021+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3505671883 2024-05-13T11:09:23.662823+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/4157495437 2024-05-13T10:58:43.982021+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/636932738 2024-05-13T10:58:43.982021+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3025922080 2024-05-13T10:58:16.834530+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/155657181 2024-05-13T11:09:23.662823+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/4229502845 2024-05-13T11:09:23.662823+0000 2024-05-12T11:20:07.394 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/1257416774 2024-05-13T10:58:16.834530+0000 2024-05-12T11:20:07.395 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3479534219 2024-05-13T10:58:43.982021+0000 2024-05-12T11:20:07.395 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/1055215670 2024-05-13T10:58:16.834530+0000 2024-05-12T11:20:07.395 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/1257416774 2024-05-13T10:58:16.834530+0000 2024-05-12T11:20:07.395 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/995517811 2024-05-13T10:58:16.834530+0000 2024-05-12T11:20:07.395 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/3515811906 2024-05-13T10:58:43.982021+0000 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f31e40b2a70 msgr2=0x7f31e40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f31e40b2a70 0x7f31e40b4f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f31f4005fd0 tx=0x7f31f4005d90 comp rx=0 tx=0).stop 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f8102d60 msgr2=0x7f31f81045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f8102d60 0x7f31f81045c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f31ec000c00 tx=0x7f31ec0047b0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 shutdown_connections 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f8108410 0x7f31f8104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f81023a0 0x7f31f8104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f31e40b2a70 0x7f31e40b4f30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 --2- 172.21.15.86:0/1061968710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31f8102d60 0x7f31f81045c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 >> 172.21.15.86:0/1061968710 conn(0x7f31f8079350 msgr2=0x7f31f8101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 shutdown_connections 2024-05-12T11:20:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:07.398+0000 7f31ff794700 1 -- 172.21.15.86:0/1061968710 wait complete. 2024-05-12T11:20:07.397 INFO:teuthology.orchestra.run.smithi086.stderr:listed 16 entries 2024-05-12T11:20:08.027 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:07 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1061968710' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-12T11:20:08.054 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-12T11:20:08.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:20:08.054 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-12T11:20:08.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:20:08.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:20:08.098 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-12T11:20:08.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:20:08.162 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-05-12T11:20:08.217 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-12T11:20:08.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:20:08.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T11:20:08.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:07 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1061968710' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-12T11:20:08.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:07 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1061968710' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-12T11:20:08.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T11:20:08.284 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-05-12T11:20:08.396 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-12T11:20:08.407 INFO:tasks.cephadm:Teardown begin 2024-05-12T11:20:08.407 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-12T11:20:08.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:20:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:20:09.099 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:08 smithi086 ceph-mon[30110]: pgmap v333: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:20:09.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:08 smithi172 ceph-mon[34517]: pgmap v333: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:20:09.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:08 smithi176 ceph-mon[34357]: pgmap v333: 97 pgs: 97 active+clean; 3.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-12T11:20:10.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 -- 172.21.15.86:0/3677589525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908108410 msgr2=0x7fb9081087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:10.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/3677589525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908108410 0x7fb9081087f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb90000b0a0 tx=0x7fb90000b3b0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 -- 172.21.15.86:0/3677589525 shutdown_connections 2024-05-12T11:20:10.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/3677589525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb908102d60 0x7fb90810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/3677589525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908108410 0x7fb9081087f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/3677589525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9081023a0 0x7fb908102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 -- 172.21.15.86:0/3677589525 >> 172.21.15.86:0/3677589525 conn(0x7fb908079350 msgr2=0x7fb908079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:10.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 -- 172.21.15.86:0/3677589525 shutdown_connections 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.245+0000 7fb90fa0b700 1 -- 172.21.15.86:0/3677589525 wait complete. 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90fa0b700 1 Processor -- start 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90fa0b700 1 -- start start 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90fa0b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9081023a0 0x7fb90819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90fa0b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908102d60 0x7fb90819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90fa0b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb908108410 0x7fb9081999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90fa0b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb908112530 con 0x7fb908102d60 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90fa0b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9081123b0 con 0x7fb9081023a0 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90fa0b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9081126b0 con 0x7fb908108410 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90cfa6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908102d60 0x7fb90819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90cfa6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908102d60 0x7fb90819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57138/0 (socket says 172.21.15.86:57138) 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90cfa6700 1 -- 172.21.15.86:0/1298420961 learned_addr learned my addr 172.21.15.86:0/1298420961 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:20:10.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90d7a7700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9081023a0 0x7fb90819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.246+0000 7fb90dfa8700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb908108410 0x7fb9081999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb90cfa6700 1 -- 172.21.15.86:0/1298420961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb908108410 msgr2=0x7fb9081999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb90cfa6700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb908108410 0x7fb9081999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb90cfa6700 1 -- 172.21.15.86:0/1298420961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9081023a0 msgr2=0x7fb90819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb90cfa6700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9081023a0 0x7fb90819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb90cfa6700 1 -- 172.21.15.86:0/1298420961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90819a110 con 0x7fb908102d60 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb90cfa6700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908102d60 0x7fb90819fd30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800e9a0 tx=0x7fb8f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb8fe7fc700 1 -- 172.21.15.86:0/1298420961 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800ca10 con 0x7fb908102d60 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90819a400 con 0x7fb908102d60 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb8fe7fc700 1 -- 172.21.15.86:0/1298420961 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f800cbb0 con 0x7fb908102d60 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb8fe7fc700 1 -- 172.21.15.86:0/1298420961 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8018680 con 0x7fb908102d60 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.247+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9081a66c0 con 0x7fb908102d60 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.248+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb90806a190 con 0x7fb908102d60 2024-05-12T11:20:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.249+0000 7fb8fe7fc700 1 -- 172.21.15.86:0/1298420961 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fb8f8010430 con 0x7fb908102d60 2024-05-12T11:20:10.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.250+0000 7fb8fe7fc700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb8f40b29f0 0x7fb8f40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:10.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.250+0000 7fb90d7a7700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb8f40b29f0 0x7fb8f40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:10.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.251+0000 7fb8fe7fc700 1 -- 172.21.15.86:0/1298420961 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8615+0+0 (secure 0 0 0) 0x7fb8f80e2bc0 con 0x7fb908102d60 2024-05-12T11:20:10.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.251+0000 7fb90d7a7700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb8f40b29f0 0x7fb8f40b4eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb900009fd0 tx=0x7fb90000b700 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:10.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.254+0000 7fb8fe7fc700 1 -- 172.21.15.86:0/1298420961 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb8f80aa4e0 con 0x7fb908102d60 2024-05-12T11:20:10.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.507+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9081a68f0 con 0x7fb908102d60 2024-05-12T11:20:10.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.508+0000 7fb8fe7fc700 1 -- 172.21.15.86:0/1298420961 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7fb8f80a9de0 con 0x7fb908102d60 2024-05-12T11:20:10.506 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:20:10.506 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb8f40b29f0 msgr2=0x7fb8f40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb8f40b29f0 0x7fb8f40b4eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb900009fd0 tx=0x7fb90000b700 comp rx=0 tx=0).stop 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908102d60 msgr2=0x7fb90819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908102d60 0x7fb90819fd30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800e9a0 tx=0x7fb8f800ecb0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 shutdown_connections 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb908108410 0x7fb9081999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9081023a0 0x7fb90819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fb8f40b29f0 0x7fb8f40b4eb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 --2- 172.21.15.86:0/1298420961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb908102d60 0x7fb90819fd30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 >> 172.21.15.86:0/1298420961 conn(0x7fb908079350 msgr2=0x7fb908106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:10.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 shutdown_connections 2024-05-12T11:20:10.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:10.510+0000 7fb90fa0b700 1 -- 172.21.15.86:0/1298420961 wait complete. 2024-05-12T11:20:10.509 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:20:11.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:10 smithi086 ceph-mon[30110]: pgmap v334: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-05-12T11:20:11.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:10 smithi086 ceph-mon[30110]: osdmap e92: 12 total, 12 up, 12 in 2024-05-12T11:20:11.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:10 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1298420961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:20:11.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-12T11:20:11.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:10 smithi172 ceph-mon[34517]: pgmap v334: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-05-12T11:20:11.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:10 smithi172 ceph-mon[34517]: osdmap e92: 12 total, 12 up, 12 in 2024-05-12T11:20:11.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:10 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1298420961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:20:11.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:10 smithi176 ceph-mon[34357]: pgmap v334: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-05-12T11:20:11.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:10 smithi176 ceph-mon[34357]: osdmap e92: 12 total, 12 up, 12 in 2024-05-12T11:20:11.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:10 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1298420961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:20:11.451 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 -- 172.21.15.86:0/1966706777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888108850 msgr2=0x7fa8881103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 --2- 172.21.15.86:0/1966706777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888108850 0x7fa8881103d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa8800099c0 tx=0x7fa880009cd0 comp rx=0 tx=0).stop 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 -- 172.21.15.86:0/1966706777 shutdown_connections 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 --2- 172.21.15.86:0/1966706777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888108850 0x7fa8881103d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 --2- 172.21.15.86:0/1966706777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa888103750 0x7fa888103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 --2- 172.21.15.86:0/1966706777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa888104100 0x7fa888108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 -- 172.21.15.86:0/1966706777 >> 172.21.15.86:0/1966706777 conn(0x7fa88807a600 msgr2=0x7fa88807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 -- 172.21.15.86:0/1966706777 shutdown_connections 2024-05-12T11:20:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.979+0000 7fa88f388700 1 -- 172.21.15.86:0/1966706777 wait complete. 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88f388700 1 Processor -- start 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88f388700 1 -- start start 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88f388700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888103750 0x7fa8880757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88f388700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa888104100 0x7fa888075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88f388700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa888108850 0x7fa888076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88f388700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa888113640 con 0x7fa888103750 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88f388700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa8881134c0 con 0x7fa888108850 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88f388700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8881137c0 con 0x7fa888104100 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88d124700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888103750 0x7fa8880757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88d124700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888103750 0x7fa8880757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34430/0 (socket says 172.21.15.86:34430) 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88d124700 1 -- 172.21.15.86:0/3407158527 learned_addr learned my addr 172.21.15.86:0/3407158527 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88c923700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa888104100 0x7fa888075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.980+0000 7fa88d925700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa888108850 0x7fa888076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa88d124700 1 -- 172.21.15.86:0/3407158527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa888104100 msgr2=0x7fa888075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa88d124700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa888104100 0x7fa888075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa88d124700 1 -- 172.21.15.86:0/3407158527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa888108850 msgr2=0x7fa888076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa88d124700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa888108850 0x7fa888076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa88d124700 1 -- 172.21.15.86:0/3407158527 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8881a7fa0 con 0x7fa888103750 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa88d124700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888103750 0x7fa8880757a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa87800d950 tx=0x7fa87800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa8867fc700 1 -- 172.21.15.86:0/3407158527 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878016070 con 0x7fa888103750 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa8867fc700 1 -- 172.21.15.86:0/3407158527 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa87800fd40 con 0x7fa888103750 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8881a8290 con 0x7fa888103750 2024-05-12T11:20:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa8867fc700 1 -- 172.21.15.86:0/3407158527 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87800e3b0 con 0x7fa888103750 2024-05-12T11:20:12.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.981+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8881a87d0 con 0x7fa888103750 2024-05-12T11:20:12.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.982+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa88806a190 con 0x7fa888103750 2024-05-12T11:20:12.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.983+0000 7fa8867fc700 1 -- 172.21.15.86:0/3407158527 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fa878019070 con 0x7fa888103750 2024-05-12T11:20:12.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.984+0000 7fa8867fc700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa8700b29f0 0x7fa8700b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:12.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.984+0000 7fa88c923700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa8700b29f0 0x7fa8700b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:12.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.984+0000 7fa8867fc700 1 -- 172.21.15.86:0/3407158527 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8615+0+0 (secure 0 0 0) 0x7fa8780e20d0 con 0x7fa888103750 2024-05-12T11:20:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.984+0000 7fa88c923700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa8700b29f0 0x7fa8700b4eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa87c007fd0 tx=0x7fa87c00c040 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:12.987+0000 7fa8867fc700 1 -- 172.21.15.86:0/3407158527 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa8780a9a50 con 0x7fa888103750 2024-05-12T11:20:13.218 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:12 smithi086 ceph-mon[30110]: pgmap v336: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-12T11:20:13.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:12 smithi172 ceph-mon[34517]: pgmap v336: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-12T11:20:13.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.236+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa88802e6d0 con 0x7fa888103750 2024-05-12T11:20:13.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.236+0000 7fa8867fc700 1 -- 172.21.15.86:0/3407158527 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11935 (secure 0 0 0) 0x7fa8780a9350 con 0x7fa888103750 2024-05-12T11:20:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:20:13.234 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2771013061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2771013061},{"type":"v1","addr":"172.21.15.86:6835","nonce":2771013061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1659604028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":1659604028},{"type":"v1","addr":"172.21.15.86:6837","nonce":1659604028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-12T11:06:07.078153+0000","modified":"2024-05-12T11:09:21.361894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24466,"mds_1":24443,"mds_2":24442,"mds_3":24436,"mds_4":24422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6839/2477289859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":2477289859},{"type":"v1","addr":"172.21.15.86:6839","nonce":2477289859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6841/637755871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":637755871},{"type":"v1","addr":"172.21.15.86:6841","nonce":637755871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24383":{"gid":24383,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3992302401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3992302401},{"type":"v1","addr":"172.21.15.172:6833","nonce":3992302401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/868497491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":868497491},{"type":"v1","addr":"172.21.15.176:6833","nonce":868497491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3404000495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3404000495},{"type":"v1","addr":"172.21.15.172:6835","nonce":3404000495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.172:6837/2564045723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2564045723},{"type":"v1","addr":"172.21.15.172:6837","nonce":2564045723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.176:6835/197047059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":197047059},{"type":"v1","addr":"172.21.15.176:6835","nonce":197047059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.176:6837/2905239515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2905239515},{"type":"v1","addr":"172.21.15.176:6837","nonce":2905239515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/2644756211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2644756211},{"type":"v1","addr":"172.21.15.172:6839","nonce":2644756211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.176:6839/410261641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":410261641},{"type":"v1","addr":"172.21.15.176:6839","nonce":410261641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24442,24443,24422,24436]},"id":1}]} 2024-05-12T11:20:13.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa8700b29f0 msgr2=0x7fa8700b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:13.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa8700b29f0 0x7fa8700b4eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa87c007fd0 tx=0x7fa87c00c040 comp rx=0 tx=0).stop 2024-05-12T11:20:13.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888103750 msgr2=0x7fa8880757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:13.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888103750 0x7fa8880757a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa87800d950 tx=0x7fa87800dc60 comp rx=0 tx=0).stop 2024-05-12T11:20:13.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 shutdown_connections 2024-05-12T11:20:13.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa888108850 0x7fa888076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:13.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa8700b29f0 0x7fa8700b4eb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa888103750 0x7fa8880757a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 --2- 172.21.15.86:0/3407158527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa888104100 0x7fa888075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 >> 172.21.15.86:0/3407158527 conn(0x7fa88807a600 msgr2=0x7fa888101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 shutdown_connections 2024-05-12T11:20:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:13.239+0000 7fa88f388700 1 -- 172.21.15.86:0/3407158527 wait complete. 2024-05-12T11:20:13.239 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-05-12T11:20:13.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:12 smithi176 ceph-mon[34357]: pgmap v336: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-12T11:20:13.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-12T11:20:14.150 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:20:14.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:13 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3407158527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:20:14.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:13 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3407158527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:20:14.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:13 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3407158527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-12T11:20:15.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:14 smithi086 ceph-mon[30110]: pgmap v337: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-12T11:20:15.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:14 smithi172 ceph-mon[34517]: pgmap v337: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-12T11:20:15.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:14 smithi176 ceph-mon[34357]: pgmap v337: 97 pgs: 97 active+clean; 3.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-12T11:20:15.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 -- 172.21.15.86:0/2523639061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20103040 msgr2=0x7f4b20107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:15.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 --2- 172.21.15.86:0/2523639061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20103040 0x7f4b20107000 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0099c0 tx=0x7f4b0c009cd0 comp rx=0 tx=0).stop 2024-05-12T11:20:15.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 -- 172.21.15.86:0/2523639061 shutdown_connections 2024-05-12T11:20:15.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 --2- 172.21.15.86:0/2523639061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b201076e0 0x7f4b2010f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:15.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 --2- 172.21.15.86:0/2523639061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20102690 0x7f4b20102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:15.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 --2- 172.21.15.86:0/2523639061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20103040 0x7f4b20107000 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:15.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 -- 172.21.15.86:0/2523639061 >> 172.21.15.86:0/2523639061 conn(0x7f4b200783f0 msgr2=0x7f4b20078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:15.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 -- 172.21.15.86:0/2523639061 shutdown_connections 2024-05-12T11:20:15.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.857+0000 7f4b26f07700 1 -- 172.21.15.86:0/2523639061 wait complete. 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b26f07700 1 Processor -- start 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b26f07700 1 -- start start 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b26f07700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20102690 0x7f4b2019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b26f07700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20103040 0x7f4b2019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b26f07700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b201076e0 0x7f4b20199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b26f07700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b20112550 con 0x7f4b20102690 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b26f07700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201123d0 con 0x7f4b20103040 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b26f07700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201126d0 con 0x7f4b201076e0 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b24ca3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20102690 0x7f4b2019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b24ca3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20102690 0x7f4b2019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34446/0 (socket says 172.21.15.86:34446) 2024-05-12T11:20:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b24ca3700 1 -- 172.21.15.86:0/3797727818 learned_addr learned my addr 172.21.15.86:0/3797727818 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b254a4700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b201076e0 0x7f4b20199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b1ffff700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20103040 0x7f4b2019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b24ca3700 1 -- 172.21.15.86:0/3797727818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b201076e0 msgr2=0x7f4b20199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b24ca3700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b201076e0 0x7f4b20199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b24ca3700 1 -- 172.21.15.86:0/3797727818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20103040 msgr2=0x7f4b2019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b24ca3700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20103040 0x7f4b2019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.858+0000 7f4b24ca3700 1 -- 172.21.15.86:0/3797727818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2019a180 con 0x7f4b20102690 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.859+0000 7f4b1ffff700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20103040 0x7f4b2019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.859+0000 7f4b24ca3700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20102690 0x7f4b2019f860 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400ef10 tx=0x7f4b1400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.859+0000 7f4b1dffb700 1 -- 172.21.15.86:0/3797727818 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400ca70 con 0x7f4b20102690 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.859+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2019a410 con 0x7f4b20102690 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.859+0000 7f4b1dffb700 1 -- 172.21.15.86:0/3797727818 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b14019070 con 0x7f4b20102690 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.859+0000 7f4b1dffb700 1 -- 172.21.15.86:0/3797727818 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14014480 con 0x7f4b20102690 2024-05-12T11:20:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.859+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b201a6730 con 0x7f4b20102690 2024-05-12T11:20:15.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.860+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2006a190 con 0x7f4b20102690 2024-05-12T11:20:15.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.861+0000 7f4b1dffb700 1 -- 172.21.15.86:0/3797727818 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f4b14012050 con 0x7f4b20102690 2024-05-12T11:20:15.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.862+0000 7f4b1dffb700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4b100b29f0 0x7f4b100b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:15.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.862+0000 7f4b1ffff700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4b100b29f0 0x7f4b100b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:15.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.862+0000 7f4b1dffb700 1 -- 172.21.15.86:0/3797727818 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8615+0+0 (secure 0 0 0) 0x7f4b140e2730 con 0x7f4b20102690 2024-05-12T11:20:15.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.862+0000 7f4b1ffff700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4b100b29f0 0x7f4b100b4eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009990 tx=0x7f4b0c005a90 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:15.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:15.867+0000 7f4b1dffb700 1 -- 172.21.15.86:0/3797727818 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4b14010040 con 0x7f4b20102690 2024-05-12T11:20:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.071+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b201a6900 con 0x7f4b20102690 2024-05-12T11:20:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.073+0000 7f4b1dffb700 1 -- 172.21.15.86:0/3797727818 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23279 (secure 0 0 0) 0x7f4b140aa0b0 con 0x7f4b20102690 2024-05-12T11:20:16.071 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-05-12T11:20:16.071 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":92,"fsid":"513c80a2-104e-11ef-bc98-c7b262605968","created":"2024-05-12T10:57:49.284318+0000","modified":"2024-05-12T11:20:09.924308+0000","last_up_change":"2024-05-12T11:05:00.380843+0000","last_in_change":"2024-05-12T11:04:40.664441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T11:01:12.074132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T11:06:00.763348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T11:06:04.018363+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d3771cb-dd57-494b-ba95-1cf9a0d5d840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6803","nonce":2476610607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6805","nonce":2476610607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6809","nonce":2476610607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2476610607},{"type":"v1","addr":"172.21.15.86:6807","nonce":2476610607}]},"public_addr":"172.21.15.86:6803/2476610607","cluster_addr":"172.21.15.86:6805/2476610607","heartbeat_back_addr":"172.21.15.86:6809/2476610607","heartbeat_front_addr":"172.21.15.86:6807/2476610607","state":["exists","up"]},{"osd":1,"uuid":"34298bec-64f8-4ede-a3de-f974d74e2cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6801","nonce":3776376045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6803","nonce":3776376045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6807","nonce":3776376045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3776376045},{"type":"v1","addr":"172.21.15.172:6805","nonce":3776376045}]},"public_addr":"172.21.15.172:6801/3776376045","cluster_addr":"172.21.15.172:6803/3776376045","heartbeat_back_addr":"172.21.15.172:6807/3776376045","heartbeat_front_addr":"172.21.15.172:6805/3776376045","state":["exists","up"]},{"osd":2,"uuid":"de1f858a-97d7-471d-8b4b-cc315316c20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6801","nonce":753242720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6803","nonce":753242720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6807","nonce":753242720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":753242720},{"type":"v1","addr":"172.21.15.176:6805","nonce":753242720}]},"public_addr":"172.21.15.176:6801/753242720","cluster_addr":"172.21.15.176:6803/753242720","heartbeat_back_addr":"172.21.15.176:6807/753242720","heartbeat_front_addr":"172.21.15.176:6805/753242720","state":["exists","up"]},{"osd":3,"uuid":"e87f2dd2-dbd2-4b99-a8c3-29bb9b306da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6811","nonce":743430147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6813","nonce":743430147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6817","nonce":743430147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":743430147},{"type":"v1","addr":"172.21.15.86:6815","nonce":743430147}]},"public_addr":"172.21.15.86:6811/743430147","cluster_addr":"172.21.15.86:6813/743430147","heartbeat_back_addr":"172.21.15.86:6817/743430147","heartbeat_front_addr":"172.21.15.86:6815/743430147","state":["exists","up"]},{"osd":4,"uuid":"5d396904-c535-4618-afc4-706ddd9c478b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6809","nonce":3299166420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6811","nonce":3299166420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6815","nonce":3299166420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3299166420},{"type":"v1","addr":"172.21.15.172:6813","nonce":3299166420}]},"public_addr":"172.21.15.172:6809/3299166420","cluster_addr":"172.21.15.172:6811/3299166420","heartbeat_back_addr":"172.21.15.172:6815/3299166420","heartbeat_front_addr":"172.21.15.172:6813/3299166420","state":["exists","up"]},{"osd":5,"uuid":"41cdc75e-1b3c-4555-8135-71c5fc91a504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6809","nonce":3129482072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6811","nonce":3129482072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6815","nonce":3129482072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3129482072},{"type":"v1","addr":"172.21.15.176:6813","nonce":3129482072}]},"public_addr":"172.21.15.176:6809/3129482072","cluster_addr":"172.21.15.176:6811/3129482072","heartbeat_back_addr":"172.21.15.176:6815/3129482072","heartbeat_front_addr":"172.21.15.176:6813/3129482072","state":["exists","up"]},{"osd":6,"uuid":"7389cd75-eea2-4ce4-adeb-b8e8db25b3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6819","nonce":2940460720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6821","nonce":2940460720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6825","nonce":2940460720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2940460720},{"type":"v1","addr":"172.21.15.86:6823","nonce":2940460720}]},"public_addr":"172.21.15.86:6819/2940460720","cluster_addr":"172.21.15.86:6821/2940460720","heartbeat_back_addr":"172.21.15.86:6825/2940460720","heartbeat_front_addr":"172.21.15.86:6823/2940460720","state":["exists","up"]},{"osd":7,"uuid":"b719ee4d-f7b6-4fe1-9e1a-cf81da9f0688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6817","nonce":183030662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6819","nonce":183030662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6823","nonce":183030662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":183030662},{"type":"v1","addr":"172.21.15.172:6821","nonce":183030662}]},"public_addr":"172.21.15.172:6817/183030662","cluster_addr":"172.21.15.172:6819/183030662","heartbeat_back_addr":"172.21.15.172:6823/183030662","heartbeat_front_addr":"172.21.15.172:6821/183030662","state":["exists","up"]},{"osd":8,"uuid":"45bf3d95-2150-45a9-8b6f-ea01eb14ba83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6817","nonce":1304311054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6819","nonce":1304311054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6823","nonce":1304311054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1304311054},{"type":"v1","addr":"172.21.15.176:6821","nonce":1304311054}]},"public_addr":"172.21.15.176:6817/1304311054","cluster_addr":"172.21.15.176:6819/1304311054","heartbeat_back_addr":"172.21.15.176:6823/1304311054","heartbeat_front_addr":"172.21.15.176:6821/1304311054","state":["exists","up"]},{"osd":9,"uuid":"aaaf5d21-ebd3-4757-b50c-531bf69652aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6827","nonce":3922597037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6829","nonce":3922597037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6833","nonce":3922597037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3922597037},{"type":"v1","addr":"172.21.15.86:6831","nonce":3922597037}]},"public_addr":"172.21.15.86:6827/3922597037","cluster_addr":"172.21.15.86:6829/3922597037","heartbeat_back_addr":"172.21.15.86:6833/3922597037","heartbeat_front_addr":"172.21.15.86:6831/3922597037","state":["exists","up"]},{"osd":10,"uuid":"b399ceda-5a65-4b65-abc3-c0cfaa7f1e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6825","nonce":2676876464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6827","nonce":2676876464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6831","nonce":2676876464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2676876464},{"type":"v1","addr":"172.21.15.172:6829","nonce":2676876464}]},"public_addr":"172.21.15.172:6825/2676876464","cluster_addr":"172.21.15.172:6827/2676876464","heartbeat_back_addr":"172.21.15.172:6831/2676876464","heartbeat_front_addr":"172.21.15.172:6829/2676876464","state":["exists","up"]},{"osd":11,"uuid":"daa12269-209c-4940-adcf-129c9470f578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6825","nonce":2310445273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6827","nonce":2310445273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6831","nonce":2310445273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":2310445273},{"type":"v1","addr":"172.21.15.176:6829","nonce":2310445273}]},"public_addr":"172.21.15.176:6825/2310445273","cluster_addr":"172.21.15.176:6827/2310445273","heartbeat_back_addr":"172.21.15.176:6831/2310445273","heartbeat_front_addr":"172.21.15.176:6829/2310445273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:20.060356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:00:44.117645+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:07.687599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:33.166047+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:01:58.493526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:23.542666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:02:49.358409+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:14.914161+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:03:40.076380+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:06.678974+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:33.179125+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T11:04:59.238375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/155657181":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/2138389102":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/2852030835":"2024-05-13T11:09:23.662823+0000","172.21.15.86:6801/3515811906":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3505671883":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/4157495437":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/636932738":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/3025922080":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/155657181":"2024-05-13T11:09:23.662823+0000","172.21.15.86:0/4229502845":"2024-05-13T11:09:23.662823+0000","172.21.15.86:6800/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/3479534219":"2024-05-13T10:58:43.982021+0000","172.21.15.86:0/1055215670":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6801/1257416774":"2024-05-13T10:58:16.834530+0000","172.21.15.86:0/995517811":"2024-05-13T10:58:16.834530+0000","172.21.15.86:6800/3515811906":"2024-05-13T10:58:43.982021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T11:20:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4b100b29f0 msgr2=0x7f4b100b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4b100b29f0 0x7f4b100b4eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009990 tx=0x7f4b0c005a90 comp rx=0 tx=0).stop 2024-05-12T11:20:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20102690 msgr2=0x7f4b2019f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20102690 0x7f4b2019f860 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400ef10 tx=0x7f4b1400c3a0 comp rx=0 tx=0).stop 2024-05-12T11:20:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 shutdown_connections 2024-05-12T11:20:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b201076e0 0x7f4b20199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f4b100b29f0 0x7f4b100b4eb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b20102690 0x7f4b2019f860 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 --2- 172.21.15.86:0/3797727818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20103040 0x7f4b2019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.075+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 >> 172.21.15.86:0/3797727818 conn(0x7f4b200783f0 msgr2=0x7f4b20106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.076+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 shutdown_connections 2024-05-12T11:20:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:16.076+0000 7f4b26f07700 1 -- 172.21.15.86:0/3797727818 wait complete. 2024-05-12T11:20:16.768 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs fail cephfs 2024-05-12T11:20:17.012 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:20:17.133 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:16 smithi086 ceph-mon[30110]: pgmap v338: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-12T11:20:17.134 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:16 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3797727818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:20:17.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:16 smithi172 ceph-mon[34517]: pgmap v338: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-12T11:20:17.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:16 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3797727818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:20:17.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:16 smithi176 ceph-mon[34357]: pgmap v338: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-12T11:20:17.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:16 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3797727818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 -- 172.21.15.86:0/3359399907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 msgr2=0x7f1400110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 --2- 172.21.15.86:0/3359399907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 0x7f1400110330 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f13f800b0a0 tx=0x7f13f800b3b0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 -- 172.21.15.86:0/3359399907 shutdown_connections 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 --2- 172.21.15.86:0/3359399907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 0x7f1400110330 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 --2- 172.21.15.86:0/3359399907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1400109510 0x7f14001098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 --2- 172.21.15.86:0/3359399907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f140006b180 0x7f140006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 -- 172.21.15.86:0/3359399907 >> 172.21.15.86:0/3359399907 conn(0x7f1400079350 msgr2=0x7f1400079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 -- 172.21.15.86:0/3359399907 shutdown_connections 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.640+0000 7f1406229700 1 -- 172.21.15.86:0/3359399907 wait complete. 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f1406229700 1 Processor -- start 2024-05-12T11:20:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f1406229700 1 -- start start 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f1406229700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f140006b180 0x7f1400102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f1406229700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 0x7f14001029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f1406229700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1400109510 0x7f1400102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f1406229700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f14001136a0 con 0x7f140006bb40 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f1406229700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1400113520 con 0x7f140006b180 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f1406229700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1400113820 con 0x7f1400109510 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f13feffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 0x7f14001029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f13feffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 0x7f14001029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34466/0 (socket says 172.21.15.86:34466) 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.641+0000 7f13feffd700 1 -- 172.21.15.86:0/1764077081 learned_addr learned my addr 172.21.15.86:0/1764077081 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13fffff700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1400109510 0x7f1400102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13ff7fe700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f140006b180 0x7f1400102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13feffd700 1 -- 172.21.15.86:0/1764077081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1400109510 msgr2=0x7f1400102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:18.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13feffd700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1400109510 0x7f1400102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13feffd700 1 -- 172.21.15.86:0/1764077081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f140006b180 msgr2=0x7f1400102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13feffd700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f140006b180 0x7f1400102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13feffd700 1 -- 172.21.15.86:0/1764077081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14001a80c0 con 0x7f140006bb40 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13feffd700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 0x7f14001029b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f13f000c920 tx=0x7f13f000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13fcff9700 1 -- 172.21.15.86:0/1764077081 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0007b00 con 0x7f140006bb40 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13fcff9700 1 -- 172.21.15.86:0/1764077081 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f0004ce0 con 0x7f140006bb40 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f13fcff9700 1 -- 172.21.15.86:0/1764077081 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0005650 con 0x7f140006bb40 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14001a83b0 con 0x7f140006bb40 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.642+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14001a88f0 con 0x7f140006bb40 2024-05-12T11:20:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.643+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140010b9f0 con 0x7f140006bb40 2024-05-12T11:20:18.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.644+0000 7f13fcff9700 1 -- 172.21.15.86:0/1764077081 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7f13f0004750 con 0x7f140006bb40 2024-05-12T11:20:18.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.645+0000 7f13fcff9700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f13ec0b2a70 0x7f13ec0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:18.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.646+0000 7f13ff7fe700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f13ec0b2a70 0x7f13ec0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:18.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.646+0000 7f13fcff9700 1 -- 172.21.15.86:0/1764077081 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8615+0+0 (secure 0 0 0) 0x7f13f00e2640 con 0x7f140006bb40 2024-05-12T11:20:18.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.646+0000 7f13ff7fe700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f13ec0b2a70 0x7f13ec0b4f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f13e8006fd0 tx=0x7f13e8008040 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:18.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.649+0000 7f13fcff9700 1 -- 172.21.15.86:0/1764077081 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f13f0014030 con 0x7f140006bb40 2024-05-12T11:20:18.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.904+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f140010b3d0 con 0x7f140006bb40 2024-05-12T11:20:18.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.906+0000 7f13fcff9700 1 -- 172.21.15.86:0/1764077081 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f13f00a9fe0 con 0x7f140006bb40 2024-05-12T11:20:18.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.909+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f13ec0b2a70 msgr2=0x7f13ec0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:18.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.909+0000 7f1406229700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f13ec0b2a70 0x7f13ec0b4f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f13e8006fd0 tx=0x7f13e8008040 comp rx=0 tx=0).stop 2024-05-12T11:20:18.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.909+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 msgr2=0x7f14001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:18.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.909+0000 7f1406229700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 0x7f14001029b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f13f000c920 tx=0x7f13f000cce0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.910+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 shutdown_connections 2024-05-12T11:20:18.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.910+0000 7f1406229700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1400109510 0x7f1400102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.910+0000 7f1406229700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f140006b180 0x7f1400102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.910+0000 7f1406229700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7f13ec0b2a70 0x7f13ec0b4f30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.910+0000 7f1406229700 1 --2- 172.21.15.86:0/1764077081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f140006bb40 0x7f14001029b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:18.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.910+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 >> 172.21.15.86:0/1764077081 conn(0x7f1400079350 msgr2=0x7f1400101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:18.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.910+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 shutdown_connections 2024-05-12T11:20:18.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:18.910+0000 7f1406229700 1 -- 172.21.15.86:0/1764077081 wait complete. 2024-05-12T11:20:18.909 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-12T11:20:19.219 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a[69267]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.219 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a[69267]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.219 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mds[69271]: -- 172.21.15.86:0/2603163937 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5631d54e9a40 con 0x5631d54bc800 2024-05-12T11:20:19.219 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a[69267]: starting mds.a at 2024-05-12T11:20:19.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a[30106]: 2024-05-12T11:20:18.904+0000 7f8a123b7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mon[30110]: pgmap v339: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1764077081' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mon[30110]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mon[30110]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/1764077081' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mon[30110]: osdmap e93: 12 total, 12 up, 12 in 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mon[30110]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:20:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g[68813]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:20:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g[68813]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:20:18 smithi086 ceph-mds[68835]: -- 172.21.15.86:0/2073035173 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55707d9ada40 con 0x55707d981000 2024-05-12T11:20:19.220 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:20:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g[68813]: starting mds.g at 2024-05-12T11:20:19.230 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e[64147]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.230 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e[64147]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.230 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mds[64151]: -- 172.21.15.172:0/1066265859 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e2bf29a40 con 0x562e2befcc00 2024-05-12T11:20:19.230 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e[64147]: starting mds.e at 2024-05-12T11:20:19.230 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k[63828]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.230 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k[63828]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.230 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mds[63832]: -- 172.21.15.172:0/1649084494 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56076e28ba40 con 0x56076e25e800 2024-05-12T11:20:19.230 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k[63828]: starting mds.k at 2024-05-12T11:20:19.231 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b[64771]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.231 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b[64771]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.231 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mds[64775]: -- 172.21.15.172:0/3391333561 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56389cc9fa40 con 0x56389cc72800 2024-05-12T11:20:19.231 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b[64771]: starting mds.b at 2024-05-12T11:20:19.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mon[34517]: pgmap v339: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-12T11:20:19.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1764077081' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-12T11:20:19.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mon[34517]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-12T11:20:19.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mon[34517]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-12T11:20:19.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/1764077081' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-12T11:20:19.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mon[34517]: osdmap e93: 12 total, 12 up, 12 in 2024-05-12T11:20:19.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mon[34517]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-12T11:20:19.232 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h[64460]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.232 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h[64460]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.232 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:20:18 smithi172 ceph-mds[64464]: -- 172.21.15.172:0/707235161 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c3fd299a40 con 0x55c3fd26cc00 2024-05-12T11:20:19.232 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:20:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h[64460]: starting mds.h at 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mon[34357]: pgmap v339: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1764077081' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mon[34357]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mon[34357]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/1764077081' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mon[34357]: osdmap e93: 12 total, 12 up, 12 in 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mon[34357]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c[65600]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.273 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c[65600]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.274 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mds[65604]: -- 172.21.15.176:0/3120982451 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557e8f73a40 con 0x5557e8f47000 2024-05-12T11:20:19.274 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c[65600]: starting mds.c at 2024-05-12T11:20:19.274 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f[65294]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.274 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f[65294]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.274 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mds[65298]: -- 172.21.15.176:0/3232285528 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bcdf679a40 con 0x55bcdf64cc00 2024-05-12T11:20:19.274 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f[65294]: starting mds.f at 2024-05-12T11:20:19.274 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i[65906]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.275 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i[65906]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.275 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mds[65910]: -- 172.21.15.176:0/3959338793 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570e2081a40 con 0x5570e2054c00 2024-05-12T11:20:19.275 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i[65906]: starting mds.i at 2024-05-12T11:20:19.275 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l[64972]: ignoring --setuser ceph since I am not root 2024-05-12T11:20:19.275 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l[64972]: ignoring --setgroup ceph since I am not root 2024-05-12T11:20:19.275 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:20:18 smithi176 ceph-mds[64976]: -- 172.21.15.176:0/3955067542 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564dd7139a40 con 0x564dd710cc00 2024-05-12T11:20:19.275 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:20:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l[64972]: starting mds.l at 2024-05-12T11:20:19.584 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-12T11:20:19.831 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:20:20.969 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: pgmap v341: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 103 B/s wr, 9 op/s 2024-05-12T11:20:20.969 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: osdmap e94: 12 total, 12 up, 12 in 2024-05-12T11:20:20.969 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.86:6838/510729456,v1:172.21.15.86:6839/510729456] up:boot 2024-05-12T11:20:20.969 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6832/90083250,v1:172.21.15.176:6833/90083250] up:boot 2024-05-12T11:20:20.969 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6832/1339171511,v1:172.21.15.172:6833/1339171511] up:boot 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6834/3840477742,v1:172.21.15.176:6835/3840477742] up:boot 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6834/2067963425,v1:172.21.15.172:6835/2067963425] up:boot 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.86:6840/2215596760,v1:172.21.15.86:6841/2215596760] up:boot 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6836/3865368734,v1:172.21.15.172:6837/3865368734] up:boot 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6836/432002261,v1:172.21.15.176:6837/432002261] up:boot 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.176:6838/779996883,v1:172.21.15.176:6839/779996883] up:boot 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: mds.? [v2:172.21.15.172:6838/2494150360,v1:172.21.15.172:6839/2494150360] up:boot 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:20:20.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:20:20.971 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:20:20.971 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:20:20.971 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:20:20.971 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:20:20.971 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:20 smithi086 ceph-mon[30110]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:20:21.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: pgmap v341: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 103 B/s wr, 9 op/s 2024-05-12T11:20:21.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: osdmap e94: 12 total, 12 up, 12 in 2024-05-12T11:20:21.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.86:6838/510729456,v1:172.21.15.86:6839/510729456] up:boot 2024-05-12T11:20:21.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6832/90083250,v1:172.21.15.176:6833/90083250] up:boot 2024-05-12T11:20:21.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6832/1339171511,v1:172.21.15.172:6833/1339171511] up:boot 2024-05-12T11:20:21.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6834/3840477742,v1:172.21.15.176:6835/3840477742] up:boot 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6834/2067963425,v1:172.21.15.172:6835/2067963425] up:boot 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.86:6840/2215596760,v1:172.21.15.86:6841/2215596760] up:boot 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6836/3865368734,v1:172.21.15.172:6837/3865368734] up:boot 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6836/432002261,v1:172.21.15.176:6837/432002261] up:boot 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.176:6838/779996883,v1:172.21.15.176:6839/779996883] up:boot 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: mds.? [v2:172.21.15.172:6838/2494150360,v1:172.21.15.172:6839/2494150360] up:boot 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:20:21.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:20:21.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:20:21.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:20 smithi172 ceph-mon[34517]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: pgmap v341: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 103 B/s wr, 9 op/s 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: osdmap e94: 12 total, 12 up, 12 in 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.86:6838/510729456,v1:172.21.15.86:6839/510729456] up:boot 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6832/90083250,v1:172.21.15.176:6833/90083250] up:boot 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6832/1339171511,v1:172.21.15.172:6833/1339171511] up:boot 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6834/3840477742,v1:172.21.15.176:6835/3840477742] up:boot 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6834/2067963425,v1:172.21.15.172:6835/2067963425] up:boot 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.86:6840/2215596760,v1:172.21.15.86:6841/2215596760] up:boot 2024-05-12T11:20:21.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6836/3865368734,v1:172.21.15.172:6837/3865368734] up:boot 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6836/432002261,v1:172.21.15.176:6837/432002261] up:boot 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.176:6838/779996883,v1:172.21.15.176:6839/779996883] up:boot 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: mds.? [v2:172.21.15.172:6838/2494150360,v1:172.21.15.172:6839/2494150360] up:boot 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-12T11:20:21.274 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-12T11:20:21.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-12T11:20:21.275 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:20 smithi176 ceph-mon[34357]: from='mgr.24749 172.21.15.86:0/47492334' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-12T11:20:21.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 -- 172.21.15.86:0/3159692225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8181037b0 msgr2=0x7fc818103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:21.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 --2- 172.21.15.86:0/3159692225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8181037b0 0x7fc818103b90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc8080099c0 tx=0x7fc808009cd0 comp rx=0 tx=0).stop 2024-05-12T11:20:21.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 -- 172.21.15.86:0/3159692225 shutdown_connections 2024-05-12T11:20:21.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 --2- 172.21.15.86:0/3159692225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc818108880 0x7fc818110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:21.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 --2- 172.21.15.86:0/3159692225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8181037b0 0x7fc818103b90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:21.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 --2- 172.21.15.86:0/3159692225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc818104160 0x7fc818108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:21.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 -- 172.21.15.86:0/3159692225 >> 172.21.15.86:0/3159692225 conn(0x7fc81807a580 msgr2=0x7fc81807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:21.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 -- 172.21.15.86:0/3159692225 shutdown_connections 2024-05-12T11:20:21.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.643+0000 7fc81cf93700 1 -- 172.21.15.86:0/3159692225 wait complete. 2024-05-12T11:20:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81cf93700 1 Processor -- start 2024-05-12T11:20:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81cf93700 1 -- start start 2024-05-12T11:20:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81cf93700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8181037b0 0x7fc81819f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81cf93700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc818104160 0x7fc81819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81cf93700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc818108880 0x7fc818199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81cf93700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc818113670 con 0x7fc818104160 2024-05-12T11:20:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81cf93700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8181134f0 con 0x7fc8181037b0 2024-05-12T11:20:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81cf93700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8181137f0 con 0x7fc818108880 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc815d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc818104160 0x7fc81819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc815d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc818104160 0x7fc81819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46666/0 (socket says 172.21.15.86:46666) 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc815d9b700 1 -- 172.21.15.86:0/2999192585 learned_addr learned my addr 172.21.15.86:0/2999192585 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc81659c700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8181037b0 0x7fc81819f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc816d9d700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc818108880 0x7fc818199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc815d9b700 1 -- 172.21.15.86:0/2999192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc818108880 msgr2=0x7fc818199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc815d9b700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc818108880 0x7fc818199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc815d9b700 1 -- 172.21.15.86:0/2999192585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8181037b0 msgr2=0x7fc81819f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc815d9b700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8181037b0 0x7fc81819f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc815d9b700 1 -- 172.21.15.86:0/2999192585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81819a0b0 con 0x7fc818104160 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.644+0000 7fc816d9d700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc818108880 0x7fc818199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.645+0000 7fc815d9b700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc818104160 0x7fc81819fc80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00d950 tx=0x7fc80c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:21.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.645+0000 7fc8077fe700 1 -- 172.21.15.86:0/2999192585 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c016070 con 0x7fc818104160 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.645+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81819a3a0 con 0x7fc818104160 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.645+0000 7fc8077fe700 1 -- 172.21.15.86:0/2999192585 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc80c009df0 con 0x7fc818104160 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.645+0000 7fc8077fe700 1 -- 172.21.15.86:0/2999192585 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00f3c0 con 0x7fc818104160 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.645+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8181a6610 con 0x7fc818104160 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.646+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc81810bac0 con 0x7fc818104160 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.647+0000 7fc8077fe700 1 -- 172.21.15.86:0/2999192585 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fc80c019070 con 0x7fc818104160 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.648+0000 7fc8077fe700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc8000b29f0 0x7fc8000b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.648+0000 7fc81659c700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc8000b29f0 0x7fc8000b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.648+0000 7fc8077fe700 1 -- 172.21.15.86:0/2999192585 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9001+0+0 (secure 0 0 0) 0x7fc80c0e2420 con 0x7fc818104160 2024-05-12T11:20:21.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.648+0000 7fc81659c700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc8000b29f0 0x7fc8000b4eb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc818108380 tx=0x7fc808005c40 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:21.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.652+0000 7fc8077fe700 1 -- 172.21.15.86:0/2999192585 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc80c0a9c20 con 0x7fc818104160 2024-05-12T11:20:21.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:21.900+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc81810b4a0 con 0x7fc818104160 2024-05-12T11:20:22.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.905+0000 7fc8077fe700 1 -- 172.21.15.86:0/2999192585 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7fc80c0a9520 con 0x7fc818104160 2024-05-12T11:20:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.908+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc8000b29f0 msgr2=0x7fc8000b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.908+0000 7fc81cf93700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc8000b29f0 0x7fc8000b4eb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc818108380 tx=0x7fc808005c40 comp rx=0 tx=0).stop 2024-05-12T11:20:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.908+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc818104160 msgr2=0x7fc81819fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.908+0000 7fc81cf93700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc818104160 0x7fc81819fc80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00d950 tx=0x7fc80c00dc60 comp rx=0 tx=0).stop 2024-05-12T11:20:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.908+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 shutdown_connections 2024-05-12T11:20:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.908+0000 7fc81cf93700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc818108880 0x7fc818199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.909+0000 7fc81cf93700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8181037b0 0x7fc81819f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.909+0000 7fc81cf93700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc8000b29f0 0x7fc8000b4eb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.909+0000 7fc81cf93700 1 --2- 172.21.15.86:0/2999192585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc818104160 0x7fc81819fc80 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.909+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 >> 172.21.15.86:0/2999192585 conn(0x7fc81807a580 msgr2=0x7fc8181017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.909+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 shutdown_connections 2024-05-12T11:20:22.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:22.909+0000 7fc81cf93700 1 -- 172.21.15.86:0/2999192585 wait complete. 2024-05-12T11:20:23.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:22 smithi086 ceph-mon[30110]: pgmap v343: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 11 op/s 2024-05-12T11:20:23.216 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:22 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2999192585' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:20:23.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:22 smithi172 ceph-mon[34517]: pgmap v343: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 11 op/s 2024-05-12T11:20:23.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:22 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2999192585' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:20:23.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:22 smithi176 ceph-mon[34357]: pgmap v343: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 11 op/s 2024-05-12T11:20:23.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:22 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2999192585' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-12T11:20:23.533 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-12T11:20:23.781 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:20:24.170 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:23 smithi086 ceph-mon[30110]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-12T11:20:24.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:23 smithi086 ceph-mon[30110]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-12T11:20:24.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:23 smithi086 ceph-mon[30110]: Cluster is now healthy 2024-05-12T11:20:24.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:23 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/2999192585' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-12T11:20:24.171 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:23 smithi086 ceph-mon[30110]: fsmap 12 up:standby 2024-05-12T11:20:24.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:23 smithi172 ceph-mon[34517]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-12T11:20:24.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:23 smithi172 ceph-mon[34517]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-12T11:20:24.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:23 smithi172 ceph-mon[34517]: Cluster is now healthy 2024-05-12T11:20:24.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:23 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/2999192585' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-12T11:20:24.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:23 smithi172 ceph-mon[34517]: fsmap 12 up:standby 2024-05-12T11:20:24.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:23 smithi176 ceph-mon[34357]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-12T11:20:24.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:23 smithi176 ceph-mon[34357]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-12T11:20:24.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:23 smithi176 ceph-mon[34357]: Cluster is now healthy 2024-05-12T11:20:24.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:23 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/2999192585' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-12T11:20:24.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:23 smithi176 ceph-mon[34357]: fsmap 12 up:standby 2024-05-12T11:20:25.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:24 smithi086 ceph-mon[30110]: pgmap v344: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-12T11:20:25.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:24 smithi172 ceph-mon[34517]: pgmap v344: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-12T11:20:25.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:24 smithi176 ceph-mon[34357]: pgmap v344: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-12T11:20:25.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 -- 172.21.15.86:0/2041523831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6041023d0 msgr2=0x7fc604102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 --2- 172.21.15.86:0/2041523831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6041023d0 0x7fc604102850 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009990 tx=0x7fc5f4009ca0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 -- 172.21.15.86:0/2041523831 shutdown_connections 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 --2- 172.21.15.86:0/2041523831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc604102d90 0x7fc60410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 --2- 172.21.15.86:0/2041523831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc604108450 0x7fc604108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 --2- 172.21.15.86:0/2041523831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6041023d0 0x7fc604102850 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 -- 172.21.15.86:0/2041523831 >> 172.21.15.86:0/2041523831 conn(0x7fc604078410 msgr2=0x7fc604078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 -- 172.21.15.86:0/2041523831 shutdown_connections 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.487+0000 7fc60bc36700 1 -- 172.21.15.86:0/2041523831 wait complete. 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc60bc36700 1 Processor -- start 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc60bc36700 1 -- start start 2024-05-12T11:20:25.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc60bc36700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6041023d0 0x7fc604104080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc60bc36700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc604102d90 0x7fc6041045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc60bc36700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc604108450 0x7fc604104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc60bc36700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc604112540 con 0x7fc604102d90 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc60bc36700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc6041123c0 con 0x7fc604108450 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc60bc36700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc6041126c0 con 0x7fc6041023d0 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc6091d1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc604102d90 0x7fc6041045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc6091d1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc604102d90 0x7fc6041045c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46688/0 (socket says 172.21.15.86:46688) 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.488+0000 7fc6091d1700 1 -- 172.21.15.86:0/3870530708 learned_addr learned my addr 172.21.15.86:0/3870530708 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc6099d2700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6041023d0 0x7fc604104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc6091d1700 1 -- 172.21.15.86:0/3870530708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6041023d0 msgr2=0x7fc604104080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc60a1d3700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc604108450 0x7fc604104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc6091d1700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6041023d0 0x7fc604104080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc6091d1700 1 -- 172.21.15.86:0/3870530708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc604108450 msgr2=0x7fc604104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:25.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc6091d1700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc604108450 0x7fc604104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc6091d1700 1 -- 172.21.15.86:0/3870530708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6041a80f0 con 0x7fc604102d90 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc6099d2700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6041023d0 0x7fc604104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc6091d1700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc604102d90 0x7fc6041045c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4000c00 tx=0x7fc5f40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc5faffd700 1 -- 172.21.15.86:0/3870530708 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4027070 con 0x7fc604102d90 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6041a8380 con 0x7fc604102d90 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc5faffd700 1 -- 172.21.15.86:0/3870530708 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5f4022470 con 0x7fc604102d90 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc5faffd700 1 -- 172.21.15.86:0/3870530708 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4017650 con 0x7fc604102d90 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.489+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6041a8830 con 0x7fc604102d90 2024-05-12T11:20:25.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.490+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc604103ac0 con 0x7fc604102d90 2024-05-12T11:20:25.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.492+0000 7fc5faffd700 1 -- 172.21.15.86:0/3870530708 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fc5f402a070 con 0x7fc604102d90 2024-05-12T11:20:25.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.493+0000 7fc5faffd700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc5f00b29f0 0x7fc5f00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:25.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.493+0000 7fc6099d2700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc5f00b29f0 0x7fc5f00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:25.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.493+0000 7fc5faffd700 1 -- 172.21.15.86:0/3870530708 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9001+0+0 (secure 0 0 0) 0x7fc5f40e38c0 con 0x7fc604102d90 2024-05-12T11:20:25.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.493+0000 7fc6099d2700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc5f00b29f0 0x7fc5f00b4eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc600005e90 tx=0x7fc600005d20 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:25.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.496+0000 7fc5faffd700 1 -- 172.21.15.86:0/3870530708 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc5f4013070 con 0x7fc604102d90 2024-05-12T11:20:25.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.698+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc60406a190 con 0x7fc604102d90 2024-05-12T11:20:25.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.915+0000 7fc5faffd700 1 -- 172.21.15.86:0/3870530708 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7fc5f40ab150 con 0x7fc604102d90 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc5f00b29f0 msgr2=0x7fc5f00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc5f00b29f0 0x7fc5f00b4eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc600005e90 tx=0x7fc600005d20 comp rx=0 tx=0).stop 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc604102d90 msgr2=0x7fc6041045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc604102d90 0x7fc6041045c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4000c00 tx=0x7fc5f40047b0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 shutdown_connections 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc604108450 0x7fc604104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6041023d0 0x7fc604104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fc5f00b29f0 0x7fc5f00b4eb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 --2- 172.21.15.86:0/3870530708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc604102d90 0x7fc6041045c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:25.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 >> 172.21.15.86:0/3870530708 conn(0x7fc604078410 msgr2=0x7fc60406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:25.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 shutdown_connections 2024-05-12T11:20:25.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:25.917+0000 7fc60bc36700 1 -- 172.21.15.86:0/3870530708 wait complete. 2024-05-12T11:20:25.916 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2024-05-12T11:20:26.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:25 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3870530708' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-12T11:20:26.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:25 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3870530708' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-12T11:20:26.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:25 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3870530708' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-12T11:20:26.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a shell --fsid 513c80a2-104e-11ef-bc98-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-12T11:20:26.823 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/mon.a/config 2024-05-12T11:20:26.914 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:26 smithi086 ceph-mon[30110]: pgmap v345: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-12T11:20:26.914 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:26 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/3870530708' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-12T11:20:27.179 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:26 smithi086 ceph-mon[30110]: osdmap e95: 12 total, 12 up, 12 in 2024-05-12T11:20:27.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:26 smithi172 ceph-mon[34517]: pgmap v345: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-12T11:20:27.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:26 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/3870530708' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-12T11:20:27.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:26 smithi172 ceph-mon[34517]: osdmap e95: 12 total, 12 up, 12 in 2024-05-12T11:20:27.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:26 smithi176 ceph-mon[34357]: pgmap v345: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-12T11:20:27.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:26 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/3870530708' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-12T11:20:27.273 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:26 smithi176 ceph-mon[34357]: osdmap e95: 12 total, 12 up, 12 in 2024-05-12T11:20:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 -- 172.21.15.86:0/370556273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0104100 msgr2=0x7fa0d0108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/370556273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0104100 0x7fa0d0108120 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80099c0 tx=0x7fa0b8009cd0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 -- 172.21.15.86:0/370556273 shutdown_connections 2024-05-12T11:20:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/370556273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d0108850 0x7fa0d01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/370556273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0d0103750 0x7fa0d0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/370556273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0104100 0x7fa0d0108120 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 -- 172.21.15.86:0/370556273 >> 172.21.15.86:0/370556273 conn(0x7fa0d007a600 msgr2=0x7fa0d007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 -- 172.21.15.86:0/370556273 shutdown_connections 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.504+0000 7fa0d53b6700 1 -- 172.21.15.86:0/370556273 wait complete. 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0d53b6700 1 Processor -- start 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0d53b6700 1 -- start start 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0d53b6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0103750 0x7fa0d019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0d53b6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d0104100 0x7fa0d019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0d53b6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0d0108850 0x7fa0d0199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0d53b6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0113690 con 0x7fa0d0103750 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0d53b6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0113510 con 0x7fa0d0108850 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0d53b6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0113810 con 0x7fa0d0104100 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0ceffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0103750 0x7fa0d019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0ceffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0103750 0x7fa0d019f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46708/0 (socket says 172.21.15.86:46708) 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0ceffd700 1 -- 172.21.15.86:0/491100528 learned_addr learned my addr 172.21.15.86:0/491100528 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-05-12T11:20:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0c67fc700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d0104100 0x7fa0d019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.505+0000 7fa0cf7fe700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0d0108850 0x7fa0d0199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ceffd700 1 -- 172.21.15.86:0/491100528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d0104100 msgr2=0x7fa0d019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ceffd700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d0104100 0x7fa0d019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ceffd700 1 -- 172.21.15.86:0/491100528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0d0108850 msgr2=0x7fa0d0199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ceffd700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0d0108850 0x7fa0d0199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ceffd700 1 -- 172.21.15.86:0/491100528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d019a0d0 con 0x7fa0d0103750 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ceffd700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0103750 0x7fa0d019f760 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000c920 tx=0x7fa0c000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ccff9700 1 -- 172.21.15.86:0/491100528 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0007b00 con 0x7fa0d0103750 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d019a3c0 con 0x7fa0d0103750 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ccff9700 1 -- 172.21.15.86:0/491100528 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0c0004ce0 con 0x7fa0d0103750 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0ccff9700 1 -- 172.21.15.86:0/491100528 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0005500 con 0x7fa0d0103750 2024-05-12T11:20:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.506+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d01a66b0 con 0x7fa0d0103750 2024-05-12T11:20:28.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.507+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d006a190 con 0x7fa0d0103750 2024-05-12T11:20:28.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.508+0000 7fa0ccff9700 1 -- 172.21.15.86:0/491100528 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) ==== 149783+0+0 (secure 0 0 0) 0x7fa0c0007ca0 con 0x7fa0d0103750 2024-05-12T11:20:28.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.509+0000 7fa0ccff9700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa0bc0b29f0 0x7fa0bc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T11:20:28.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.509+0000 7fa0c67fc700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa0bc0b29f0 0x7fa0bc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T11:20:28.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.509+0000 7fa0ccff9700 1 -- 172.21.15.86:0/491100528 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8403+0+0 (secure 0 0 0) 0x7fa0c00e2560 con 0x7fa0d0103750 2024-05-12T11:20:28.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.510+0000 7fa0c67fc700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa0bc0b29f0 0x7fa0bc0b4eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8006010 tx=0x7fa0b8009f10 comp rx=0 tx=0).ready entity=mgr.24749 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T11:20:28.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.513+0000 7fa0ccff9700 1 -- 172.21.15.86:0/491100528 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa0c0014030 con 0x7fa0d0103750 2024-05-12T11:20:28.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.717+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa0d019ae50 con 0x7fa0d0103750 2024-05-12T11:20:28.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.918+0000 7fa0ccff9700 1 -- 172.21.15.86:0/491100528 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7fa0c00a9fb0 con 0x7fa0d0103750 2024-05-12T11:20:28.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.921+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa0bc0b29f0 msgr2=0x7fa0bc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:28.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.921+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa0bc0b29f0 0x7fa0bc0b4eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8006010 tx=0x7fa0b8009f10 comp rx=0 tx=0).stop 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.921+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0103750 msgr2=0x7fa0d019f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.921+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0103750 0x7fa0d019f760 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000c920 tx=0x7fa0c000cc30 comp rx=0 tx=0).stop 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.922+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 shutdown_connections 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.922+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0d0108850 0x7fa0d0199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.922+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:6800/3529939097,v1:172.21.15.86:6801/3529939097] conn(0x7fa0bc0b29f0 0x7fa0bc0b4eb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.922+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0d0103750 0x7fa0d019f760 secure :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000c920 tx=0x7fa0c000cc30 comp rx=0 tx=0).stop 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.922+0000 7fa0d53b6700 1 --2- 172.21.15.86:0/491100528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0d0104100 0x7fa0d019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.922+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 >> 172.21.15.86:0/491100528 conn(0x7fa0d007a600 msgr2=0x7fa0d01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T11:20:28.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.922+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 shutdown_connections 2024-05-12T11:20:28.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-05-12T11:20:28.922+0000 7fa0d53b6700 1 -- 172.21.15.86:0/491100528 wait complete. 2024-05-12T11:20:28.922 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2024-05-12T11:20:28.969 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:28 smithi086 ceph-mon[30110]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:20:28.969 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:28 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/491100528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-12T11:20:29.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:28 smithi172 ceph-mon[34517]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:20:29.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:28 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/491100528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-12T11:20:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:28 smithi176 ceph-mon[34357]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-12T11:20:29.272 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:28 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/491100528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-12T11:20:29.639 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-12T11:20:29.667 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-12T11:20:29.700 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-12T11:20:29.727 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-12T11:20:29.727 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-12T11:20:29.744 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-12T11:20:29.761 DEBUG:teuthology.orchestra.run.smithi176:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-12T11:20:29.781 INFO:tasks.cephadm:Stopping all daemons... 2024-05-12T11:20:29.782 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-12T11:20:29.782 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.a 2024-05-12T11:20:29.929 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:29 smithi086 systemd[1]: Stopping Ceph mon.a for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:29.980 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:29 smithi172 ceph-mon[34517]: from='client.? 172.21.15.86:0/491100528' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-12T11:20:29.980 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:29 smithi172 ceph-mon[34517]: osdmap e96: 12 total, 12 up, 12 in 2024-05-12T11:20:30.023 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:29 smithi176 ceph-mon[34357]: from='client.? 172.21.15.86:0/491100528' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-12T11:20:30.023 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:29 smithi176 ceph-mon[34357]: osdmap e96: 12 total, 12 up, 12 in 2024-05-12T11:20:30.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:29 smithi086 ceph-mon[30110]: from='client.? 172.21.15.86:0/491100528' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-12T11:20:30.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:29 smithi086 ceph-mon[30110]: osdmap e96: 12 total, 12 up, 12 in 2024-05-12T11:20:30.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:30 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a[30106]: 2024-05-12T11:20:30.099+0000 7f8a17bc2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:20:30.219 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:30 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a[30106]: 2024-05-12T11:20:30.099+0000 7f8a17bc2700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-12T11:20:30.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:30 smithi086 podman[95468]: 2024-05-12 11:20:30.335318905 +0000 UTC m=+0.356195623 container died 272d40c7cd9355ebae8cf1356cc9604daf3745117e39953916f8c7231265c96a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:20:30.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:30 smithi086 podman[95468]: 2024-05-12 11:20:30.725744211 +0000 UTC m=+0.746620927 container cleanup 272d40c7cd9355ebae8cf1356cc9604daf3745117e39953916f8c7231265c96a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True) 2024-05-12T11:20:30.970 INFO:journalctl@ceph.mon.a.smithi086.stdout:May 12 11:20:30 smithi086 bash[95468]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-a 2024-05-12T11:20:31.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.a.service' 2024-05-12T11:20:31.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:20:31.195 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-12T11:20:31.196 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-12T11:20:31.196 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.b 2024-05-12T11:20:31.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:31 smithi172 systemd[1]: Stopping Ceph mon.b for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:31.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:31 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-b[34512]: 2024-05-12T11:20:31.547+0000 7fbc5cbc4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:20:31.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:31 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-b[34512]: 2024-05-12T11:20:31.547+0000 7fbc5cbc4700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-12T11:20:32.121 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:31 smithi172 podman[70895]: 2024-05-12 11:20:31.803350019 +0000 UTC m=+0.410541645 container died caaa4d03105831dd02daf4f02546996d36e817f22f87bcdb00b53bdc53f141be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-12T11:20:32.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:32 smithi172 podman[70895]: 2024-05-12 11:20:32.223903298 +0000 UTC m=+0.831094930 container cleanup caaa4d03105831dd02daf4f02546996d36e817f22f87bcdb00b53bdc53f141be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-b, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-12T11:20:32.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:32 smithi172 bash[70895]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-b 2024-05-12T11:20:32.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.b.service' 2024-05-12T11:20:32.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:32 smithi172 podman[70909]: 2024-05-12 11:20:32.467113241 +0000 UTC m=+0.660555319 container remove caaa4d03105831dd02daf4f02546996d36e817f22f87bcdb00b53bdc53f141be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-12T11:20:32.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:32 smithi172 systemd[1]: ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.b.service: Deactivated successfully. 2024-05-12T11:20:32.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:32 smithi172 systemd[1]: Stopped Ceph mon.b for 513c80a2-104e-11ef-bc98-c7b262605968. 2024-05-12T11:20:32.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 12 11:20:32 smithi172 systemd[1]: ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.b.service: Consumed 12.294s CPU time. 2024-05-12T11:20:32.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:20:32.748 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-12T11:20:32.748 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-12T11:20:32.748 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.c 2024-05-12T11:20:33.122 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:32 smithi176 systemd[1]: Stopping Ceph mon.c for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:33.447 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-c[34353]: 2024-05-12T11:20:33.123+0000 7f0633828700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:20:33.447 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-c[34353]: 2024-05-12T11:20:33.123+0000 7f0633828700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-12T11:20:33.447 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:33 smithi176 podman[71996]: 2024-05-12 11:20:33.144157195 +0000 UTC m=+0.193857910 container died f56d1b53be8d5ec8de4e2f38175721da9a6bb339ca3e588f8712cdcf55252e55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-12T11:20:33.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:33 smithi176 podman[71996]: 2024-05-12 11:20:33.549158943 +0000 UTC m=+0.598859647 container cleanup f56d1b53be8d5ec8de4e2f38175721da9a6bb339ca3e588f8712cdcf55252e55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-12T11:20:33.773 INFO:journalctl@ceph.mon.c.smithi176.stdout:May 12 11:20:33 smithi176 bash[71996]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mon-c 2024-05-12T11:20:33.966 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mon.c.service' 2024-05-12T11:20:34.028 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:20:34.029 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-12T11:20:34.029 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-12T11:20:34.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.x 2024-05-12T11:20:34.347 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:20:34 smithi086 systemd[1]: Stopping Ceph mgr.x for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:34.697 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:20:34 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x[30340]: 2024-05-12T11:20:34.347+0000 7f2c88ab5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:20:34.698 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:20:34 smithi086 podman[95591]: 2024-05-12 11:20:34.380378932 +0000 UTC m=+0.151981742 container died c006a90d75fa0840b2ab35a2689ed7ac09b708dfc0d17675b10a024596278d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:20:34.969 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:20:34 smithi086 podman[95591]: 2024-05-12 11:20:34.800047304 +0000 UTC m=+0.571650112 container cleanup c006a90d75fa0840b2ab35a2689ed7ac09b708dfc0d17675b10a024596278d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:20:34.969 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:20:34 smithi086 bash[95591]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x 2024-05-12T11:20:35.274 INFO:journalctl@ceph.mgr.x.smithi086.stdout:May 12 11:20:35 smithi086 podman[95605]: 2024-05-12 11:20:35.026791721 +0000 UTC m=+0.643882603 container remove c006a90d75fa0840b2ab35a2689ed7ac09b708dfc0d17675b10a024596278d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f1ec882358465db8f363a3865fa83f099183688a, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-x, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:20:35.278 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.x.service' 2024-05-12T11:20:35.314 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:20:35.314 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-12T11:20:35.314 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-12T11:20:35.314 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.y 2024-05-12T11:20:35.654 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:20:35 smithi172 systemd[1]: Stopping Ceph mgr.y for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:35.944 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:20:35 smithi172 podman[71018]: 2024-05-12 11:20:35.65773688 +0000 UTC m=+0.143653284 container died 24d1c8192c9ad9550516dcc92b3096cccab4eb3fb154963c5c05dcdef5a44254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-05-12T11:20:36.230 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:20:36 smithi172 podman[71018]: 2024-05-12 11:20:36.012535907 +0000 UTC m=+0.498452290 container cleanup 24d1c8192c9ad9550516dcc92b3096cccab4eb3fb154963c5c05dcdef5a44254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-12T11:20:36.230 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:20:36 smithi172 bash[71018]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y 2024-05-12T11:20:36.555 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:20:36 smithi172 podman[71032]: 2024-05-12 11:20:36.283488284 +0000 UTC m=+0.621438993 container remove 24d1c8192c9ad9550516dcc92b3096cccab4eb3fb154963c5c05dcdef5a44254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-12T11:20:36.555 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 12 11:20:36 smithi172 systemd[1]: ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-12T11:20:36.575 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.y.service' 2024-05-12T11:20:36.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:20:36.608 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-12T11:20:36.608 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-12T11:20:36.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.z 2024-05-12T11:20:37.023 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:20:36 smithi176 systemd[1]: Stopping Ceph mgr.z for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:37.427 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:20:37 smithi176 podman[72117]: 2024-05-12 11:20:37.058067526 +0000 UTC m=+0.258208700 container died 9e11416f5d2b58738eee8105ce6450fe541dfbfb9bc1ce091aff769e33dd8062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-12T11:20:37.686 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:20:37 smithi176 podman[72117]: 2024-05-12 11:20:37.429983127 +0000 UTC m=+0.630124298 container cleanup 9e11416f5d2b58738eee8105ce6450fe541dfbfb9bc1ce091aff769e33dd8062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:20:37.687 INFO:journalctl@ceph.mgr.z.smithi176.stdout:May 12 11:20:37 smithi176 bash[72117]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mgr-z 2024-05-12T11:20:37.906 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mgr.z.service' 2024-05-12T11:20:37.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:20:37.982 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-12T11:20:37.982 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-12T11:20:37.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.0 2024-05-12T11:20:38.310 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:38 smithi086 systemd[1]: Stopping Ceph osd.0 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:38.719 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:38 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0[42257]: 2024-05-12T11:20:38.312+0000 7f1b2dd39700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:20:38.719 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:38 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0[42257]: 2024-05-12T11:20:38.312+0000 7f1b2dd39700 -1 osd.0 96 *** Got signal Terminated *** 2024-05-12T11:20:38.719 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:38 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0[42257]: 2024-05-12T11:20:38.312+0000 7f1b2dd39700 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:20:43.969 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:43 smithi086 podman[95710]: 2024-05-12 11:20:43.677596548 +0000 UTC m=+5.497294422 container died 9889602b32a5731ac18795c24c84bc992215a2132a685e4e42f026ca301d1db5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-12T11:20:44.304 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:44 smithi086 podman[95710]: 2024-05-12 11:20:44.080112624 +0000 UTC m=+5.899810495 container cleanup 9889602b32a5731ac18795c24c84bc992215a2132a685e4e42f026ca301d1db5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-12T11:20:44.304 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:44 smithi086 bash[95710]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0 2024-05-12T11:20:44.719 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:44 smithi086 podman[95729]: 2024-05-12 11:20:44.306667226 +0000 UTC m=+0.626784232 container remove 9889602b32a5731ac18795c24c84bc992215a2132a685e4e42f026ca301d1db5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:20:45.041 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:44 smithi086 podman[95826]: 2024-05-12 11:20:44.665061209 +0000 UTC m=+0.018271689 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:20:45.041 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:44 smithi086 podman[95826]: 2024-05-12 11:20:44.782876305 +0000 UTC m=+0.136086764 container create af2c6d66927a34c36d357776a771c274e0ee3b896fd27d4181e0507953817618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-12T11:20:45.322 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:45 smithi086 podman[95826]: 2024-05-12 11:20:45.043911594 +0000 UTC m=+0.397122064 container init af2c6d66927a34c36d357776a771c274e0ee3b896fd27d4181e0507953817618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:20:45.322 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:45 smithi086 podman[95826]: 2024-05-12 11:20:45.047535728 +0000 UTC m=+0.400746191 container start af2c6d66927a34c36d357776a771c274e0ee3b896fd27d4181e0507953817618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:20:45.322 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:45 smithi086 podman[95826]: 2024-05-12 11:20:45.152559347 +0000 UTC m=+0.505769812 container attach af2c6d66927a34c36d357776a771c274e0ee3b896fd27d4181e0507953817618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-12T11:20:45.719 INFO:journalctl@ceph.osd.0.smithi086.stdout:May 12 11:20:45 smithi086 podman[95826]: 2024-05-12 11:20:45.363601534 +0000 UTC m=+0.716811994 container died af2c6d66927a34c36d357776a771c274e0ee3b896fd27d4181e0507953817618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-12T11:20:46.051 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.0.service' 2024-05-12T11:20:46.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:20:46.090 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-12T11:20:46.090 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-12T11:20:46.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.1 2024-05-12T11:20:46.406 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:46 smithi172 systemd[1]: Stopping Ceph osd.1 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:46.730 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1[39100]: 2024-05-12T11:20:46.408+0000 7fd8307ec700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:20:46.730 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1[39100]: 2024-05-12T11:20:46.408+0000 7fd8307ec700 -1 osd.1 96 *** Got signal Terminated *** 2024-05-12T11:20:46.730 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1[39100]: 2024-05-12T11:20:46.408+0000 7fd8307ec700 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:20:52.057 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:51 smithi172 podman[71141]: 2024-05-12 11:20:51.762732258 +0000 UTC m=+5.477593004 container died 9e72443f9e81ee32c17f3c5e49f9f7a5ff094cf3fd18b8c9d51d4bb8eb6f3347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:20:52.416 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:52 smithi172 podman[71141]: 2024-05-12 11:20:52.167127105 +0000 UTC m=+5.881987844 container cleanup 9e72443f9e81ee32c17f3c5e49f9f7a5ff094cf3fd18b8c9d51d4bb8eb6f3347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:20:52.416 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:52 smithi172 bash[71141]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1 2024-05-12T11:20:52.730 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:52 smithi172 podman[71159]: 2024-05-12 11:20:52.418755709 +0000 UTC m=+0.646585436 container remove 9e72443f9e81ee32c17f3c5e49f9f7a5ff094cf3fd18b8c9d51d4bb8eb6f3347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-12T11:20:53.103 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:52 smithi172 podman[71250]: 2024-05-12 11:20:52.733845104 +0000 UTC m=+0.018026876 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:20:53.103 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:52 smithi172 podman[71250]: 2024-05-12 11:20:52.861828449 +0000 UTC m=+0.146010263 container create 5321a8ab2c41cd5e04ef9faa49aac86ddf8c3dc677af96ca96abf4d0391d6ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-12T11:20:53.379 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:53 smithi172 podman[71250]: 2024-05-12 11:20:53.10626298 +0000 UTC m=+0.390444760 container init 5321a8ab2c41cd5e04ef9faa49aac86ddf8c3dc677af96ca96abf4d0391d6ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507) 2024-05-12T11:20:53.379 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:53 smithi172 podman[71250]: 2024-05-12 11:20:53.109872199 +0000 UTC m=+0.394053975 container start 5321a8ab2c41cd5e04ef9faa49aac86ddf8c3dc677af96ca96abf4d0391d6ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2) 2024-05-12T11:20:53.380 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:53 smithi172 podman[71250]: 2024-05-12 11:20:53.197778173 +0000 UTC m=+0.481959968 container attach 5321a8ab2c41cd5e04ef9faa49aac86ddf8c3dc677af96ca96abf4d0391d6ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-12T11:20:53.724 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 12 11:20:53 smithi172 podman[71250]: 2024-05-12 11:20:53.418552039 +0000 UTC m=+0.702733811 container died 5321a8ab2c41cd5e04ef9faa49aac86ddf8c3dc677af96ca96abf4d0391d6ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507) 2024-05-12T11:20:54.059 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.1.service' 2024-05-12T11:20:54.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:20:54.097 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-12T11:20:54.097 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-12T11:20:54.097 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.2 2024-05-12T11:20:54.466 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:20:54 smithi176 systemd[1]: Stopping Ceph osd.2 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:20:54.773 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:20:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2[39691]: 2024-05-12T11:20:54.467+0000 7fa75a29c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:20:54.773 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:20:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2[39691]: 2024-05-12T11:20:54.467+0000 7fa75a29c700 -1 osd.2 96 *** Got signal Terminated *** 2024-05-12T11:20:54.773 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:20:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2[39691]: 2024-05-12T11:20:54.467+0000 7fa75a29c700 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:00.274 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:20:59 smithi176 podman[72244]: 2024-05-12 11:20:59.991680362 +0000 UTC m=+5.696950570 container died 85f2fc86a5aae5768029a73a8b20aedb9ba87f89b50b2750ee8d2d7229c54565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-12T11:21:00.574 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:00 smithi176 podman[72244]: 2024-05-12 11:21:00.375194126 +0000 UTC m=+6.080464332 container cleanup 85f2fc86a5aae5768029a73a8b20aedb9ba87f89b50b2750ee8d2d7229c54565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:21:00.574 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:00 smithi176 bash[72244]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2 2024-05-12T11:21:01.023 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:00 smithi176 podman[72261]: 2024-05-12 11:21:00.576709113 +0000 UTC m=+0.579523285 container remove 85f2fc86a5aae5768029a73a8b20aedb9ba87f89b50b2750ee8d2d7229c54565 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-12T11:21:01.328 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:01 smithi176 podman[72364]: 2024-05-12 11:21:00.931149577 +0000 UTC m=+0.024812475 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:21:01.328 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:01 smithi176 podman[72364]: 2024-05-12 11:21:01.053021881 +0000 UTC m=+0.146684772 container create a9317e141f45bdebb6f57513a21488c18a8714fa1d59266144c282ac77a376b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-12T11:21:01.328 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:01 smithi176 podman[72364]: 2024-05-12 11:21:01.33069126 +0000 UTC m=+0.424354155 container init a9317e141f45bdebb6f57513a21488c18a8714fa1d59266144c282ac77a376b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-12T11:21:01.636 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:01 smithi176 podman[72364]: 2024-05-12 11:21:01.334247641 +0000 UTC m=+0.427910526 container start a9317e141f45bdebb6f57513a21488c18a8714fa1d59266144c282ac77a376b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux ) 2024-05-12T11:21:01.636 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:01 smithi176 podman[72364]: 2024-05-12 11:21:01.414249731 +0000 UTC m=+0.507912616 container attach a9317e141f45bdebb6f57513a21488c18a8714fa1d59266144c282ac77a376b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-12T11:21:01.957 INFO:journalctl@ceph.osd.2.smithi176.stdout:May 12 11:21:01 smithi176 podman[72364]: 2024-05-12 11:21:01.638528748 +0000 UTC m=+0.732191644 container died a9317e141f45bdebb6f57513a21488c18a8714fa1d59266144c282ac77a376b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-2-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-12T11:21:02.300 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.2.service' 2024-05-12T11:21:02.340 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:21:02.340 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-12T11:21:02.340 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-12T11:21:02.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.3 2024-05-12T11:21:02.665 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:02 smithi086 systemd[1]: Stopping Ceph osd.3 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:21:02.969 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:21:02.667+0000 7f7ce7232700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:21:02.969 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:21:02.667+0000 7f7ce7232700 -1 osd.3 96 *** Got signal Terminated *** 2024-05-12T11:21:02.969 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:02 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:21:02.667+0000 7f7ce7232700 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:04.969 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:04 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:21:04.567+0000 7f7cdf81e700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.062235+0000 front 2024-05-12T11:20:42.062258+0000 (oldest deadline 2024-05-12T11:21:03.762440+0000) 2024-05-12T11:21:05.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:04 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:04.710+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:05.719 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:05 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:21:05.535+0000 7f7cdf81e700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.062235+0000 front 2024-05-12T11:20:42.062258+0000 (oldest deadline 2024-05-12T11:21:03.762440+0000) 2024-05-12T11:21:05.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:05 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:05.404+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:06.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:05 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:05.697+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:06.719 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:06 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:21:06.493+0000 7f7cdf81e700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.062235+0000 front 2024-05-12T11:20:42.062258+0000 (oldest deadline 2024-05-12T11:21:03.762440+0000) 2024-05-12T11:21:06.719 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:06 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:06.267+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:06.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:06 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:06.367+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:06.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:06.391+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:07.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:06.730+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:07.688 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:07.407+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:07.719 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:07 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:07.238+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:07.719 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:07 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3[48750]: 2024-05-12T11:21:07.470+0000 7f7cdf81e700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.062235+0000 front 2024-05-12T11:20:42.062258+0000 (oldest deadline 2024-05-12T11:21:03.762440+0000) 2024-05-12T11:21:07.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:07 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:07.326+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:08.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:07.764+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:08.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:07.690+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:08.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:07 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:07.817+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:08.265 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:07 smithi086 podman[95943]: 2024-05-12 11:21:07.975096758 +0000 UTC m=+5.437146331 container died d5e2dd689446f70987580efb3b3798189ef57280c43d8f6b69f17f1ac3749ee3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-12T11:21:08.624 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:08 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:08.267+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:08.624 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:08 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:08.276+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:08.625 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:08 smithi086 podman[95943]: 2024-05-12 11:21:08.375904011 +0000 UTC m=+5.837953635 container cleanup d5e2dd689446f70987580efb3b3798189ef57280c43d8f6b69f17f1ac3749ee3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0) 2024-05-12T11:21:08.625 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:08 smithi086 bash[95943]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3 2024-05-12T11:21:08.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:08.360+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:08.944 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:08 smithi086 podman[95961]: 2024-05-12 11:21:08.62710412 +0000 UTC m=+0.648136264 container remove d5e2dd689446f70987580efb3b3798189ef57280c43d8f6b69f17f1ac3749ee3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-12T11:21:09.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:08.732+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:09.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:08.730+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:09.202 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:08 smithi086 podman[96053]: 2024-05-12 11:21:08.850644561 +0000 UTC m=+0.018306902 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:21:09.203 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:08 smithi086 podman[96053]: 2024-05-12 11:21:08.969780547 +0000 UTC m=+0.137442921 container create d3097b0cbcf36f393a70c326e3aed3bafa2b03d41f9b66ad4660430ac778cb89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-12T11:21:09.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:08 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:08.797+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:09.469 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:09 smithi086 podman[96053]: 2024-05-12 11:21:09.205498866 +0000 UTC m=+0.373161197 container init d3097b0cbcf36f393a70c326e3aed3bafa2b03d41f9b66ad4660430ac778cb89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-12T11:21:09.470 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:09 smithi086 podman[96053]: 2024-05-12 11:21:09.209049905 +0000 UTC m=+0.376712237 container start d3097b0cbcf36f393a70c326e3aed3bafa2b03d41f9b66ad4660430ac778cb89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-12T11:21:09.470 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:09 smithi086 podman[96053]: 2024-05-12 11:21:09.313950514 +0000 UTC m=+0.481612862 container attach d3097b0cbcf36f393a70c326e3aed3bafa2b03d41f9b66ad4660430ac778cb89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:21:09.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:09 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:09.288+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:09.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:09 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:09.247+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:09.711 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:09.375+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:09.865 INFO:journalctl@ceph.osd.3.smithi086.stdout:May 12 11:21:09 smithi086 podman[96053]: 2024-05-12 11:21:09.500127367 +0000 UTC m=+0.667789705 container died d3097b0cbcf36f393a70c326e3aed3bafa2b03d41f9b66ad4660430ac778cb89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:21:10.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:09.729+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:10.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:09.714+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:10.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:09 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:09.806+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:10.242 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.3.service' 2024-05-12T11:21:10.286 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:21:10.286 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-12T11:21:10.286 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-12T11:21:10.286 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.4 2024-05-12T11:21:10.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:10 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:10.336+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:10.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:10 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:10.204+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:10.594 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:10 smithi172 systemd[1]: Stopping Ceph osd.4 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:21:10.688 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:10.347+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:10.969 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:10.708+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:10.969 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:10.690+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:10.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:10 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:10.771+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:10.980 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:10 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4[45768]: 2024-05-12T11:21:10.596+0000 7f05efdca700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:21:10.980 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:10 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4[45768]: 2024-05-12T11:21:10.596+0000 7f05efdca700 -1 osd.4 96 *** Got signal Terminated *** 2024-05-12T11:21:10.980 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:10 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4[45768]: 2024-05-12T11:21:10.596+0000 7f05efdca700 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:11.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:11 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:11.364+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:11.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:11 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:11.158+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:11.650 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:11 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:11.387+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:12.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:11 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:11.735+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:12.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:11 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:11.652+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:12.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:11 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:11.784+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:12.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:12.133+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:12.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:12.372+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:12.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:12 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:12.372+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:12.767 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:12 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:12.422+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:12.767 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:12 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:12.659+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:13.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:12 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:12.769+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:13.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:12 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:12.735+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:13.230 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:12 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:12.808+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:13.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:13 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:13.143+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:13.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:13 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:13.364+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:13.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:13 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:13.364+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:13.679 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:13 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:13.401+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:13.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:13 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:13.770+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:13.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:13 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:13.685+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:13.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:13 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:13.685+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:14.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:13 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:13.799+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:14.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:13 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:13.681+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:14.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:13 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:13.681+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:14.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:14.325+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:14.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:14.325+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:14.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:14.185+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:14.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:14.185+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:14.632 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:14 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:14.362+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:14.632 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:14 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:14.362+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:14.959 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:14 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:14.771+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:14.960 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:14 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:14.704+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:14.960 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:14 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:14.704+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:15.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:14 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:14.767+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:15.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:14 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:14.634+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:15.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:14 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:14.634+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:15.230 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:14 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4[45768]: 2024-05-12T11:21:14.961+0000 7f05e83b6700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:49.854079+0000 front 2024-05-12T11:20:49.854105+0000 (oldest deadline 2024-05-12T11:21:14.554215+0000) 2024-05-12T11:21:15.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:15.333+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:15.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:15.333+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:15.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:15.215+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:15.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:15 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:15.215+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:15.681 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:15 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:15.407+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:15.681 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:15 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:15.407+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:15.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:15 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:15.726+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:15.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:15 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:15.723+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:15.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:15 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:15.723+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:16.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:15 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:15.725+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:16.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:15 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:15.683+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:16.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:15 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:15.683+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:16.411 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:16 smithi172 podman[71366]: 2024-05-12 11:21:16.097573856 +0000 UTC m=+5.616535042 container died 5c9346018318a252cd65115eb9dfeb3a726cc2bdc4aa6cadeb2771752d3dd328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5) 2024-05-12T11:21:16.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:16.332+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:16.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:16.332+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:16.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:16.206+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:16.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:16 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:16.206+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:16.690 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:16 smithi172 podman[71366]: 2024-05-12 11:21:16.504281474 +0000 UTC m=+6.023242659 container cleanup 5c9346018318a252cd65115eb9dfeb3a726cc2bdc4aa6cadeb2771752d3dd328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:21:16.690 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:16 smithi172 bash[71366]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4 2024-05-12T11:21:16.770 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:16.389+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:16.771 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:16.389+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:16.771 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:16.637+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:16.771 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:16.637+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:16.980 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:16 smithi172 podman[71383]: 2024-05-12 11:21:16.772555921 +0000 UTC m=+0.673499776 container remove 5c9346018318a252cd65115eb9dfeb3a726cc2bdc4aa6cadeb2771752d3dd328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-05-12T11:21:16.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:16.692+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:16.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:16.729+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:16.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:16 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:16.729+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:17.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:16 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:16.772+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:17.441 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:17 smithi172 podman[71472]: 2024-05-12 11:21:17.084490012 +0000 UTC m=+0.017812295 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:21:17.441 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:17 smithi172 podman[71472]: 2024-05-12 11:21:17.198381231 +0000 UTC m=+0.131703514 container create 6ed067f7b27b0558da5a853cb7d2636ac8231bfb3692f96c553ced3936df33d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-12T11:21:17.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:17 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:17.343+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:17.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:17 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:17.343+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:17.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:17 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:17.209+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:17.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:17 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:17.209+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:17.728 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:17 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:17.648+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:17.729 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:17 smithi172 podman[71472]: 2024-05-12 11:21:17.44366255 +0000 UTC m=+0.376984833 container init 6ed067f7b27b0558da5a853cb7d2636ac8231bfb3692f96c553ced3936df33d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4-deactivate, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-12T11:21:17.729 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:17 smithi172 podman[71472]: 2024-05-12 11:21:17.446754586 +0000 UTC m=+0.380076874 container start 6ed067f7b27b0558da5a853cb7d2636ac8231bfb3692f96c553ced3936df33d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240507) 2024-05-12T11:21:17.729 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:17 smithi172 podman[71472]: 2024-05-12 11:21:17.543669245 +0000 UTC m=+0.476991531 container attach 6ed067f7b27b0558da5a853cb7d2636ac8231bfb3692f96c553ced3936df33d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-12T11:21:17.773 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:17 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:17.625+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:17.773 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:17 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:17.625+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:17.773 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:17 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:17.409+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:17.773 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:17 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:17.409+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:17.980 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 12 11:21:17 smithi172 podman[71472]: 2024-05-12 11:21:17.748787557 +0000 UTC m=+0.682109849 container died 6ed067f7b27b0558da5a853cb7d2636ac8231bfb3692f96c553ced3936df33d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-12T11:21:17.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:17 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:17.729+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:17.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:17 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:17.729+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:18.273 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:17 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:17.784+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:18.387 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.4.service' 2024-05-12T11:21:18.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:21:18.430 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-12T11:21:18.430 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-12T11:21:18.430 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.5 2024-05-12T11:21:18.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:18.348+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:18.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:18.348+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:18.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:18.165+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:18.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:18 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:18.165+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:18.718 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:18.602+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:18.761 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:18.410+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:18.761 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:18.410+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:18.761 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:18 smithi176 systemd[1]: Stopping Ceph osd.5 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:21:18.762 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:18.634+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:18.762 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:18.634+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:18.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:18.720+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:18.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:18 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:18.720+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:19.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:18 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:18.763+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:19.369 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:19.036+0000 7f53c73ac700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:21:19.370 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:19.036+0000 7f53c73ac700 -1 osd.5 96 *** Got signal Terminated *** 2024-05-12T11:21:19.370 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:19.036+0000 7f53c73ac700 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:19.370 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:19.370+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:19.370 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:19.370+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:19.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:19.369+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:19.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:19.369+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:19.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:19.190+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:19.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:19.190+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:19.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:19 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:19.566+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:19.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:19 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:19.718+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:19.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:19 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:19.718+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:20.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:19.738+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:20.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:19.649+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:20.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:19 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:19.649+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:20.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:20.371+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:20.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:20.371+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:20.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:20.145+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:20.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:20 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:20.145+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:20.758 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:20.403+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:20.758 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:20.403+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:20.758 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:20.403+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.087732+0000 front 2024-05-12T11:20:59.087784+0000 (oldest deadline 2024-05-12T11:21:20.088462+0000) 2024-05-12T11:21:20.758 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:20.623+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:20.758 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:20.623+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:20.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:20 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:20.524+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:20.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:20 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:20.748+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:20.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:20 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:20.748+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:21.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:20.759+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:21.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:20 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:20.759+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:21.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:21.333+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:21.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:21.333+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:21.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:21.101+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:21.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:21.101+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:21.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:21 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:21.101+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:21.715 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:21.580+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:21.715 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:21.580+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:21.715 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:21.444+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:21.715 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:21.444+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:21.715 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:21.444+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.087732+0000 front 2024-05-12T11:20:59.087784+0000 (oldest deadline 2024-05-12T11:21:20.088462+0000) 2024-05-12T11:21:21.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:21 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:21.714+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:21.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:21 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:21.714+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:21.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:21 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:21.560+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:21.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:21 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:21.560+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:22.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:21.717+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:22.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:21 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:21.717+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:22.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:22.329+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:22.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:22.329+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:22.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:22.117+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:22.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:22.117+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:22.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:22.117+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:22.693 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:22.595+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:22.693 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:22.595+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:22.693 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:22.403+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:22.693 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:22.403+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:22.693 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:22.403+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.087732+0000 front 2024-05-12T11:20:59.087784+0000 (oldest deadline 2024-05-12T11:21:20.088462+0000) 2024-05-12T11:21:22.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:22.672+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:22.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:22.672+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:22.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:22.672+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:22.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:22.533+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:22.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:22 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:22.533+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:23.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:22.695+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:23.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:22 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:22.695+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:23.363 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:23.100+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:23.363 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:23.100+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:23.363 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:23.100+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:23.719 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:23.365+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:23.719 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:23 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:23.365+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:23.773 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:23.606+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:23.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:23.606+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:23.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:23.666+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:23.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:23.666+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:23.775 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:23.451+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:42.884804+0000 front 2024-05-12T11:20:42.884542+0000 (oldest deadline 2024-05-12T11:21:05.784566+0000) 2024-05-12T11:21:23.775 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:23.451+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.485555+0000 front 2024-05-12T11:20:50.485518+0000 (oldest deadline 2024-05-12T11:21:13.985666+0000) 2024-05-12T11:21:23.775 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:23 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5[46174]: 2024-05-12T11:21:23.451+0000 7f53bf998700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.087732+0000 front 2024-05-12T11:20:59.087784+0000 (oldest deadline 2024-05-12T11:21:20.088462+0000) 2024-05-12T11:21:23.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:23 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:23.523+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:23.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:23 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:23.523+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:23.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:23 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:23.708+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:23.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:23 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:23.708+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:23.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:23 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:23.708+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:24.409 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:24.079+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:24.409 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:24.079+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:24.409 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:24.079+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:24.659 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:24 smithi176 podman[72472]: 2024-05-12 11:21:24.405530404 +0000 UTC m=+5.776392908 container died 37c4c9d351ba1749bbd5a5585fc55a8759fb291aab4e565ceec05025cde0e99f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-12T11:21:24.659 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:24 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:24.597+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:24.659 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:24 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:24.597+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:24.659 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:24 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:24.597+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:24.719 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:24.410+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:24.720 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:24.410+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:24.720 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:24 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:24.410+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.401372+0000 front 2024-05-12T11:20:59.401391+0000 (oldest deadline 2024-05-12T11:21:24.101147+0000) 2024-05-12T11:21:24.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:24 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:24.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:24.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:24 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:24.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:24.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:24 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:24.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:24.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:24 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:24.519+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:24.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:24 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:24.519+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:25.023 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:24 smithi176 podman[72472]: 2024-05-12 11:21:24.795646249 +0000 UTC m=+6.166508746 container cleanup 37c4c9d351ba1749bbd5a5585fc55a8759fb291aab4e565ceec05025cde0e99f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-12T11:21:25.023 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:24 smithi176 bash[72472]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5 2024-05-12T11:21:25.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:24 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:24.660+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:25.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:24 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:24.660+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:25.385 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:25 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:25.112+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:25.385 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:25 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:25.112+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:25.385 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:25 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:25.112+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:25.402 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:25 smithi176 podman[72489]: 2024-05-12 11:21:25.097450956 +0000 UTC m=+0.691141401 container remove 37c4c9d351ba1749bbd5a5585fc55a8759fb291aab4e565ceec05025cde0e99f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-12T11:21:25.706 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:25 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:25.623+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:25.706 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:25 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:25.623+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:25.707 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:25 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:25.627+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:25.707 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:25 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:25.627+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:25.707 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:25 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:25.627+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:25.707 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:25 smithi176 podman[72575]: 2024-05-12 11:21:25.307911117 +0000 UTC m=+0.017911696 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:21:25.707 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:25 smithi176 podman[72575]: 2024-05-12 11:21:25.431526661 +0000 UTC m=+0.141527238 container create 96afb368d6e81e2eef22938f8e7281a375ffce7b08499797c752aa3961ca9075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5-deactivate, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:21:25.707 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:25 smithi176 podman[72575]: 2024-05-12 11:21:25.642264457 +0000 UTC m=+0.352265038 container init 96afb368d6e81e2eef22938f8e7281a375ffce7b08499797c752aa3961ca9075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux ) 2024-05-12T11:21:25.707 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:25 smithi176 podman[72575]: 2024-05-12 11:21:25.645199665 +0000 UTC m=+0.355200253 container start 96afb368d6e81e2eef22938f8e7281a375ffce7b08499797c752aa3961ca9075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD) 2024-05-12T11:21:25.707 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:25 smithi176 podman[72575]: 2024-05-12 11:21:25.708947736 +0000 UTC m=+0.418948314 container attach 96afb368d6e81e2eef22938f8e7281a375ffce7b08499797c752aa3961ca9075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:21:25.719 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:25 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:25.386+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:25.719 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:25 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:25.386+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:25.719 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:25 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:25.386+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.401372+0000 front 2024-05-12T11:20:59.401391+0000 (oldest deadline 2024-05-12T11:21:24.101147+0000) 2024-05-12T11:21:25.730 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:25 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:25.470+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:25.730 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:25 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:25.470+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:25.730 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:25 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:25.698+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:25.730 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:25 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:25.698+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:25.730 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:25 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:25.698+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:26.023 INFO:journalctl@ceph.osd.5.smithi176.stdout:May 12 11:21:25 smithi176 podman[72575]: 2024-05-12 11:21:25.931815927 +0000 UTC m=+0.641816503 container died 96afb368d6e81e2eef22938f8e7281a375ffce7b08499797c752aa3961ca9075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:21:26.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:26.358+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:26.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:26.358+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:26.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:26.358+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.401372+0000 front 2024-05-12T11:20:59.401391+0000 (oldest deadline 2024-05-12T11:21:24.101147+0000) 2024-05-12T11:21:26.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:26.140+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:26.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:26.140+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:26.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:26.140+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:26.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.5.service' 2024-05-12T11:21:26.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:21:26.550 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-12T11:21:26.550 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-12T11:21:26.550 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.6 2024-05-12T11:21:26.743 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:26 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:26.490+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:26.743 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:26 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:26.490+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:26.773 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:26 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:26.657+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:26.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:26 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:26.658+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:26.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:26 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:26.658+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:26.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:26 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:26.593+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:26.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:26 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:26.593+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:26.843 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:26 smithi086 systemd[1]: Stopping Ceph osd.6 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:21:27.176 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:26.845+0000 7f061aa0b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:21:27.176 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:26.845+0000 7f061aa0b700 -1 osd.6 96 *** Got signal Terminated *** 2024-05-12T11:21:27.176 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:26 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:26.845+0000 7f061aa0b700 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:27.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:26 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:26.745+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:27.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:26 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:26.745+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:27.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:26 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:26.745+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:27.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:27 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:27.315+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:27.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:27 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:27.315+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:27.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:27 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:27.315+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.401372+0000 front 2024-05-12T11:20:59.401391+0000 (oldest deadline 2024-05-12T11:21:24.101147+0000) 2024-05-12T11:21:27.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:27 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:27.178+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:27.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:27 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:27.178+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:27.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:27 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:27.178+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:27.782 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:27 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:27.507+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:27.782 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:27 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:27.507+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:28.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:27 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:27.572+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:28.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:27 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:27.572+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:28.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:27 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:27.645+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:28.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:27 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:27.645+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:28.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:27 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:27.645+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:28.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:27 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:27.784+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:28.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:27 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:27.784+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:28.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:27 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:27.784+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:28.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:28 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:28.205+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:28.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:28 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:28.205+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:28.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:28 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:28.205+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:28.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:28 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:28.300+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:28.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:28 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:28.301+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:28.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:28 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:28.301+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.401372+0000 front 2024-05-12T11:20:59.401391+0000 (oldest deadline 2024-05-12T11:21:24.101147+0000) 2024-05-12T11:21:28.807 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:28 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:28.541+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:28.807 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:28 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:28.541+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:29.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:28 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:28.539+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:29.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:28 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:28.539+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:29.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:28 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:28.611+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:29.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:28 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:28.611+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:29.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:28 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:28.611+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:29.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:28 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:28.611+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:29.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:28 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:28.808+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:29.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:28 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:28.808+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:29.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:28 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:28.808+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:29.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:29.298+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:29.469 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:29.298+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:29.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:29.298+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.401372+0000 front 2024-05-12T11:20:59.401391+0000 (oldest deadline 2024-05-12T11:21:24.101147+0000) 2024-05-12T11:21:29.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:29.203+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:29.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:29.203+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:29.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:29 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:29.203+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:29.835 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:29 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:29.587+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:29.835 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:29 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:29.587+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:30.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:29 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:29.549+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:30.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:29 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:29.549+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:30.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:29 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:29.652+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:30.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:29 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:29.652+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:30.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:29 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:29.652+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:30.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:29 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:29.652+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:30.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:29 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:29.838+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:30.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:29 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:29.838+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:30.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:29 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:29.838+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:30.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:30 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:30.285+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:30.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:30 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:30.285+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:30.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:30 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:30.285+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.401372+0000 front 2024-05-12T11:20:59.401391+0000 (oldest deadline 2024-05-12T11:21:24.101147+0000) 2024-05-12T11:21:30.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:30 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:30.198+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:30.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:30 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:30.198+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:30.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:30 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:30.198+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:30.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:30 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:30.513+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:30.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:30 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:30.513+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:30.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:30 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:30.611+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:30.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:30 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:30.611+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:30.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:30 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:30.611+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:30.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:30 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:30.611+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:30.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:30 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:30.791+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:30.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:30 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:30.791+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:30.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:30 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:30.791+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:30.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:30 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:30.617+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:30.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:30 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:30.617+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:30.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:30 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:30.617+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:31.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:31 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:31.332+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:40.698660+0000 front 2024-05-12T11:20:40.698750+0000 (oldest deadline 2024-05-12T11:21:05.998777+0000) 2024-05-12T11:21:31.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:31 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:31.332+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:45.999226+0000 front 2024-05-12T11:20:45.999410+0000 (oldest deadline 2024-05-12T11:21:11.899253+0000) 2024-05-12T11:21:31.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:31 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6[55262]: 2024-05-12T11:21:31.332+0000 7f0612ff7700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.401372+0000 front 2024-05-12T11:20:59.401391+0000 (oldest deadline 2024-05-12T11:21:24.101147+0000) 2024-05-12T11:21:31.471 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:31 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:31.194+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:31.471 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:31 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:31.194+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:31.471 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:31 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:31.194+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:31.795 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:31 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:31.540+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:31.795 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:31 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:31.540+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:31.795 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:31 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:31.540+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:31.796 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:31 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:31.622+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:31.796 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:31 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:31.622+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:31.796 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:31 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:31.622+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:31.796 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:31 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:31.622+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:31.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:31 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:31.598+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:31.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:31 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:31.598+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:31.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:31 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:31.598+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:31.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:31 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:31.745+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:31.982 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:31 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:31.745+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:31.982 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:31 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:31.745+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:32.470 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:32 smithi086 podman[96173]: 2024-05-12 11:21:32.252385968 +0000 UTC m=+5.502523075 container died 9534a682394e21404563e02002863aaf1d8f702b77ff871ba6a5e4a5d0143c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-05-12T11:21:32.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:32 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:32.159+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:32.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:32 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:32.159+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:32.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:32 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:32.159+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:32.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:32 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:32.159+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:32.911 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:32 smithi086 podman[96173]: 2024-05-12 11:21:32.65348974 +0000 UTC m=+5.903626856 container cleanup 9534a682394e21404563e02002863aaf1d8f702b77ff871ba6a5e4a5d0143c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:21:32.911 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:32 smithi086 bash[96173]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6 2024-05-12T11:21:32.974 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:32 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:32.574+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:32.975 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:32 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:32.574+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:32.975 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:32 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:32.574+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:32.975 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:32 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:32.655+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:32.975 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:32 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:32.655+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:32.975 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:32 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:32.655+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:32.975 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:32 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:32.655+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:32.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:32 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:32.637+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:32.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:32 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:32.637+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:32.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:32 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:32.637+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:32.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:32 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:32.779+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:32.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:32 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:32.779+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:32.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:32 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:32.779+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:32.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:32 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:32.779+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:33.219 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:32 smithi086 podman[96190]: 2024-05-12 11:21:32.913533484 +0000 UTC m=+0.654906148 container remove 9534a682394e21404563e02002863aaf1d8f702b77ff871ba6a5e4a5d0143c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-12T11:21:33.220 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:33 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:33.129+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:33.220 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:33 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:33.129+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:33.220 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:33 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:33.129+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:33.220 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:33 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:33.129+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:33.614 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:33 smithi086 podman[96279]: 2024-05-12 11:21:33.181068528 +0000 UTC m=+0.018047486 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:21:33.614 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:33 smithi086 podman[96279]: 2024-05-12 11:21:33.281005944 +0000 UTC m=+0.117984938 container create 77e420b6289c581988da6012ce1324e6d654ef43532c7cd4176959b43233b9b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-12T11:21:33.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:33 smithi086 podman[96279]: 2024-05-12 11:21:33.516591005 +0000 UTC m=+0.353569954 container init 77e420b6289c581988da6012ce1324e6d654ef43532c7cd4176959b43233b9b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-12T11:21:33.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:33 smithi086 podman[96279]: 2024-05-12 11:21:33.520098562 +0000 UTC m=+0.357077511 container start 77e420b6289c581988da6012ce1324e6d654ef43532c7cd4176959b43233b9b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD) 2024-05-12T11:21:33.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:33 smithi086 podman[96279]: 2024-05-12 11:21:33.616534489 +0000 UTC m=+0.453513454 container attach 77e420b6289c581988da6012ce1324e6d654ef43532c7cd4176959b43233b9b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-12T11:21:33.970 INFO:journalctl@ceph.osd.6.smithi086.stdout:May 12 11:21:33 smithi086 podman[96279]: 2024-05-12 11:21:33.821805431 +0000 UTC m=+0.658784387 container died 77e420b6289c581988da6012ce1324e6d654ef43532c7cd4176959b43233b9b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True) 2024-05-12T11:21:33.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:33 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:33.611+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:33.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:33 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:33.611+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:33.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:33 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:33.611+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:33.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:33 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:33.805+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:33.982 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:33 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:33.805+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:33.982 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:33 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:33.805+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:33.982 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:33 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:33.805+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:34.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:33.617+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:34.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:33.617+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:34.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:33.617+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:34.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:33.636+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:34.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:33.636+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:34.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:33.636+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:34.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:33 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:33.636+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:34.451 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:34 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:34.164+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:34.451 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:34 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:34.164+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:34.451 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:34 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:34.164+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:34.451 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:34 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:34.164+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:34.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.6.service' 2024-05-12T11:21:34.510 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:21:34.510 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-12T11:21:34.511 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-12T11:21:34.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.7 2024-05-12T11:21:34.815 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:34 smithi172 systemd[1]: Stopping Ceph osd.7 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:21:34.815 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:34.614+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:34.815 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:34.614+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:34.815 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:34.614+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:34.815 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:34.815+0000 7f30dd485700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:21:34.815 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:34.815+0000 7f30dd485700 -1 osd.7 96 *** Got signal Terminated *** 2024-05-12T11:21:34.815 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:34.815+0000 7f30dd485700 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:35.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:34 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:34.586+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:35.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:34 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:34.586+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:35.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:34 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:34.586+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:35.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:34 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:34.685+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:35.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:34 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:34.685+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:35.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:34 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:34.685+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:35.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:34 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:34.685+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:35.077 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:34.823+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:35.078 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:34.823+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:35.078 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:34.823+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:35.078 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:34 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:34.823+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:35.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:35 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:35.177+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:35.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:35 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:35.177+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:35.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:35 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:35.177+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:35.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:35 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:35.177+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:35.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:35.595+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:35.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:35.595+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:35.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:35.595+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:35.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:35.818+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:35.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:35.818+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:35.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:35.818+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:35.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:35.818+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:36.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:35 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:35.553+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:36.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:35 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:35.553+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:36.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:35 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:35.553+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:36.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:35 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:35.656+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:36.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:35 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:35.656+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:36.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:35 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:35.656+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:36.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:35 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:35.656+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:36.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:36 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:36.165+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:36.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:36 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:36.165+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:36.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:36 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:36.165+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:36.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:36 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:36.165+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:36.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:36 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:36.511+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:36.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:36 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:36.511+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:36.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:36 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:36.511+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:36.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:36 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:36.511+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:36.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:36 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:36.645+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:36.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:36 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:36.645+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:36.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:36 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:36.645+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:36.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:36 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:36.645+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:36.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:36 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:36.626+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:36.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:36 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:36.626+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:36.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:36 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:36.626+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:36.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:36 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:36.793+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:36.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:36 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:36.793+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:36.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:36 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:36.793+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:36.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:36 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:36.793+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:37.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:37 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:37.159+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:37.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:37 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:37.159+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:37.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:37 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:37.159+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:37.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:37 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:37.159+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:37.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:37.502+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:37.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:37.502+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:37.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:37.502+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:37.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:37.502+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:37.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:37.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:37.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:37.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:37.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:37.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:37.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:37.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:37.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:37 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:37.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:37.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:37 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:37.583+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:37.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:37 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:37.583+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:37.981 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:37 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:37.583+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:37.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:37 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:37.814+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:37.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:37 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:37.814+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:37.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:37 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:37.814+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:37.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:37 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:37.814+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:38.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:38 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:38.198+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:38.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:38 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:38.198+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:38.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:38 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:38.198+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:38.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:38 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:38.198+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:38.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:38.456+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:38.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:38.456+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:38.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:38.456+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:38.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:38.456+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:38.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:38.566+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:38.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:38.566+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:38.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:38.566+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:38.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:38.566+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:38.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:38 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:38.566+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:38.830 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:38 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:38.572+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:38.830 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:38 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:38.572+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:38.830 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:38 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:38.572+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:38.830 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:38 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:38.572+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.224629+0000 front 2024-05-12T11:21:14.224693+0000 (oldest deadline 2024-05-12T11:21:38.225234+0000) 2024-05-12T11:21:39.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:38 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:38.831+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:39.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:38 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:38.831+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:39.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:38 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:38.831+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:39.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:38 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:38.831+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:39.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:39.204+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:39.469 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:39.204+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:39.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:39.204+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:39.470 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:39 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:39.204+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:39.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:39.457+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:39.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:39.457+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:39.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:39.457+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:39.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:39.457+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:39.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:39.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:39.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:39.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:39.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:39.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:39.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:39.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:39.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:39 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:39.615+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:39.868 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:39.555+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:50.420090+0000 front 2024-05-12T11:20:50.420148+0000 (oldest deadline 2024-05-12T11:21:12.120305+0000) 2024-05-12T11:21:39.868 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:39.555+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.721740+0000 front 2024-05-12T11:20:56.722056+0000 (oldest deadline 2024-05-12T11:21:20.821865+0000) 2024-05-12T11:21:39.868 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:39.555+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.423583+0000 front 2024-05-12T11:21:05.423622+0000 (oldest deadline 2024-05-12T11:21:30.123638+0000) 2024-05-12T11:21:39.868 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7[52622]: 2024-05-12T11:21:39.555+0000 7f30d9a79700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.224629+0000 front 2024-05-12T11:21:14.224693+0000 (oldest deadline 2024-05-12T11:21:38.225234+0000) 2024-05-12T11:21:40.134 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:39.869+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:40.134 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:39.869+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:40.134 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:39.869+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:40.135 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:39.869+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:40.135 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:39 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:39.869+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:40.425 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:40 smithi172 podman[71580]: 2024-05-12 11:21:40.136802098 +0000 UTC m=+5.435303174 container died 26a3c646ba155aa7a6b7e6805810637dd06f2439db9a4f0c3c90647d8ec59ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:21:40.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:40 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:40.253+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:40.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:40 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:40.253+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:40.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:40 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:40.253+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:40.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:40 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:40.253+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:40.730 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:40 smithi172 podman[71580]: 2024-05-12 11:21:40.526283343 +0000 UTC m=+5.824784418 container cleanup 26a3c646ba155aa7a6b7e6805810637dd06f2439db9a4f0c3c90647d8ec59ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-12T11:21:40.730 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:40 smithi172 bash[71580]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:40.500+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:40.500+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:40.500+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:40.500+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:40.621+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:40.621+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:40.621+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:40.621+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:40.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:40 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:40.621+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:41.135 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:40 smithi172 podman[71610]: 2024-05-12 11:21:40.794076463 +0000 UTC m=+0.650623781 container remove 26a3c646ba155aa7a6b7e6805810637dd06f2439db9a4f0c3c90647d8ec59ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-12T11:21:41.136 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:40 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:40.832+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:41.136 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:40 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:40.832+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:41.136 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:40 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:40.832+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:41.136 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:40 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:40.832+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:41.136 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:40 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:40.832+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:41.388 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:41 smithi172 podman[71699]: 2024-05-12 11:21:41.040956571 +0000 UTC m=+0.018147661 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:21:41.388 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:41 smithi172 podman[71699]: 2024-05-12 11:21:41.145051238 +0000 UTC m=+0.122242302 container create a33fd2f93b7c507e1f63d60ad421efac5fa5c3530bddd156db50e11265de16c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True) 2024-05-12T11:21:41.388 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:41 smithi172 podman[71699]: 2024-05-12 11:21:41.390123171 +0000 UTC m=+0.367314233 container init a33fd2f93b7c507e1f63d60ad421efac5fa5c3530bddd156db50e11265de16c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS) 2024-05-12T11:21:41.687 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:41 smithi172 podman[71699]: 2024-05-12 11:21:41.393399948 +0000 UTC m=+0.370591011 container start a33fd2f93b7c507e1f63d60ad421efac5fa5c3530bddd156db50e11265de16c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-12T11:21:41.687 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:41 smithi172 podman[71699]: 2024-05-12 11:21:41.481734036 +0000 UTC m=+0.458925114 container attach a33fd2f93b7c507e1f63d60ad421efac5fa5c3530bddd156db50e11265de16c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-12T11:21:41.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:41 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:41.266+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:41.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:41 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:41.266+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:41.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:41 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:41.266+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:41.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:41 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:41.266+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:41.980 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 12 11:21:41 smithi172 podman[71699]: 2024-05-12 11:21:41.690224143 +0000 UTC m=+0.667415211 container died a33fd2f93b7c507e1f63d60ad421efac5fa5c3530bddd156db50e11265de16c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-12T11:21:41.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:41 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:41.785+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:41.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:41 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:41.785+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:41.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:41 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:41.785+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:41.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:41 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:41.785+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:41.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:41 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:41.785+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:42.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:41.531+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:42.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:41.531+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:42.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:41.531+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:42.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:41.531+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:42.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:41.599+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:42.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:41.599+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:42.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:41.599+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:42.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:41.599+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:42.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:41 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:41.599+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:42.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.7.service' 2024-05-12T11:21:42.433 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:21:42.434 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-12T11:21:42.434 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-12T11:21:42.434 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.8 2024-05-12T11:21:42.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:42.299+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:42.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:42.299+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:42.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:42.299+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:42.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:42 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:42.299+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:42.771 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:42.632+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:42.771 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:42.632+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:42.771 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:42.632+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:42.771 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:42.632+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:42.771 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:42.632+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:42.771 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:42 smithi176 systemd[1]: Stopping Ceph osd.8 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:21:42.771 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:42.552+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:42.771 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:42.552+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:42.772 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:42.552+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:42.772 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:42.552+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:42.772 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:42.772+0000 7f9d75f62700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:21:42.772 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:42.772+0000 7f9d75f62700 -1 osd.8 96 *** Got signal Terminated *** 2024-05-12T11:21:42.772 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:42 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:42.772+0000 7f9d75f62700 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:43.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:42 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:42.765+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:43.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:42 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:42.765+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:43.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:42 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:42.765+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:43.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:42 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:42.765+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:43.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:42 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:42.765+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:43.621 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:43 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:43.279+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:43.621 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:43 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:43.279+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:43.621 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:43 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:43.279+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:43.621 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:43 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:43.279+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:43.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:43.517+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:43.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:43.517+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:43.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:43.517+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:43.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:43.517+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:43.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:43.672+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:43.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:43.672+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:43.774 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:43.672+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:43.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:43.672+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:43.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:43 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:43.672+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:44.230 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:43 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:43.757+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:44.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:43 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:43.757+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:44.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:43 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:43.757+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:44.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:43 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:43.757+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:44.231 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:43 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:43.757+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:44.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:44 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:44.245+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:44.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:44 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:44.245+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:44.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:44 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:44.245+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:44.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:44 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:44.245+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:44.773 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:44.515+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:44.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:44.515+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:44.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:44.515+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:44.774 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:44.515+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:44.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:44.709+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:44.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:44.709+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:44.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:44.709+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:44.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:44.709+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:44.775 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:44 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:44.709+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:44.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:44 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:44.708+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:44.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:44 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:44.708+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:44.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:44 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:44.708+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:44.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:44 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:44.708+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:44.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:44 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:44.708+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:45.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:45 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:45.280+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:45.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:45 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:45.280+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:45.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:45 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:45.280+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:45.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:45 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:45.280+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:45.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:45 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:45.744+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:45.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:45 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:45.744+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:45.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:45 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:45.744+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:45.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:45 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:45.744+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:45.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:45 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:45.744+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:45.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:45 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:45.744+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:46.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:45.526+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:46.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:45.526+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:46.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:45.526+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:46.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:45.526+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:46.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:45.690+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:46.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:45.690+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:46.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:45.690+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:46.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:45.690+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:46.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:45 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:45.690+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:46.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:46 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:46.294+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:46.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:46 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:46.294+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:46.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:46 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:46.294+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:46.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:46 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:46.294+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:46.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:46.717+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:46.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:46.717+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:46.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:46.717+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:46.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:46.717+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:46.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:46.717+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:46.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:46 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:46.717+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:47.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:46.547+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:47.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:46.547+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:47.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:46.547+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:47.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:46.547+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:47.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:46.675+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:47.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:46.675+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:47.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:46.675+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:47.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:46.675+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:47.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:46 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:46.675+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:47.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:47 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:47.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:47.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:47 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:47.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:47.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:47 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:47.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:47.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:47 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:47.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:47.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:47 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:47.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:47.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:47 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:47.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:47.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:47 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:47.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:47.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:47 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:47.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:47.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:47 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:47.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:47.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:47 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:47.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:47.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:47 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:47.676+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:48.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:47.557+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.487626+0000 front 2024-05-12T11:20:41.487797+0000 (oldest deadline 2024-05-12T11:21:06.787714+0000) 2024-05-12T11:21:48.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:47.557+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:57.890229+0000 front 2024-05-12T11:20:57.890195+0000 (oldest deadline 2024-05-12T11:21:20.090683+0000) 2024-05-12T11:21:48.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:47.557+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:05.292093+0000 front 2024-05-12T11:21:05.292162+0000 (oldest deadline 2024-05-12T11:21:31.191821+0000) 2024-05-12T11:21:48.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8[53157]: 2024-05-12T11:21:47.557+0000 7f9d6e54e700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:11.192475+0000 front 2024-05-12T11:21:11.192390+0000 (oldest deadline 2024-05-12T11:21:36.392950+0000) 2024-05-12T11:21:48.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:47.651+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:48.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:47.651+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:48.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:47.651+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:48.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:47.651+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:48.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:47 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:47.651+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:48.524 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:48 smithi176 podman[72693]: 2024-05-12 11:21:48.260808533 +0000 UTC m=+5.612981454 container died 40e95d0c0dbbc59dfbc54456f18c4b98729aa036227fae15868c4fb51759ee18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-12T11:21:48.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:48 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:48.322+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:48.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:48 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:48.322+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:48.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:48 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:48.322+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:48.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:48 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:48.322+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:48.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:48 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:48.322+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:48.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:48 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:48.633+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:48.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:48 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:48.633+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:48.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:48 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:48.633+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:48.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:48 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:48.633+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:48.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:48 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:48.633+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:48.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:48 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:48.633+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:49.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:48 smithi176 podman[72693]: 2024-05-12 11:21:48.639318514 +0000 UTC m=+5.991491433 container cleanup 40e95d0c0dbbc59dfbc54456f18c4b98729aa036227fae15868c4fb51759ee18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:21:49.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:48 smithi176 bash[72693]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8 2024-05-12T11:21:49.024 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:48 smithi176 podman[72711]: 2024-05-12 11:21:48.773635236 +0000 UTC m=+0.502384402 container remove 40e95d0c0dbbc59dfbc54456f18c4b98729aa036227fae15868c4fb51759ee18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:21:49.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:48 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:48.620+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:49.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:48 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:48.620+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:49.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:48 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:48.620+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:49.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:48 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:48.620+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:49.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:48 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:48.620+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:49.441 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:49 smithi176 podman[72799]: 2024-05-12 11:21:49.080935207 +0000 UTC m=+0.018159361 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:21:49.441 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:49 smithi176 podman[72799]: 2024-05-12 11:21:49.191005954 +0000 UTC m=+0.128230099 container create 23fe2f5a5508e1cb891388c54bbd898c502ff0c8f3ef4e528bb1636e04d31065 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-12T11:21:49.441 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:49 smithi176 podman[72799]: 2024-05-12 11:21:49.443634941 +0000 UTC m=+0.380859086 container init 23fe2f5a5508e1cb891388c54bbd898c502ff0c8f3ef4e528bb1636e04d31065 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-12T11:21:49.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:49 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:49.311+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:49.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:49 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:49.311+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:49.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:49 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:49.311+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:49.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:49 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:49.311+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:49.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:49 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:49.311+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:49.739 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:49 smithi176 podman[72799]: 2024-05-12 11:21:49.447050701 +0000 UTC m=+0.384274851 container start 23fe2f5a5508e1cb891388c54bbd898c502ff0c8f3ef4e528bb1636e04d31065 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:21:49.739 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:49 smithi176 podman[72799]: 2024-05-12 11:21:49.543737407 +0000 UTC m=+0.480961574 container attach 23fe2f5a5508e1cb891388c54bbd898c502ff0c8f3ef4e528bb1636e04d31065 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-12T11:21:49.739 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:49 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:49.661+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:49.740 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:49 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:49.661+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:49.740 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:49 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:49.661+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:49.740 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:49 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:49.661+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:49.740 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:49 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:49.661+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:49.740 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:49 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:49.661+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:49.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:49 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:49.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:49.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:49 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:49.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:49.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:49 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:49.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:49.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:49 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:49.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:49.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:49 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:49.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:49.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:49 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:49.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:50.023 INFO:journalctl@ceph.osd.8.smithi176.stdout:May 12 11:21:49 smithi176 podman[72799]: 2024-05-12 11:21:49.7416162 +0000 UTC m=+0.678840346 container died 23fe2f5a5508e1cb891388c54bbd898c502ff0c8f3ef4e528bb1636e04d31065 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True) 2024-05-12T11:21:50.370 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.8.service' 2024-05-12T11:21:50.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:21:50.409 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-12T11:21:50.409 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-12T11:21:50.409 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.9 2024-05-12T11:21:50.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:50.342+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:50.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:50.342+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:50.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:50.342+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:50.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:50.342+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:50.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:50.342+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:50.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 systemd[1]: Stopping Ceph osd.9 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:21:50.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:50 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:50.667+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:50.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:50 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:50.667+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:50.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:50 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:50.667+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:50.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:50 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:50.667+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:50.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:50 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:50.667+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:50.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:50 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:50.667+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:51.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:50 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:50.648+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:51.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:50 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:50.648+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:51.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:50 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:50.648+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:51.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:50 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:50.648+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:51.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:50 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:50.648+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:51.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:50 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:50.648+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:51.219 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:50.722+0000 7fe78ae3c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:21:51.219 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:50.722+0000 7fe78ae3c700 -1 osd.9 96 *** Got signal Terminated *** 2024-05-12T11:21:51.220 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:50 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:50.722+0000 7fe78ae3c700 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:51.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:51 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:51.340+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:51.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:51 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:51.340+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:51.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:51 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:51.340+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:51.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:51 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:51.340+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:51.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:51 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:51.340+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:51.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:51 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:51.655+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:51.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:51 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:51.655+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:51.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:51 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:51.655+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:51.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:51 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:51.655+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:51.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:51 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:51.655+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:51.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:51 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:51.655+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:52.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:51 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:51.609+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:52.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:51 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:51.609+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:52.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:51 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:51.609+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:52.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:51 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:51.609+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:52.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:51 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:51.609+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:52.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:51 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:51.609+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:52.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:52 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:52.345+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:52.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:52 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:52.345+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:52.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:52 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:52.345+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:52.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:52 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:52.345+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:52.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:52 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:52.345+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:52.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:52 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:52.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:52.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:52 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:52.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:52.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:52 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:52.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:52.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:52 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:52.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:52.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:52 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:52.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:52.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:52 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:52.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:53.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:52 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:52.658+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:53.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:52 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:52.658+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:53.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:52 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:52.658+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:53.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:52 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:52.658+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:53.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:52 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:52.658+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:53.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:52 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:52.658+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:53.680 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:53 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:53.313+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:53.680 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:53 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:53.313+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:53.680 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:53 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:53.313+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:53.680 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:53 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:53.313+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:53.680 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:53 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:53.313+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:53.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:53 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:53.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:53.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:53 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:53.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:53.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:53 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:53.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:53.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:53 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:53.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:53.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:53 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:53.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:53.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:53 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:53.683+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:54.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:53 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:53.625+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:54.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:53 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:53.625+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:54.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:53 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:53.625+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:54.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:53 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:53.625+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:54.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:53 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:53.625+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:54.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:53 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:53.625+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:54.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:54 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:54.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:54.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:54 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:54.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:54.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:54 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:54.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:54.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:54 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:54.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:54.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:54 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:54.304+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:54.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:54 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:54.644+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:54.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:54 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:54.644+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:54.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:54 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:54.644+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:54.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:54 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:54.644+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:54.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:54 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:54.644+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:54.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:54 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:54.644+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:55.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:54.633+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:55.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:54.633+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:55.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:54.633+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:55.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:54.633+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:55.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:54.633+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:55.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:54 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:54.633+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:55.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:55 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:55.277+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.697251+0000 front 2024-05-12T11:20:41.697286+0000 (oldest deadline 2024-05-12T11:21:05.197340+0000) 2024-05-12T11:21:55.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:55 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:55.277+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:47.999176+0000 front 2024-05-12T11:20:47.999110+0000 (oldest deadline 2024-05-12T11:21:13.898987+0000) 2024-05-12T11:21:55.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:55 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:55.277+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.200244+0000 front 2024-05-12T11:20:56.200186+0000 (oldest deadline 2024-05-12T11:21:20.800739+0000) 2024-05-12T11:21:55.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:55 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:55.277+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:06.602287+0000 front 2024-05-12T11:21:06.602496+0000 (oldest deadline 2024-05-12T11:21:31.902480+0000) 2024-05-12T11:21:55.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:55 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9[61976]: 2024-05-12T11:21:55.277+0000 7fe787430700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.804988+0000 front 2024-05-12T11:21:21.804911+0000 (oldest deadline 2024-05-12T11:21:46.504835+0000) 2024-05-12T11:21:55.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:55 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:55.681+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:55.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:55 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:55.681+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:55.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:55 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:55.681+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:55.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:55 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:55.681+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:55.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:55 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:55.681+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:55.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:55 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:55.681+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:55.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:55 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:55.681+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:21:56.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:55.674+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:56.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:55.674+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:56.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:55.674+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:56.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:55.674+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:56.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:55.674+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:56.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:55.674+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:56.430 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:56 smithi086 podman[96396]: 2024-05-12 11:21:56.147559161 +0000 UTC m=+5.535871353 container died 272e2215ed78a325fef64052a3b714b22b89d5c7ed63559b5a4c2eb3437cf283 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-12T11:21:56.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:56 smithi086 podman[96396]: 2024-05-12 11:21:56.5225924 +0000 UTC m=+5.910904586 container cleanup 272e2215ed78a325fef64052a3b714b22b89d5c7ed63559b5a4c2eb3437cf283 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:21:56.719 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:56 smithi086 bash[96396]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9 2024-05-12T11:21:56.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:56 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:56.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:56.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:56 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:56.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:56.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:56 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:56.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:56.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:56 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:56.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:56.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:56 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:56.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:56.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:56 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:56.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:56.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:56 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:56.656+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:21:57.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:56 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:56.715+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:57.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:56 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:56.715+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:57.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:56 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:56.715+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:57.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:56 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:56.715+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:57.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:56 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:56.715+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:57.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:56 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:56.715+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:57.080 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:56 smithi086 podman[96413]: 2024-05-12 11:21:56.773779738 +0000 UTC m=+0.618012084 container remove 272e2215ed78a325fef64052a3b714b22b89d5c7ed63559b5a4c2eb3437cf283 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:21:57.407 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:57 smithi086 podman[96506]: 2024-05-12 11:21:57.082634551 +0000 UTC m=+0.103342222 container create 6c069536cefa5b4994557349d111702f3e6daf7186a363efa288e59eb81a3c40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-12T11:21:57.407 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:57 smithi086 podman[96506]: 2024-05-12 11:21:56.997777739 +0000 UTC m=+0.018485417 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:21:57.407 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:57 smithi086 podman[96506]: 2024-05-12 11:21:57.309776896 +0000 UTC m=+0.330484565 container init 6c069536cefa5b4994557349d111702f3e6daf7186a363efa288e59eb81a3c40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5) 2024-05-12T11:21:57.407 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:57 smithi086 podman[96506]: 2024-05-12 11:21:57.313811851 +0000 UTC m=+0.334519511 container start 6c069536cefa5b4994557349d111702f3e6daf7186a363efa288e59eb81a3c40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9-deactivate, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-12T11:21:57.408 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:57 smithi086 podman[96506]: 2024-05-12 11:21:57.409781391 +0000 UTC m=+0.430489060 container attach 6c069536cefa5b4994557349d111702f3e6daf7186a363efa288e59eb81a3c40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-12T11:21:57.720 INFO:journalctl@ceph.osd.9.smithi086.stdout:May 12 11:21:57 smithi086 podman[96506]: 2024-05-12 11:21:57.609316081 +0000 UTC m=+0.630023760 container died 6c069536cefa5b4994557349d111702f3e6daf7186a363efa288e59eb81a3c40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-12T11:21:57.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:57 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:57.630+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:57.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:57 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:57.630+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:57.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:57 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:57.630+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:57.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:57 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:57.630+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:57.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:57 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:57.630+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:57.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:57 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:57.630+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:57.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:57 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:57.630+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:21:58.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:57.711+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:58.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:57.711+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:58.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:57.711+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:58.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:57.711+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:58.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:57.711+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:58.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:57 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:57.711+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:58.230 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.9.service' 2024-05-12T11:21:58.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:21:58.270 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-12T11:21:58.270 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-12T11:21:58.270 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.10 2024-05-12T11:21:58.585 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 systemd[1]: Stopping Ceph osd.10 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:21:58.585 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.586+0000 7f44ef221700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:21:58.585 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.586+0000 7f44ef221700 -1 osd.10 96 *** Got signal Terminated *** 2024-05-12T11:21:58.585 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.586+0000 7f44ef221700 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:21:58.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.632+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:58.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.632+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:58.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.632+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:58.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.632+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:58.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.632+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:58.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.632+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:58.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:58 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:58.632+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:21:59.023 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:58 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:58.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:21:59.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:58 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:58.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:21:59.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:58 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:58.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:21:59.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:58 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:58.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:21:59.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:58 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:58.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:21:59.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:58 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:58.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:21:59.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:59.616+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:21:59.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:59.616+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:21:59.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:59.616+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:21:59.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:59.616+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:21:59.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:59.616+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:21:59.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:59.616+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:21:59.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:21:59 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:21:59.616+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:22:00.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:59.734+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:00.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:59.734+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:00.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:59.734+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:00.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:59.734+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:00.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:59.734+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:00.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:21:59 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:21:59.734+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:00.980 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:00.574+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:22:00.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:00.574+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:22:00.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:00.574+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:22:00.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:00.574+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:22:00.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:00.574+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:22:00.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:00.574+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:22:00.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:00 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:00.574+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:22:01.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:00.741+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:01.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:00.741+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:01.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:00.741+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:01.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:00.741+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:01.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:00.741+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:01.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:00.741+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:01.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:01.593+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:22:01.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:01.593+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:22:01.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:01.593+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:22:01.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:01.593+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:22:01.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:01.593+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:22:01.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:01.593+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:22:01.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:01 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:01.593+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:22:02.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:01.787+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:02.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:01.787+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:02.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:01.787+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:02.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:01.787+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:02.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:01.787+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:02.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:01 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:01.787+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:02.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:02.565+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:22:02.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:02.565+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:22:02.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:02.565+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:22:02.981 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:02.565+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:22:02.982 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:02.565+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:22:02.982 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:02.565+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:22:02.982 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:02 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:02.565+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:22:03.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:02 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:02.751+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:03.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:02 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:02.751+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:03.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:02 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:02.751+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:03.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:02 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:02.751+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:03.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:02 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:02.751+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:03.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:02 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:02.751+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:03.906 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:03.526+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:41.223423+0000 front 2024-05-12T11:20:41.223679+0000 (oldest deadline 2024-05-12T11:21:07.023949+0000) 2024-05-12T11:22:03.906 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:03.526+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:51.025477+0000 front 2024-05-12T11:20:51.025361+0000 (oldest deadline 2024-05-12T11:21:13.325526+0000) 2024-05-12T11:22:03.906 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:03.526+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:56.226597+0000 front 2024-05-12T11:20:56.226498+0000 (oldest deadline 2024-05-12T11:21:22.126559+0000) 2024-05-12T11:22:03.906 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:03.526+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:07.328113+0000 front 2024-05-12T11:21:07.328224+0000 (oldest deadline 2024-05-12T11:21:32.028074+0000) 2024-05-12T11:22:03.907 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:03.526+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:14.328981+0000 front 2024-05-12T11:21:14.329010+0000 (oldest deadline 2024-05-12T11:21:39.629116+0000) 2024-05-12T11:22:03.907 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:03.526+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.230673+0000 front 2024-05-12T11:21:21.230610+0000 (oldest deadline 2024-05-12T11:21:45.330430+0000) 2024-05-12T11:22:03.907 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:03 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10[59404]: 2024-05-12T11:22:03.526+0000 7f44e780d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-05-12T11:21:30.631390+0000 front 2024-05-12T11:21:30.631420+0000 (oldest deadline 2024-05-12T11:21:54.731226+0000) 2024-05-12T11:22:04.160 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:03 smithi172 podman[71805]: 2024-05-12 11:22:03.908606219 +0000 UTC m=+5.448408454 container died 630dd2188483282f17f26f156184d88f676bffc76df2cb5ea4d13afc3cf07b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-12T11:22:04.273 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:03 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:03.775+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:04.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:03 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:03.775+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:04.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:03 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:03.775+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:04.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:03 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:03.775+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:04.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:03 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:03.775+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:04.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:03 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:03.775+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:04.480 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:04 smithi172 podman[71805]: 2024-05-12 11:22:04.253075022 +0000 UTC m=+5.792877256 container cleanup 630dd2188483282f17f26f156184d88f676bffc76df2cb5ea4d13afc3cf07b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:22:04.480 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:04 smithi172 bash[71805]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10 2024-05-12T11:22:04.876 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:04 smithi172 podman[71822]: 2024-05-12 11:22:04.546118471 +0000 UTC m=+0.640765695 container remove 630dd2188483282f17f26f156184d88f676bffc76df2cb5ea4d13afc3cf07b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-12T11:22:05.196 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:04 smithi172 podman[71919]: 2024-05-12 11:22:04.782243081 +0000 UTC m=+0.018176897 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:22:05.197 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:04 smithi172 podman[71919]: 2024-05-12 11:22:04.913469528 +0000 UTC m=+0.149403395 container create e0b93fc6a9262ad9b693cb2579bc1db81cb0bc467fd9ea15f08378b1971e41ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-12T11:22:05.197 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:05 smithi172 podman[71919]: 2024-05-12 11:22:05.115394534 +0000 UTC m=+0.351328338 container init e0b93fc6a9262ad9b693cb2579bc1db81cb0bc467fd9ea15f08378b1971e41ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-12T11:22:05.197 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:05 smithi172 podman[71919]: 2024-05-12 11:22:05.118680104 +0000 UTC m=+0.354613917 container start e0b93fc6a9262ad9b693cb2579bc1db81cb0bc467fd9ea15f08378b1971e41ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507) 2024-05-12T11:22:05.197 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:05 smithi172 podman[71919]: 2024-05-12 11:22:05.198835632 +0000 UTC m=+0.434769458 container attach e0b93fc6a9262ad9b693cb2579bc1db81cb0bc467fd9ea15f08378b1971e41ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10-deactivate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:22:05.273 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:04 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:04.818+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:05.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:04 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:04.818+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:05.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:04 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:04.818+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:05.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:04 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:04.818+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:05.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:04 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:04.818+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:05.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:04 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:04.818+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:05.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:04 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:04.818+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-12T11:21:38.793585+0000 front 2024-05-12T11:21:38.793699+0000 (oldest deadline 2024-05-12T11:22:04.593802+0000) 2024-05-12T11:22:05.480 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:05 smithi172 podman[71919]: 2024-05-12 11:22:05.416941771 +0000 UTC m=+0.652875576 container died e0b93fc6a9262ad9b693cb2579bc1db81cb0bc467fd9ea15f08378b1971e41ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-12T11:22:06.016 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 12 11:22:06 smithi172 podman[71946]: 2024-05-12 11:22:06.002149282 +0000 UTC m=+0.580119998 container remove e0b93fc6a9262ad9b693cb2579bc1db81cb0bc467fd9ea15f08378b1971e41ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-12T11:22:06.022 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.10.service' 2024-05-12T11:22:06.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:06.060 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-12T11:22:06.060 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-12T11:22:06.060 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.11 2024-05-12T11:22:06.087 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:05 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:05.781+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:06.087 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:05 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:05.781+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:06.087 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:05 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:05.781+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:06.087 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:05 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:05.781+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:06.087 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:05 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:05.781+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:06.087 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:05 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:05.781+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:06.087 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:05 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:05.781+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-12T11:21:38.793585+0000 front 2024-05-12T11:21:38.793699+0000 (oldest deadline 2024-05-12T11:22:04.593802+0000) 2024-05-12T11:22:06.372 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 systemd[1]: Stopping Ceph osd.11 for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.373+0000 7f5ac9910700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.373+0000 7f5ac9910700 -1 osd.11 96 *** Got signal Terminated *** 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.373+0000 7f5ac9910700 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.760+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.760+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.760+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.760+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.760+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.760+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:06.759 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:06 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:06.760+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-12T11:21:38.793585+0000 front 2024-05-12T11:21:38.793699+0000 (oldest deadline 2024-05-12T11:22:04.593802+0000) 2024-05-12T11:22:08.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:07.778+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:08.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:07.778+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:08.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:07.778+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:08.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:07.778+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:08.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:07.778+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:08.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:07.778+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:08.274 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:07 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:07.778+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-12T11:21:38.793585+0000 front 2024-05-12T11:21:38.793699+0000 (oldest deadline 2024-05-12T11:22:04.593802+0000) 2024-05-12T11:22:09.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:08.739+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:09.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:08.739+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:09.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:08.739+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:09.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:08.739+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:09.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:08.739+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:09.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:08.739+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:09.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:08 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:08.739+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-12T11:21:38.793585+0000 front 2024-05-12T11:21:38.793699+0000 (oldest deadline 2024-05-12T11:22:04.593802+0000) 2024-05-12T11:22:10.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:09.696+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:10.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:09.696+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:10.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:09.696+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:10.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:09.696+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:10.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:09.696+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:10.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:09.696+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:10.025 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:09 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:09.696+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-12T11:21:38.793585+0000 front 2024-05-12T11:21:38.793699+0000 (oldest deadline 2024-05-12T11:22:04.593802+0000) 2024-05-12T11:22:11.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:10.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-05-12T11:20:38.085437+0000 front 2024-05-12T11:20:38.085216+0000 (oldest deadline 2024-05-12T11:21:03.985284+0000) 2024-05-12T11:22:11.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:10.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-12T11:20:48.686525+0000 front 2024-05-12T11:20:48.686506+0000 (oldest deadline 2024-05-12T11:21:12.786650+0000) 2024-05-12T11:22:11.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:10.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-05-12T11:20:59.188157+0000 front 2024-05-12T11:20:59.188190+0000 (oldest deadline 2024-05-12T11:21:23.888309+0000) 2024-05-12T11:22:11.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:10.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-05-12T11:21:04.389282+0000 front 2024-05-12T11:21:04.389363+0000 (oldest deadline 2024-05-12T11:21:28.489244+0000) 2024-05-12T11:22:11.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:10.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-12T11:21:13.190195+0000 front 2024-05-12T11:21:13.190209+0000 (oldest deadline 2024-05-12T11:21:36.690107+0000) 2024-05-12T11:22:11.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:10.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-05-12T11:21:21.191701+0000 front 2024-05-12T11:21:21.191755+0000 (oldest deadline 2024-05-12T11:21:48.792331+0000) 2024-05-12T11:22:11.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:10.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-12T11:21:38.793585+0000 front 2024-05-12T11:21:38.793699+0000 (oldest deadline 2024-05-12T11:22:04.593802+0000) 2024-05-12T11:22:11.024 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:10 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11[60179]: 2024-05-12T11:22:10.684+0000 7f5ac5f04700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.176:6820 osd.8 since back 2024-05-12T11:21:44.594115+0000 front 2024-05-12T11:21:44.594152+0000 (oldest deadline 2024-05-12T11:22:09.894101+0000) 2024-05-12T11:22:12.189 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:11 smithi176 podman[72915]: 2024-05-12 11:22:11.890720545 +0000 UTC m=+5.630205333 container died 49965f8b38b0141782daa4d2d9f97247151078d128028c74b6d26b28d3eb0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-12T11:22:12.524 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:12 smithi176 podman[72915]: 2024-05-12 11:22:12.256889821 +0000 UTC m=+5.996374599 container cleanup 49965f8b38b0141782daa4d2d9f97247151078d128028c74b6d26b28d3eb0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-12T11:22:12.524 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:12 smithi176 bash[72915]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11 2024-05-12T11:22:12.924 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:12 smithi176 podman[72931]: 2024-05-12 11:22:12.574833262 +0000 UTC m=+0.679308738 container remove 49965f8b38b0141782daa4d2d9f97247151078d128028c74b6d26b28d3eb0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-12T11:22:13.176 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:12 smithi176 podman[73020]: 2024-05-12 11:22:12.828942838 +0000 UTC m=+0.017751627 image pull 6791bdeb4eda1311f2ce917b502322db93f7269b36709c7d033a464e9f453413 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4 2024-05-12T11:22:13.176 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:12 smithi176 podman[73020]: 2024-05-12 11:22:12.94206475 +0000 UTC m=+0.130873521 container create 257348d5696a290577ef817a02a681b7ef5a36a031c9d7855a673bea9df2d390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-12T11:22:13.176 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:13 smithi176 podman[73020]: 2024-05-12 11:22:13.178360029 +0000 UTC m=+0.367168819 container init 257348d5696a290577ef817a02a681b7ef5a36a031c9d7855a673bea9df2d390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-12T11:22:13.471 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:13 smithi176 podman[73020]: 2024-05-12 11:22:13.181776457 +0000 UTC m=+0.370585229 container start 257348d5696a290577ef817a02a681b7ef5a36a031c9d7855a673bea9df2d390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5) 2024-05-12T11:22:13.471 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:13 smithi176 podman[73020]: 2024-05-12 11:22:13.252985754 +0000 UTC m=+0.441794549 container attach 257348d5696a290577ef817a02a681b7ef5a36a031c9d7855a673bea9df2d390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-12T11:22:13.753 INFO:journalctl@ceph.osd.11.smithi176.stdout:May 12 11:22:13 smithi176 podman[73020]: 2024-05-12 11:22:13.473567128 +0000 UTC m=+0.662375906 container died 257348d5696a290577ef817a02a681b7ef5a36a031c9d7855a673bea9df2d390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-osd-11-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:22:14.055 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@osd.11.service' 2024-05-12T11:22:14.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:14.131 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-12T11:22:14.132 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-12T11:22:14.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.a 2024-05-12T11:22:14.422 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:22:14 smithi086 systemd[1]: Stopping Ceph mds.a for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:14.689 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:22:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a[69267]: 2024-05-12T11:22:14.422+0000 7f889f043700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:14.689 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:22:14 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a[69267]: 2024-05-12T11:22:14.422+0000 7f889f043700 -1 mds.a *** got signal Terminated *** 2024-05-12T11:22:18.719 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:22:18 smithi086 podman[96612]: 2024-05-12 11:22:18.430655535 +0000 UTC m=+4.106580235 container died e11230b9fcd1c629b76ec9c21678f8c2019c0410312185506e35a389d5a53613 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:22:19.063 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:22:18 smithi086 podman[96612]: 2024-05-12 11:22:18.864320991 +0000 UTC m=+4.540245681 container cleanup e11230b9fcd1c629b76ec9c21678f8c2019c0410312185506e35a389d5a53613 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, ceph=True, org.label-schema.build-date=20240507) 2024-05-12T11:22:19.063 INFO:journalctl@ceph.mds.a.smithi086.stdout:May 12 11:22:18 smithi086 bash[96612]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-a 2024-05-12T11:22:19.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.a.service' 2024-05-12T11:22:19.324 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:19.324 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-12T11:22:19.324 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-12T11:22:19.324 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.d 2024-05-12T11:22:19.642 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:22:19 smithi086 systemd[1]: Stopping Ceph mds.d for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:19.970 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:22:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d[68002]: 2024-05-12T11:22:19.643+0000 7f76a571c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:19.970 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:22:19 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d[68002]: 2024-05-12T11:22:19.643+0000 7f76a571c700 -1 mds.d *** got signal Terminated *** 2024-05-12T11:22:21.632 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:22:21 smithi086 podman[96744]: 2024-05-12 11:22:21.339661469 +0000 UTC m=+1.793748491 container died a5800a290abdb05087555c02e8d4bbe8f4e6fcb33910b5b2e96e23612415e745 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507) 2024-05-12T11:22:21.633 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:22:21 smithi086 podman[96744]: 2024-05-12 11:22:21.634712064 +0000 UTC m=+2.088799084 container cleanup a5800a290abdb05087555c02e8d4bbe8f4e6fcb33910b5b2e96e23612415e745 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:22:21.970 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:22:21 smithi086 bash[96744]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d 2024-05-12T11:22:21.970 INFO:journalctl@ceph.mds.d.smithi086.stdout:May 12 11:22:21 smithi086 podman[96759]: 2024-05-12 11:22:21.877545789 +0000 UTC m=+0.526383396 container remove a5800a290abdb05087555c02e8d4bbe8f4e6fcb33910b5b2e96e23612415e745 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:22:22.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.d.service' 2024-05-12T11:22:22.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:22.054 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-12T11:22:22.054 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-12T11:22:22.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.g 2024-05-12T11:22:22.370 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:22:22 smithi086 systemd[1]: Stopping Ceph mds.g for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:22.720 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:22:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g[68813]: 2024-05-12T11:22:22.371+0000 7f3580de6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:22.720 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:22:22 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g[68813]: 2024-05-12T11:22:22.371+0000 7f3580de6700 -1 mds.g *** got signal Terminated *** 2024-05-12T11:22:26.720 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:22:26 smithi086 podman[96862]: 2024-05-12 11:22:26.376736928 +0000 UTC m=+4.104898563 container died 4d7310f5c6c3fba07c711e14c537a693d8c5412485d877b24449778d1856ef72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:22:27.204 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:22:26 smithi086 podman[96862]: 2024-05-12 11:22:26.796150943 +0000 UTC m=+4.524312577 container cleanup 4d7310f5c6c3fba07c711e14c537a693d8c5412485d877b24449778d1856ef72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-12T11:22:27.204 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:22:26 smithi086 bash[96862]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g 2024-05-12T11:22:27.204 INFO:journalctl@ceph.mds.g.smithi086.stdout:May 12 11:22:27 smithi086 podman[96876]: 2024-05-12 11:22:27.00569039 +0000 UTC m=+0.622714982 container remove 4d7310f5c6c3fba07c711e14c537a693d8c5412485d877b24449778d1856ef72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:22:27.219 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.g.service' 2024-05-12T11:22:27.252 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:27.252 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-12T11:22:27.252 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-12T11:22:27.253 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.j 2024-05-12T11:22:27.469 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:22:27 smithi086 systemd[1]: Stopping Ceph mds.j for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:27.970 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:22:27 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j[67557]: 2024-05-12T11:22:27.574+0000 7f38e6b42700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:27.970 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:22:27 smithi086 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j[67557]: 2024-05-12T11:22:27.574+0000 7f38e6b42700 -1 mds.j *** got signal Terminated *** 2024-05-12T11:22:29.365 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:22:29 smithi086 podman[96982]: 2024-05-12 11:22:29.000164596 +0000 UTC m=+1.526878533 container died 52c0a89746c112a3be0541366c90d5ec66b619c73180cb62f3d89775d0214b28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-12T11:22:29.716 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:22:29 smithi086 podman[96982]: 2024-05-12 11:22:29.458320856 +0000 UTC m=+1.985034782 container cleanup 52c0a89746c112a3be0541366c90d5ec66b619c73180cb62f3d89775d0214b28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-12T11:22:29.716 INFO:journalctl@ceph.mds.j.smithi086.stdout:May 12 11:22:29 smithi086 bash[96982]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-j 2024-05-12T11:22:29.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.j.service' 2024-05-12T11:22:29.914 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:29.914 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-12T11:22:29.914 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-12T11:22:29.914 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.b 2024-05-12T11:22:30.218 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:22:29 smithi172 systemd[1]: Stopping Ceph mds.b for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:30.480 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:22:30 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b[64771]: 2024-05-12T11:22:30.218+0000 7fb18b3b4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:30.481 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:22:30 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b[64771]: 2024-05-12T11:22:30.218+0000 7fb18b3b4700 -1 mds.b *** got signal Terminated *** 2024-05-12T11:22:34.481 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:22:34 smithi172 podman[72036]: 2024-05-12 11:22:34.224935798 +0000 UTC m=+4.112340069 container died d5ccd53698889b5c11dcf9053d2b0f3d81bd9f3d9d479f95552b2b90364d92e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-12T11:22:34.842 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:22:34 smithi172 podman[72036]: 2024-05-12 11:22:34.576587386 +0000 UTC m=+4.463991655 container cleanup d5ccd53698889b5c11dcf9053d2b0f3d81bd9f3d9d479f95552b2b90364d92e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-12T11:22:34.842 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 12 11:22:34 smithi172 bash[72036]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-b 2024-05-12T11:22:34.957 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.b.service' 2024-05-12T11:22:34.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:34.993 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-12T11:22:34.993 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-12T11:22:34.993 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.e 2024-05-12T11:22:35.231 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:22:35 smithi172 systemd[1]: Stopping Ceph mds.e for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:35.731 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:22:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e[64147]: 2024-05-12T11:22:35.329+0000 7f5b43e42700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:35.731 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:22:35 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e[64147]: 2024-05-12T11:22:35.329+0000 7f5b43e42700 -1 mds.e *** got signal Terminated *** 2024-05-12T11:22:39.231 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:22:38 smithi172 podman[72158]: 2024-05-12 11:22:38.977815971 +0000 UTC m=+3.760408299 container died 8602267d807b9c30a1186f4b5363c9cdc6b236818f9d1a44dfcc31059dbe379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240507) 2024-05-12T11:22:39.604 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:22:39 smithi172 podman[72158]: 2024-05-12 11:22:39.413166139 +0000 UTC m=+4.195758460 container cleanup 8602267d807b9c30a1186f4b5363c9cdc6b236818f9d1a44dfcc31059dbe379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux ) 2024-05-12T11:22:39.604 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 12 11:22:39 smithi172 bash[72158]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-e 2024-05-12T11:22:39.829 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.e.service' 2024-05-12T11:22:39.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:39.862 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-12T11:22:39.863 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-12T11:22:39.863 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.h 2024-05-12T11:22:40.190 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:22:39 smithi172 systemd[1]: Stopping Ceph mds.h for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:40.480 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:22:40 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h[64460]: 2024-05-12T11:22:40.192+0000 7f6badcfa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:40.481 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:22:40 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h[64460]: 2024-05-12T11:22:40.192+0000 7f6badcfa700 -1 mds.h *** got signal Terminated *** 2024-05-12T11:22:43.314 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:22:42 smithi172 podman[72290]: 2024-05-12 11:22:42.989148339 +0000 UTC m=+2.911244534 container died cbd4d8913856aec55d3192f81078b60989309a345f2ce843497b774ee5ba6446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-12T11:22:43.315 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:22:43 smithi172 podman[72290]: 2024-05-12 11:22:43.316620758 +0000 UTC m=+3.238716964 container cleanup cbd4d8913856aec55d3192f81078b60989309a345f2ce843497b774ee5ba6446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-12T11:22:43.718 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:22:43 smithi172 bash[72290]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h 2024-05-12T11:22:43.718 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 12 11:22:43 smithi172 podman[72304]: 2024-05-12 11:22:43.509405194 +0000 UTC m=+0.519071817 container remove cbd4d8913856aec55d3192f81078b60989309a345f2ce843497b774ee5ba6446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-h, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-12T11:22:43.736 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.h.service' 2024-05-12T11:22:43.768 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:43.768 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-12T11:22:43.769 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-12T11:22:43.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.k 2024-05-12T11:22:44.094 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:22:43 smithi172 systemd[1]: Stopping Ceph mds.k for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:44.480 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:22:44 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k[63828]: 2024-05-12T11:22:44.094+0000 7f0509b4a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:44.481 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:22:44 smithi172 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k[63828]: 2024-05-12T11:22:44.094+0000 7f0509b4a700 -1 mds.k *** got signal Terminated *** 2024-05-12T11:22:47.231 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:22:46 smithi172 podman[72411]: 2024-05-12 11:22:46.985527818 +0000 UTC m=+3.002376429 container died edaeeb374b3dd7994ce88720af99c2a8244b7094e334d60f04e313504cc92078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-12T11:22:47.594 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:22:47 smithi172 podman[72411]: 2024-05-12 11:22:47.361728978 +0000 UTC m=+3.378577592 container cleanup edaeeb374b3dd7994ce88720af99c2a8244b7094e334d60f04e313504cc92078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:22:47.594 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 12 11:22:47 smithi172 bash[72411]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-k 2024-05-12T11:22:47.743 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.k.service' 2024-05-12T11:22:47.778 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:47.778 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-12T11:22:47.778 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-12T11:22:47.778 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.c 2024-05-12T11:22:48.079 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:22:47 smithi176 systemd[1]: Stopping Ceph mds.c for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:48.524 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:22:48 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c[65600]: 2024-05-12T11:22:48.079+0000 7faa1daf2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:48.524 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:22:48 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c[65600]: 2024-05-12T11:22:48.079+0000 7faa1daf2700 -1 mds.c *** got signal Terminated *** 2024-05-12T11:22:51.274 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:22:50 smithi176 podman[73126]: 2024-05-12 11:22:50.98593335 +0000 UTC m=+3.006017854 container died 2a5c72407815e4ec079441b5d2216323584226db39689e23b01ec2d240cbbe84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-05-12T11:22:51.612 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:22:51 smithi176 podman[73126]: 2024-05-12 11:22:51.304428616 +0000 UTC m=+3.324513109 container cleanup 2a5c72407815e4ec079441b5d2216323584226db39689e23b01ec2d240cbbe84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-12T11:22:51.613 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:22:51 smithi176 bash[73126]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c 2024-05-12T11:22:51.613 INFO:journalctl@ceph.mds.c.smithi176.stdout:May 12 11:22:51 smithi176 podman[73151]: 2024-05-12 11:22:51.530525139 +0000 UTC m=+0.535121327 container remove 2a5c72407815e4ec079441b5d2216323584226db39689e23b01ec2d240cbbe84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-12T11:22:51.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.c.service' 2024-05-12T11:22:51.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:51.660 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-12T11:22:51.660 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-12T11:22:51.660 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.f 2024-05-12T11:22:51.965 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:22:51 smithi176 systemd[1]: Stopping Ceph mds.f for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:52.274 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:22:51 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f[65294]: 2024-05-12T11:22:51.966+0000 7f3a519d5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:52.274 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:22:51 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f[65294]: 2024-05-12T11:22:51.966+0000 7f3a519d5700 -1 mds.f *** got signal Terminated *** 2024-05-12T11:22:55.272 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:22:54 smithi176 podman[73259]: 2024-05-12 11:22:54.977346517 +0000 UTC m=+3.103058909 container died b18ed50f408895097a1a4b9f9ca7852d35dfe3c684c22420fcd86557627f2396 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-12T11:22:55.273 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:22:55 smithi176 podman[73259]: 2024-05-12 11:22:55.274634296 +0000 UTC m=+3.400346688 container cleanup b18ed50f408895097a1a4b9f9ca7852d35dfe3c684c22420fcd86557627f2396 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-12T11:22:55.524 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:22:55 smithi176 bash[73259]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f 2024-05-12T11:22:55.524 INFO:journalctl@ceph.mds.f.smithi176.stdout:May 12 11:22:55 smithi176 podman[73273]: 2024-05-12 11:22:55.509165147 +0000 UTC m=+0.524775297 container remove b18ed50f408895097a1a4b9f9ca7852d35dfe3c684c22420fcd86557627f2396 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-12T11:22:55.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.f.service' 2024-05-12T11:22:55.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:55.659 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-12T11:22:55.659 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-12T11:22:55.659 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.i 2024-05-12T11:22:55.976 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:22:55 smithi176 systemd[1]: Stopping Ceph mds.i for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:22:56.274 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:22:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i[65906]: 2024-05-12T11:22:55.977+0000 7f5fac78f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:22:56.274 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:22:55 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i[65906]: 2024-05-12T11:22:55.977+0000 7f5fac78f700 -1 mds.i *** got signal Terminated *** 2024-05-12T11:22:59.274 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:22:58 smithi176 podman[73379]: 2024-05-12 11:22:58.989162631 +0000 UTC m=+3.114225862 container died dae97fceaa9af3a091dbfafa7eca71bfee0c1bd4037b2b4d0838671c0e99bf0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-12T11:22:59.627 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:22:59 smithi176 podman[73379]: 2024-05-12 11:22:59.394455332 +0000 UTC m=+3.519518568 container cleanup dae97fceaa9af3a091dbfafa7eca71bfee0c1bd4037b2b4d0838671c0e99bf0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS) 2024-05-12T11:22:59.627 INFO:journalctl@ceph.mds.i.smithi176.stdout:May 12 11:22:59 smithi176 bash[73379]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-i 2024-05-12T11:22:59.766 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.i.service' 2024-05-12T11:22:59.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:22:59.797 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-12T11:22:59.798 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-12T11:22:59.798 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.l 2024-05-12T11:23:00.274 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:22:59 smithi176 systemd[1]: Stopping Ceph mds.l for 513c80a2-104e-11ef-bc98-c7b262605968... 2024-05-12T11:23:00.274 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:23:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l[64972]: 2024-05-12T11:23:00.114+0000 7fea1e742700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-12T11:23:00.274 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:23:00 smithi176 ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l[64972]: 2024-05-12T11:23:00.114+0000 7fea1e742700 -1 mds.l *** got signal Terminated *** 2024-05-12T11:23:03.274 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:23:02 smithi176 podman[73501]: 2024-05-12 11:23:02.972423099 +0000 UTC m=+2.957197027 container died d116c79b19031d21a53ef73bb096c0ed47f48c1f7f2b78e640fdce43068089d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882, org.label-schema.build-date=20240507) 2024-05-12T11:23:03.921 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:23:03 smithi176 podman[73501]: 2024-05-12 11:23:03.639358896 +0000 UTC m=+3.624132823 container cleanup d116c79b19031d21a53ef73bb096c0ed47f48c1f7f2b78e640fdce43068089d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b7b9b842f5bab6bca41dba3e6151c73951bdbb716c3e891ecd4c6064dbd972f4, name=ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiesce-lock-auth-f1ec882) 2024-05-12T11:23:03.921 INFO:journalctl@ceph.mds.l.smithi176.stdout:May 12 11:23:03 smithi176 bash[73501]: ceph-513c80a2-104e-11ef-bc98-c7b262605968-mds-l 2024-05-12T11:23:04.057 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-513c80a2-104e-11ef-bc98-c7b262605968@mds.l.service' 2024-05-12T11:23:04.088 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-12T11:23:04.088 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-12T11:23:04.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 513c80a2-104e-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-12T11:23:04.283 INFO:teuthology.orchestra.run.smithi086.stdout:Deleting cluster with fsid: 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T11:23:06.668 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 513c80a2-104e-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-12T11:23:06.858 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T11:23:09.243 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 513c80a2-104e-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-12T11:23:09.432 INFO:teuthology.orchestra.run.smithi176.stdout:Deleting cluster with fsid: 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T11:23:11.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-12T11:23:11.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-12T11:23:11.922 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-12T11:23:11.948 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-12T11:23:11.950 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi086/crash 2024-05-12T11:23:11.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash -- . 2024-05-12T11:23:11.992 INFO:teuthology.orchestra.run.smithi086.stderr:tar: /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-12T11:23:11.992 INFO:teuthology.orchestra.run.smithi086.stderr:tar: Error is not recoverable: exiting now 2024-05-12T11:23:11.994 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi172/crash 2024-05-12T11:23:11.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash -- . 2024-05-12T11:23:12.031 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-12T11:23:12.031 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-05-12T11:23:12.033 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi176/crash 2024-05-12T11:23:12.034 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash -- . 2024-05-12T11:23:12.064 INFO:teuthology.orchestra.run.smithi176.stderr:tar: /var/lib/ceph/513c80a2-104e-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-12T11:23:12.064 INFO:teuthology.orchestra.run.smithi176.stderr:tar: Error is not recoverable: exiting now 2024-05-12T11:23:12.065 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-12T11:23:12.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-12T11:23:12.101 INFO:tasks.cephadm:Compressing logs... 2024-05-12T11:23:12.102 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-12T11:23:12.144 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-12T11:23:12.147 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-12T11:23:12.178 INFO:teuthology.orchestra.run.smithi176.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log 2024-05-12T11:23:12.178 INFO:teuthology.orchestra.run.smithi176.stderr:: No such file or directory 2024-05-12T11:23:12.178 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.2.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.f.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log: /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.5.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.c.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log: /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.c.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.z.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.i.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr: 87.9% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-12T11:23:12.179 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.i.log: 90.5% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-12T11:23:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:: No such file or directory 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.g.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log: /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.j.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.3.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.0.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.x.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.a.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log.gz/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.x.log: 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.6.log 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.a.log: gzip 90.3% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-12T11:23:12.182 INFO:teuthology.orchestra.run.smithi086.stderr: -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-12T11:23:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.a.log 2024-05-12T11:23:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.6.log: /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log: 84.3% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-12T11:23:12.183 INFO:teuthology.orchestra.run.smithi086.stderr: 94.6% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.j.log.gz 2024-05-12T11:23:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-12T11:23:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.d.log 2024-05-12T11:23:12.188 INFO:teuthology.orchestra.run.smithi176.stderr: 92.0% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.z.log.gz 2024-05-12T11:23:12.188 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.11.log 2024-05-12T11:23:12.188 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.8.log 2024-05-12T11:23:12.188 INFO:teuthology.orchestra.run.smithi176.stderr: 83.9% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-12T11:23:12.188 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-12T11:23:12.189 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.7.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.b.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.4.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.1.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.y.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.h.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.10.log 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-12T11:23:12.190 INFO:teuthology.orchestra.run.smithi172.stderr: 90.5% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-12T11:23:12.191 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-12T11:23:12.191 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.e.log 2024-05-12T11:23:12.191 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log: 83.9% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-12T11:23:12.191 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-12T11:23:12.191 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.e.log: 91.9% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.y.log.gz 2024-05-12T11:23:12.191 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.b.log 2024-05-12T11:23:12.191 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.9.log 2024-05-12T11:23:12.194 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.k.log 2024-05-12T11:23:12.197 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.l.log 2024-05-12T11:23:12.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.d.log.gz 2024-05-12T11:23:12.198 INFO:teuthology.orchestra.run.smithi086.stderr: 91.1% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-12T11:23:12.198 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-12T11:23:12.200 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-12T11:23:12.203 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-12T11:23:12.204 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-12T11:23:12.223 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-12T11:23:12.223 INFO:teuthology.orchestra.run.smithi176.stderr: 91.0% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-12T11:23:12.227 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-12T11:23:12.227 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.c.log.gz 2024-05-12T11:23:12.230 INFO:teuthology.orchestra.run.smithi176.stderr: 93.3% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.f.log.gz 2024-05-12T11:23:12.235 INFO:teuthology.orchestra.run.smithi172.stderr: 93.3% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.b.log.gz 2024-05-12T11:23:12.237 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.9.log: /var/log/ceph/cephadm.log: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-12T11:23:12.241 INFO:teuthology.orchestra.run.smithi086.stderr: 94.5% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.g.log.gz 2024-05-12T11:23:12.242 INFO:teuthology.orchestra.run.smithi172.stderr: 93.3% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.h.log.gz 2024-05-12T11:23:12.245 INFO:teuthology.orchestra.run.smithi086.stderr: 94.5% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.a.log.gz 2024-05-12T11:23:12.263 INFO:teuthology.orchestra.run.smithi176.stderr: 94.6% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.l.log.gz 2024-05-12T11:23:12.286 INFO:teuthology.orchestra.run.smithi172.stderr: 94.4% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.k.log.gz 2024-05-12T11:23:12.490 INFO:teuthology.orchestra.run.smithi176.stderr: 91.9% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.c.log.gz 2024-05-12T11:23:12.552 INFO:teuthology.orchestra.run.smithi086.stderr: 90.1% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mgr.x.log.gz 2024-05-12T11:23:12.585 INFO:teuthology.orchestra.run.smithi172.stderr: 92.1% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.b.log.gz 2024-05-12T11:23:12.619 INFO:teuthology.orchestra.run.smithi172.stderr: 95.6% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.e.log.gz 2024-05-12T11:23:13.322 INFO:teuthology.orchestra.run.smithi086.stderr: 92.4% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.0.log.gz 2024-05-12T11:23:13.385 INFO:teuthology.orchestra.run.smithi086.stderr: 90.4% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mon.a.log.gz 2024-05-12T11:23:13.626 INFO:teuthology.orchestra.run.smithi176.stderr: 92.4% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.11.log.gz 2024-05-12T11:23:13.647 INFO:teuthology.orchestra.run.smithi172.stderr: 92.8% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.4.log.gz 2024-05-12T11:23:13.720 INFO:teuthology.orchestra.run.smithi172.stderr: 92.1% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.7.log.gz 2024-05-12T11:23:13.721 INFO:teuthology.orchestra.run.smithi086.stderr: 92.5% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.6.log.gz 2024-05-12T11:23:13.756 INFO:teuthology.orchestra.run.smithi086.stderr: 92.6% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.3.log.gz 2024-05-12T11:23:13.826 INFO:teuthology.orchestra.run.smithi172.stderr: 92.6% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.1.log.gz 2024-05-12T11:23:13.919 INFO:teuthology.orchestra.run.smithi086.stderr: 91.6% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.9.log.gz 2024-05-12T11:23:13.921 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-05-12T11:23:13.921 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m1.763s 2024-05-12T11:23:13.921 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m7.500s 2024-05-12T11:23:13.922 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m0.280s 2024-05-12T11:23:14.189 INFO:teuthology.orchestra.run.smithi176.stderr: 92.2% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.8.log.gz 2024-05-12T11:23:14.378 INFO:teuthology.orchestra.run.smithi172.stderr: 92.3% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.10.log.gz 2024-05-12T11:23:14.380 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-05-12T11:23:14.380 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m2.219s 2024-05-12T11:23:14.380 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m7.678s 2024-05-12T11:23:14.380 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.247s 2024-05-12T11:23:14.611 INFO:teuthology.orchestra.run.smithi176.stderr: 92.6% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.2.log.gz 2024-05-12T11:23:15.797 INFO:teuthology.orchestra.run.smithi176.stderr: 93.3% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-mds.i.log.gz 2024-05-12T11:23:16.524 INFO:teuthology.orchestra.run.smithi176.stderr: 95.2% -- replaced with /var/log/ceph/513c80a2-104e-11ef-bc98-c7b262605968/ceph-osd.5.log.gz 2024-05-12T11:23:16.527 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-05-12T11:23:16.527 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m4.366s 2024-05-12T11:23:16.527 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m13.886s 2024-05-12T11:23:16.527 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m0.462s 2024-05-12T11:23:16.527 INFO:tasks.cephadm:Archiving logs... 2024-05-12T11:23:16.527 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi086/log 2024-05-12T11:23:16.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-12T11:23:17.680 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi172/log 2024-05-12T11:23:17.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-12T11:23:18.896 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi176/log 2024-05-12T11:23:18.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-12T11:23:20.950 INFO:tasks.cephadm:Removing cluster... 2024-05-12T11:23:20.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 513c80a2-104e-11ef-bc98-c7b262605968 --force 2024-05-12T11:23:21.143 INFO:teuthology.orchestra.run.smithi086.stdout:Deleting cluster with fsid: 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T11:23:21.402 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 513c80a2-104e-11ef-bc98-c7b262605968 --force 2024-05-12T11:23:21.593 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T11:23:22.007 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 513c80a2-104e-11ef-bc98-c7b262605968 --force 2024-05-12T11:23:22.201 INFO:teuthology.orchestra.run.smithi176.stdout:Deleting cluster with fsid: 513c80a2-104e-11ef-bc98-c7b262605968 2024-05-12T11:23:22.471 INFO:tasks.cephadm:Removing cephadm ... 2024-05-12T11:23:22.471 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-12T11:23:22.490 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-12T11:23:22.507 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-12T11:23:22.522 INFO:tasks.cephadm:Teardown complete 2024-05-12T11:23:22.522 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-12T11:23:22.535 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-12T11:23:22.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-12T11:23:22.538 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-12T11:23:22.549 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-12T11:23:22.659 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-12T11:23:22.670 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-12T11:23:22.670 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T11:23:22.673 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T11:23:22.675 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T11:23:22.687 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-05-12T11:23:22.688 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-05-12T11:23:22.689 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-05-12T11:23:22.692 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-12T11:23:22.692 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-05-12T11:23:22.692 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 +918us[ +921us] +/- 67ms 2024-05-12T11:23:22.692 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -1236us[-1236us] +/- 77ms 2024-05-12T11:23:22.692 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +162us[ +165us] +/- 81ms 2024-05-12T11:23:22.692 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T11:23:22.693 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-12T11:23:22.693 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-05-12T11:23:22.693 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +972us[ +974us] +/- 67ms 2024-05-12T11:23:22.693 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -1197us[-1197us] +/- 77ms 2024-05-12T11:23:22.693 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +196us[ +196us] +/- 81ms 2024-05-12T11:23:22.693 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T11:23:22.694 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-12T11:23:22.694 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-05-12T11:23:22.694 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +912us[ +920us] +/- 67ms 2024-05-12T11:23:22.694 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -1249us[-1241us] +/- 77ms 2024-05-12T11:23:22.694 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +140us[ +149us] +/- 81ms 2024-05-12T11:23:22.694 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-12T11:23:22.696 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-12T11:23:22.708 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-12T11:23:22.709 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-12T11:23:22.723 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-12T11:23:22.816 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-12T11:23:22.883 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-12T11:23:22.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-12T11:23:22.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:23:22.979 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-12T11:23:23.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:23:23.007 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-12T11:23:23.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:23:23.034 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-12T11:23:23.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-12T11:23:23.133 INFO:teuthology.task.internal:Duration was 1968.816579 seconds 2024-05-12T11:23:23.133 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-12T11:23:23.145 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-12T11:23:23.146 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-12T11:23:23.148 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-12T11:23:23.151 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-12T11:23:23.187 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-12T11:23:23.188 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-12T11:23:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-12T11:23:23.562 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-12T11:23:23.562 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-05-12T11:23:23.562 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-12T11:23:23.586 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-05-12T11:23:23.586 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-12T11:23:23.616 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-05-12T11:23:23.616 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-12T11:23:23.644 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-12T11:23:23.644 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-12T11:23:23.647 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-12T11:23:23.658 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-12T11:23:23.710 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-12T11:23:23.710 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-12T11:23:23.715 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-12T11:23:23.726 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-12T11:23:24.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-12T11:23:24.358 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-12T11:23:24.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-12T11:23:24.384 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-12T11:23:24.409 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-12T11:23:24.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-12T11:23:24.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:23:24.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:23:24.451 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:23:24.470 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-05-12T11:23:24.472 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-05-12T11:23:24.498 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-05-12T11:23:24.534 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:23:24.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:23:24.549 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:23:24.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:23:24.563 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-12T11:23:24.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T11:23:24.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-12T11:23:24.605 INFO:teuthology.task.internal:Transferring archived files... 2024-05-12T11:23:24.606 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi086 2024-05-12T11:23:24.606 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-12T11:23:24.656 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi172 2024-05-12T11:23:24.656 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-12T11:23:24.692 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-12_10:14:03-fs-wip-lusov-quiesce-lock-auth-distro-default-smithi/7703279/remote/smithi176 2024-05-12T11:23:24.692 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-12T11:23:24.730 INFO:teuthology.task.internal:Removing archive directory... 2024-05-12T11:23:24.730 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-12T11:23:24.733 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-12T11:23:24.736 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-12T11:23:24.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-12T11:23:24.793 INFO:teuthology.task.internal:Not uploading archives. 2024-05-12T11:23:24.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-12T11:23:24.805 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-12T11:23:24.805 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-12T11:23:24.810 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-12T11:23:24.812 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-12T11:23:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: 265504 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 12 11:23 /home/ubuntu/cephtest 2024-05-12T11:23:24.824 INFO:teuthology.orchestra.run.smithi172.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 12 11:23 /home/ubuntu/cephtest 2024-05-12T11:23:24.834 INFO:teuthology.orchestra.run.smithi176.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 12 11:23 /home/ubuntu/cephtest 2024-05-12T11:23:24.835 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-12T11:23:24.848 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-12T11:23:24.876 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} duration: 1968.8165791034698 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-05-12T11:23:24.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-12T11:23:24.956 INFO:teuthology.run:pass